Jun 15 15:42:01 devstack cinder-volume[81199]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81199) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
Jun 15 15:42:01 devstack cinder-volume[81199]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81199) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
Jun 15 15:42:01 devstack cinder-volume[81199]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81199) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
Jun 15 15:42:02 devstack cinder-volume[81199]: INFO dbcounter [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] Registered counter for database cinder
Jun 15 15:42:02 devstack cinder-volume[81199]: DEBUG oslo_db.sqlalchemy.engines [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81199) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 15 15:42:02 devstack cinder-volume[81199]: DEBUG dbcounter [-] [81199] Writer thread running {{(pid=81199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jun 15 15:42:02 devstack cinder-volume[81199]: INFO cinder.rpc [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jun 15 15:42:02 devstack cinder-volume[81199]: INFO cinder.rpc [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jun 15 15:42:02 devstack cinder-volume[81199]: DEBUG oslo_db.sqlalchemy.engines [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81199) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 15 15:42:02 devstack cinder-volume[81199]: INFO cinder.volume.manager [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] Determined volume DB was empty at startup.
Jun 15 15:42:02 devstack cinder-volume[81199]: DEBUG cinder.volume.manager [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81199) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jun 15 15:42:02 devstack cinder-volume[81199]: INFO cinder.volume.manager [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] Service not found for updating active_backend_id, assuming default for driver init.
Jun 15 15:42:02 devstack cinder-volume[81199]: WARNING stevedore.named [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jun 15 15:42:02 devstack cinder-volume[81199]: WARNING castellan.key_manager [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jun 15 15:42:02 devstack cinder-volume[81199]: WARNING cinder.keymgr.conf_key_mgr [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jun 15 15:42:02 devstack cinder-volume[81199]: DEBUG cinder.volume.drivers.lvm [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=81199) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Jun 15 15:42:02 devstack cinder-volume[81199]: DEBUG oslo_concurrency.processutils [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=81199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:42:02 devstack cinder-volume[81199]: DEBUG oslo_concurrency.processutils [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] CMD "cinder-rtstool verify" returned: 0 in 0.375s {{(pid=81199) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:42:02 devstack cinder-volume[81199]: DEBUG oslo_db.sqlalchemy.engines [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81199) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 15 15:42:02 devstack cinder-volume[81199]: INFO cinder.rpc [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Jun 15 15:42:02 devstack cinder-volume[81199]: INFO cinder.rpc [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Jun 15 15:42:02 devstack cinder-volume[81199]: WARNING stevedore.named [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jun 15 15:42:02 devstack cinder-volume[81199]: WARNING castellan.key_manager [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jun 15 15:42:02 devstack cinder-volume[81199]: INFO cinder.volume.manager [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_db.sqlalchemy.engines [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81199) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 15 15:42:03 devstack cinder-volume[81199]: INFO oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] Starting 1 workers
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] Started child 81363 {{(pid=81199) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] Full set of CONF: {{(pid=81199) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] ******************************************************************************** {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] Configuration options gathered from: {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] ================================================================================ {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] allow_availability_zone_fallback = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] allow_compression_on_image_upload = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] allowed_direct_url_schemes     = [] {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] api_rate_limit                 = True {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] auth_strategy                  = keystone {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] az_cache_duration              = 3600 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] backend_availability_zone      = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] backend_host                   = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] backend_name                   = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] backend_stats_polling_interval = 60 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] backup_api_class               = cinder.backup.api.API {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] backup_name_template           = backup-%s {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] backup_use_same_host           = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] backup_use_temp_snapshot       = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] chap_password                  = **** {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] chap_username                  =  {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] cinder_internal_tenant_project_id = b3e869f071ed46cebff83ab881255643 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81363]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] cinder_internal_tenant_user_id = ef7d0f0b44dc4298b6f9b3f49fc5698d {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] cloned_volume_same_az          = True {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] cluster                        = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] compression_format             = gzip {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] compute_api_class              = cinder.compute.nova.API {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] config_dir                     = [] {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] config_source                  = [] {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] control_exchange               = openstack {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] debug                          = True {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] default_availability_zone      = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] default_group_type             = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] default_volume_type            = lvmdriver-1 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] disk_geometry                  = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] driver_client_cert             = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] driver_client_cert_key         = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] driver_data_namespace          = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] driver_ssl_cert_path           = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] driver_ssl_cert_verify         = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] driver_use_ssl                 = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] enable_force_upload            = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] enable_new_services            = True {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] enable_unsupported_driver      = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] enforce_multipath_for_image_xfer = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] filter_function                = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] glance_api_insecure            = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] glance_api_servers             = ['http://192.168.122.131/image'] {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] glance_api_ssl_compression     = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] glance_ca_certificates_file    = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] glance_catalog_info            = image:glance:publicURL {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] glance_certfile                = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] glance_keyfile                 = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] glance_num_retries             = 3 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] glance_request_timeout         = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] goodness_function              = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] graceful_shutdown_timeout      = 5 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] group_api_class                = cinder.group.api.API {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] host                           = devstack {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] image_compress_on_upload       = True {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] image_conversion_address_space_limit = 1 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] image_conversion_cpu_limit     = 60 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] image_conversion_disable       = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] image_upload_use_cinder_backend = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] image_upload_use_internal_tenant = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] image_volume_cache_enabled     = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] image_volume_cache_max_count   = 0 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] image_volume_cache_max_size_gb = 0 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] init_host_max_objects_retrieval = 0 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] instance_format                = [instance: %(uuid)s]  {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] iscsi_target_flags             =  {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] iscsi_write_cache              = on {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] iser_helper                    = tgtadm {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] iser_ip_address                = 192.168.122.131 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] iser_port                      = 3260 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] log_color                      = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] log_config_append              = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] log_dir                        = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] log_file                       = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] log_options                    = True {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] log_rotate_interval            = 1 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] log_rotate_interval_type       = days {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] log_rotation_type              = none {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack sudo[81371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack sudo[81371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] max_age                        = 0 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] max_logfile_count              = 30 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] max_logfile_size_mb            = 200 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] max_over_subscription_ratio    = 20.0 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] message_reap_interval          = 86400 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] message_ttl                    = 2592000 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] migration_create_volume_timeout_secs = 300 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] monkey_patch                   = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] monkey_patch_modules           = [] {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] my_ip                          = 192.168.122.131 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] no_snapshot_gb_quota           = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] num_iser_scan_tries            = 3 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] num_shell_tries                = 3 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] num_volume_device_scan_tries   = 3 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] nvmeof_conn_info_version       = 1 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] nvmet_ns_id                    = 10 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] nvmet_port_id                  = 1 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] osapi_max_limit                = 1000 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] osapi_volume_ext_list          = [] {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] osapi_volume_listen_port       = 8776 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] osapi_volume_use_ssl           = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] osapi_volume_workers           = 2 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] per_volume_size_limit          = -1 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] periodic_fuzzy_delay           = 60 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] periodic_interval              = 60 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] public_endpoint                = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] publish_errors                 = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] quota_backup_gigabytes         = 1000 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] quota_backups                  = 10 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] quota_gigabytes                = 1000 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] quota_groups                   = 10 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] quota_snapshots                = 10 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] quota_volumes                  = 10 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] rate_limit_burst               = 0 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] rate_limit_except_level        = CRITICAL {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] rate_limit_interval            = 0 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] reinit_driver_count            = 3 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] replication_device             = **** {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] report_discard_supported       = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81363]: INFO cinder.volume.manager [None req-5fd8aed7-ea94-4f4c-9416-3eb297b3b1a4 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] report_interval                = 120 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] reservation_clean_interval     = 86400 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] reservation_expire             = 86400 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] reserved_image_namespaces      = [] {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-5fd8aed7-ea94-4f4c-9416-3eb297b3b1a4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] reserved_percentage            = 0 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] rpc_response_timeout           = 120 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] run_external_periodic_tasks    = True {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] scst_target_driver             = iscsi {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] scst_target_iqn_name           = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] service_down_time              = 720 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] shell_completion               = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] snapshot_name_template         = snapshot-%s {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] snapshot_same_host             = True {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] split_loggers                  = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] state_path                     = /opt/stack/data/cinder {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] storage_availability_zone      = nova {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] storage_protocol               = iSCSI {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] syslog_log_facility            = LOG_USER {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] target_helper                  = lioadm {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] target_ip_address              = 192.168.122.131 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] target_port                    = 3260 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] target_protocol                = iscsi {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] target_secondary_ip_addresses  = [] {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] trace_flags                    = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] transport_url                  = **** {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] until_refresh                  = 0 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] use_chap_auth                  = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] use_default_quota_class        = True {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] use_journal                    = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] use_json                       = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] use_multipath_for_image_xfer   = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] use_stderr                     = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] use_syslog                     = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] verify_glance_signatures       = enabled {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] volume_api_class               = cinder.volume.api.API {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] volume_backend_name            = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] volume_clear                   = zero {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] volume_clear_ionice            = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] volume_clear_size              = 0 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] volume_copy_bps_limit          = 0 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] volume_dd_blocksize            = 1M {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] volume_name_template           = volume-%s {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] volume_service_inithost_offload = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] volume_usage_audit_period      = month {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] zoning_mode                    = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] oslo_concurrency.disable_process_locking = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-5fd8aed7-ea94-4f4c-9416-3eb297b3b1a4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.040s {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] keystone_authtoken.admin_password = **** {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] keystone_authtoken.admin_token = **** {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] keystone_authtoken.admin_user  = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] keystone_authtoken.auth_port   = 35357 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-5fd8aed7-ea94-4f4c-9416-3eb297b3b1a4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] keystone_authtoken.auth_protocol = https {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] keystone_authtoken.auth_section = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] keystone_authtoken.auth_type   = password {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] keystone_authtoken.auth_uri    = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] keystone_authtoken.auth_version = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] keystone_authtoken.cache       = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] keystone_authtoken.certfile    = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] keystone_authtoken.delay_auth_decision = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] keystone_authtoken.http_connect_timeout = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] keystone_authtoken.identity_uri = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] keystone_authtoken.include_service_catalog = True {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] keystone_authtoken.insecure    = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] keystone_authtoken.interface   = public {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] keystone_authtoken.keyfile     = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] keystone_authtoken.memcache_password =  {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] keystone_authtoken.memcache_username =  {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] keystone_authtoken.region_name = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] keystone_authtoken.service_token_roles_required = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] keystone_authtoken.service_type = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] keystone_authtoken.token_cache_time = 300 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.131/identity {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] cache.backend                  = dogpile.cache.null {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] cache.backend_argument         = **** {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] cache.backend_expiration_time  = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] cache.config_prefix            = cache.oslo {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] cache.debug_cache_backend      = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] cache.enable_retry_client      = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] cache.enable_socket_keepalive  = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] cache.enabled                  = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] cache.enforce_fips_mode        = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] cache.expiration_time          = 600 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] cache.hashclient_retry_attempts = 2 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] cache.memcache_dead_retry      = 300 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] cache.memcache_pool_maxsize    = 10 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] cache.memcache_sasl_enabled    = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] cache.password                 = **** {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] cache.proxies                  = [] {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] cache.redis_db                 = 0 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] cache.redis_sentinel_service_name = mymaster {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-5fd8aed7-ea94-4f4c-9416-3eb297b3b1a4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.042s {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] cache.redis_server             = localhost:6379 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] cache.retry_attempts           = 2 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] cache.retry_delay              = 0.0 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-5fd8aed7-ea94-4f4c-9416-3eb297b3b1a4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] cache.socket_keepalive_count   = 1 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] cache.socket_keepalive_idle    = 1 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] cache.socket_keepalive_interval = 1 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] cache.socket_timeout           = 1.0 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] cache.tls_allowed_ciphers      = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] cache.tls_cafile               = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] cache.tls_certfile             = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] cache.tls_enabled              = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] cache.tls_keyfile              = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] cache.username                 = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] database.asyncio_connection    = **** {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] database.asyncio_slave_connection = **** {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] database.backend               = sqlalchemy {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] database.connection            = **** {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] database.connection_debug      = 0 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] database.connection_parameters =  {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] database.connection_recycle_time = 3600 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] database.connection_trace      = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] database.db_inc_retry_interval = True {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] database.db_max_retries        = 20 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] database.db_max_retry_interval = 10 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] database.db_retry_interval     = 1 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] database.max_overflow          = 50 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] database.max_pool_size         = 5 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] database.max_retries           = 10 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] database.mysql_wsrep_sync_wait = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] database.pool_timeout          = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] database.retry_interval        = 10 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] database.slave_connection      = **** {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] database.sqlite_synchronous    = True {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] database.synchronous_reader    = True {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] database.use_db_reconnect      = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] profiler.connection_string     = messaging:// {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] profiler.enabled               = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] profiler.es_doc_type           = notification {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] profiler.es_scroll_size        = 10000 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] profiler.es_scroll_time        = 2m {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] profiler.filter_error_trace    = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-5fd8aed7-ea94-4f4c-9416-3eb297b3b1a4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] profiler.hmac_keys             = **** {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] profiler.sentinel_service_name = mymaster {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] profiler.socket_timeout        = 0.1 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] profiler.trace_requests        = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] profiler.trace_sqlalchemy      = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] profiler_jaeger.process_tags   = {} {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] profiler_jaeger.service_name_prefix = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] profiler_otlp.service_name_prefix = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-5fd8aed7-ea94-4f4c-9416-3eb297b3b1a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] oslo_policy.enforce_new_defaults = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: WARNING oslo_config.cfg [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] oslo_policy.enforce_scope      = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] oslo_policy.policy_default_rule = default {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] oslo_policy.policy_file        = policy.yaml {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] coordination.backend_url       = **** {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] privsep_osbrick.group          = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] privsep_osbrick.helper_command = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] privsep_osbrick.user           = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] cinder_sys_admin.group         = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] cinder_sys_admin.helper_command = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] cinder_sys_admin.user          = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] service_user.auth_section      = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] service_user.auth_type         = password {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] service_user.cafile            = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] service_user.certfile          = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] service_user.collect_timing    = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] service_user.insecure          = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] service_user.keyfile           = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] service_user.send_service_user_token = True {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] service_user.split_loggers     = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] service_user.timeout           = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] glance.auth_section            = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] glance.auth_type               = password {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] glance.certfile                = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] glance.collect_timing          = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] glance.insecure                = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] glance.keyfile                 = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] glance.region_name             = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] glance.split_loggers           = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack sudo[81371]: pam_unix(sudo:session): session closed for user root
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] glance.timeout                 = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] backend_defaults.backend_availability_zone = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] backend_defaults.chap_password = **** {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] backend_defaults.chap_username =  {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] backend_defaults.disk_geometry = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] backend_defaults.driver_client_cert = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] backend_defaults.driver_client_cert_key = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] backend_defaults.driver_data_namespace = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:03 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] backend_defaults.driver_use_ssl = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] backend_defaults.enable_unsupported_driver = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] backend_defaults.extra_capabilities = {} {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] backend_defaults.filter_function = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack sudo[81399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] backend_defaults.goodness_function = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack sudo[81399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] backend_defaults.iscsi_target_flags =  {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] backend_defaults.iscsi_write_cache = on {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] backend_defaults.iser_helper   = tgtadm {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] backend_defaults.iser_ip_address = 192.168.122.131 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] backend_defaults.iser_port     = 3260 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] backend_defaults.lvm_share_target = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] backend_defaults.lvm_type      = auto {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] backend_defaults.num_shell_tries = 3 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] backend_defaults.nvmet_port_id = 1 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] backend_defaults.replication_device = **** {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] backend_defaults.report_discard_supported = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] backend_defaults.reserved_percentage = 0 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] backend_defaults.scst_target_driver = iscsi {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] backend_defaults.scst_target_iqn_name = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] backend_defaults.storage_protocol = iSCSI {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] backend_defaults.target_helper = tgtadm {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] backend_defaults.target_ip_address = 192.168.122.131 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] backend_defaults.target_port   = 3260 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] backend_defaults.target_protocol = iscsi {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] backend_defaults.trace_flags   = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] backend_defaults.unique_fqdn_network = True {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] backend_defaults.use_chap_auth = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] backend_defaults.volume_backend_name = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] backend_defaults.volume_clear  = zero {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] backend_defaults.volume_clear_ionice = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] backend_defaults.volume_clear_size = 0 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] oslo_reports.file_event_handler = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] oslo_reports.log_dir           = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] lvmdriver-1.backend_availability_zone = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] lvmdriver-1.backend_host       = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] lvmdriver-1.chap_password      = **** {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] lvmdriver-1.chap_username      = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] lvmdriver-1.disk_geometry      = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] lvmdriver-1.driver_client_cert = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] lvmdriver-1.driver_data_namespace = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] lvmdriver-1.extra_capabilities = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] lvmdriver-1.filter_function    = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] lvmdriver-1.goodness_function  = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] lvmdriver-1.iser_helper        = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] lvmdriver-1.iser_ip_address    = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] lvmdriver-1.iser_port          = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] lvmdriver-1.iser_target_prefix = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] lvmdriver-1.lvm_share_target   = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] lvmdriver-1.lvm_type           = auto {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] lvmdriver-1.num_shell_tries    = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] lvmdriver-1.replication_device = **** {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] lvmdriver-1.report_discard_supported = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] lvmdriver-1.reserved_percentage = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] lvmdriver-1.scst_target_driver = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] lvmdriver-1.storage_protocol   = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] lvmdriver-1.target_helper      = lioadm {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] lvmdriver-1.target_ip_address  = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] lvmdriver-1.target_port        = 3260 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] lvmdriver-1.trace_flags        = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] lvmdriver-1.use_chap_auth      = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] lvmdriver-1.volume_clear       = zero {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] lvmdriver-1.volume_clear_size  = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] lvmdriver-1.volumes_dir        = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] oslo_messaging_rabbit.ssl      = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] oslo_messaging_notifications.driver = [] {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] oslo_messaging_notifications.retry = -1 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] oslo_messaging_notifications.transport_url = **** {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] key_manager.fixed_key          = **** {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] barbican.barbican_api_version  = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] barbican.barbican_endpoint     = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] barbican.barbican_endpoint_type = public {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] barbican.barbican_region_name  = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] barbican.cafile                = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] barbican.certfile              = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] barbican.collect_timing        = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] barbican.insecure              = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] barbican.keyfile               = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] barbican.number_of_retries     = 60 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] barbican.retry_delay           = 1 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] barbican.send_service_user_token = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] barbican.split_loggers         = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] barbican.timeout               = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] barbican.verify_ssl            = True {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] barbican.verify_ssl_path       = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] barbican_service_user.auth_section = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] barbican_service_user.auth_type = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] barbican_service_user.cafile   = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] barbican_service_user.certfile = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] barbican_service_user.collect_timing = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] barbican_service_user.insecure = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] barbican_service_user.keyfile  = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] barbican_service_user.split_loggers = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] barbican_service_user.timeout  = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] vault.approle_role_id          = **** {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] vault.approle_secret_id        = **** {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] vault.kv_mountpoint            = secret {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] vault.kv_path                  = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] vault.kv_version               = 2 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] vault.namespace                = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] vault.root_token_id            = **** {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] vault.ssl_ca_crt_file          = None {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] vault.timeout                  = 60.0 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] vault.use_ssl                  = False {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:42:04 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] ******************************************************************************** {{(pid=81199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}}
Jun 15 15:42:04 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-5fd8aed7-ea94-4f4c-9416-3eb297b3b1a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.738s {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:42:04 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-5fd8aed7-ea94-4f4c-9416-3eb297b3b1a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:42:04 devstack sudo[81399]: pam_unix(sudo:session): session closed for user root
Jun 15 15:42:04 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-5fd8aed7-ea94-4f4c-9416-3eb297b3b1a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.658s {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:42:04 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-5fd8aed7-ea94-4f4c-9416-3eb297b3b1a4 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 15 15:42:04 devstack cinder-volume[81363]: INFO cinder.brick.local_dev.lvm [None req-5fd8aed7-ea94-4f4c-9416-3eb297b3b1a4 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Jun 15 15:42:04 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-5fd8aed7-ea94-4f4c-9416-3eb297b3b1a4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:42:04 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-5fd8aed7-ea94-4f4c-9416-3eb297b3b1a4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:42:04 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-5fd8aed7-ea94-4f4c-9416-3eb297b3b1a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:42:04 devstack sudo[81656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 15 15:42:04 devstack sudo[81656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:42:05 devstack sudo[81656]: pam_unix(sudo:session): session closed for user root
Jun 15 15:42:05 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-5fd8aed7-ea94-4f4c-9416-3eb297b3b1a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.599s {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:42:05 devstack cinder-volume[81363]: DEBUG cinder.brick.local_dev.lvm [None req-5fd8aed7-ea94-4f4c-9416-3eb297b3b1a4 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=81363) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Jun 15 15:42:05 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-5fd8aed7-ea94-4f4c-9416-3eb297b3b1a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:42:05 devstack sudo[81852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 15 15:42:05 devstack sudo[81852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:42:06 devstack sudo[81852]: pam_unix(sudo:session): session closed for user root
Jun 15 15:42:06 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-5fd8aed7-ea94-4f4c-9416-3eb297b3b1a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.505s {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:42:06 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-5fd8aed7-ea94-4f4c-9416-3eb297b3b1a4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:42:06 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-5fd8aed7-ea94-4f4c-9416-3eb297b3b1a4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.041s {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:42:06 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-5fd8aed7-ea94-4f4c-9416-3eb297b3b1a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:42:06 devstack sudo[82112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 15 15:42:06 devstack sudo[82112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:42:07 devstack sudo[82112]: pam_unix(sudo:session): session closed for user root
Jun 15 15:42:07 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-5fd8aed7-ea94-4f4c-9416-3eb297b3b1a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.045s {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:42:07 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-5fd8aed7-ea94-4f4c-9416-3eb297b3b1a4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:42:07 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-5fd8aed7-ea94-4f4c-9416-3eb297b3b1a4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:42:07 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-5fd8aed7-ea94-4f4c-9416-3eb297b3b1a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:42:07 devstack sudo[82151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Jun 15 15:42:07 devstack sudo[82151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:42:08 devstack sudo[82151]: pam_unix(sudo:session): session closed for user root
Jun 15 15:42:08 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-5fd8aed7-ea94-4f4c-9416-3eb297b3b1a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.626s {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:42:08 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-5fd8aed7-ea94-4f4c-9416-3eb297b3b1a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:42:08 devstack sudo[82154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 15 15:42:08 devstack sudo[82154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:42:09 devstack sudo[82154]: pam_unix(sudo:session): session closed for user root
Jun 15 15:42:09 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-5fd8aed7-ea94-4f4c-9416-3eb297b3b1a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.632s {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:42:09 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-5fd8aed7-ea94-4f4c-9416-3eb297b3b1a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:42:09 devstack sudo[82159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 15 15:42:09 devstack sudo[82159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:42:09 devstack sudo[82159]: pam_unix(sudo:session): session closed for user root
Jun 15 15:42:09 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-5fd8aed7-ea94-4f4c-9416-3eb297b3b1a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.697s {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:42:09 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-5fd8aed7-ea94-4f4c-9416-3eb297b3b1a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:42:09 devstack sudo[82163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 15 15:42:09 devstack sudo[82163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:42:10 devstack sudo[82163]: pam_unix(sudo:session): session closed for user root
Jun 15 15:42:10 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-5fd8aed7-ea94-4f4c-9416-3eb297b3b1a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.872s {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:42:10 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-5fd8aed7-ea94-4f4c-9416-3eb297b3b1a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:42:10 devstack sudo[82171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 15 15:42:10 devstack sudo[82171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:42:11 devstack sudo[82171]: pam_unix(sudo:session): session closed for user root
Jun 15 15:42:11 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-5fd8aed7-ea94-4f4c-9416-3eb297b3b1a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.781s {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:42:11 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-5fd8aed7-ea94-4f4c-9416-3eb297b3b1a4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:42:11 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-5fd8aed7-ea94-4f4c-9416-3eb297b3b1a4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:42:11 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-5fd8aed7-ea94-4f4c-9416-3eb297b3b1a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:42:11 devstack sudo[82178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 15 15:42:11 devstack sudo[82178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:42:12 devstack sudo[82178]: pam_unix(sudo:session): session closed for user root
Jun 15 15:42:12 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-5fd8aed7-ea94-4f4c-9416-3eb297b3b1a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.786s {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:42:12 devstack cinder-volume[81363]: INFO cinder.volume.drivers.lvm [None req-5fd8aed7-ea94-4f4c-9416-3eb297b3b1a4 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Jun 15 15:42:12 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-5fd8aed7-ea94-4f4c-9416-3eb297b3b1a4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:42:12 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-5fd8aed7-ea94-4f4c-9416-3eb297b3b1a4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:42:12 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-5fd8aed7-ea94-4f4c-9416-3eb297b3b1a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:42:12 devstack sudo[82287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 15 15:42:12 devstack sudo[82287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:42:12 devstack sudo[82287]: pam_unix(sudo:session): session closed for user root
Jun 15 15:42:12 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-5fd8aed7-ea94-4f4c-9416-3eb297b3b1a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.650s {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:42:12 devstack cinder-volume[81363]: DEBUG cinder.volume.drivers.lvm [None req-5fd8aed7-ea94-4f4c-9416-3eb297b3b1a4 None None] Updating volume stats {{(pid=81363) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jun 15 15:42:12 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-5fd8aed7-ea94-4f4c-9416-3eb297b3b1a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:42:12 devstack sudo[82298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 15 15:42:13 devstack sudo[82298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:42:13 devstack cinder-volume[81199]: DEBUG dbcounter [-] [81199] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=81199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 15:42:13 devstack sudo[82298]: pam_unix(sudo:session): session closed for user root
Jun 15 15:42:13 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-5fd8aed7-ea94-4f4c-9416-3eb297b3b1a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.614s {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:42:13 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-5fd8aed7-ea94-4f4c-9416-3eb297b3b1a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:42:13 devstack sudo[82441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 15 15:42:13 devstack sudo[82441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:42:14 devstack sudo[82441]: pam_unix(sudo:session): session closed for user root
Jun 15 15:42:14 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-5fd8aed7-ea94-4f4c-9416-3eb297b3b1a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.634s {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:42:14 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-5fd8aed7-ea94-4f4c-9416-3eb297b3b1a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:42:14 devstack sudo[82447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 15 15:42:14 devstack sudo[82447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:42:14 devstack sudo[82447]: pam_unix(sudo:session): session closed for user root
Jun 15 15:42:14 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-5fd8aed7-ea94-4f4c-9416-3eb297b3b1a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.658s {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:42:14 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-5fd8aed7-ea94-4f4c-9416-3eb297b3b1a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:42:14 devstack sudo[82450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 15 15:42:14 devstack sudo[82450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:42:15 devstack sudo[82450]: pam_unix(sudo:session): session closed for user root
Jun 15 15:42:15 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-5fd8aed7-ea94-4f4c-9416-3eb297b3b1a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.579s {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:42:15 devstack cinder-volume[81363]: INFO cinder.volume.driver [None req-5fd8aed7-ea94-4f4c-9416-3eb297b3b1a4 None None] Driver hasn't implemented _init_vendor_properties()
Jun 15 15:42:15 devstack cinder-volume[81363]: DEBUG cinder.volume.driver [None req-5fd8aed7-ea94-4f4c-9416-3eb297b3b1a4 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81363) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jun 15 15:42:15 devstack cinder-volume[81363]: DEBUG oslo_db.sqlalchemy.engines [None req-5fd8aed7-ea94-4f4c-9416-3eb297b3b1a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81363) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 15 15:42:15 devstack cinder-volume[81363]: DEBUG dbcounter [-] [81363] Writer thread running {{(pid=81363) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jun 15 15:42:15 devstack cinder-volume[81363]: DEBUG cinder.db.sqlalchemy.api [None req-5fd8aed7-ea94-4f4c-9416-3eb297b3b1a4 None None] Building query based on filter {{(pid=81363) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3979}}
Jun 15 15:42:15 devstack cinder-volume[81363]: DEBUG cinder.image.image_utils [None req-5fd8aed7-ea94-4f4c-9416-3eb297b3b1a4 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=81363) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jun 15 15:42:15 devstack cinder-volume[81363]: INFO cinder.keymgr.migration [None req-79fe7380-5acc-4b9d-897f-32ea9a23b9d0 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jun 15 15:42:15 devstack cinder-volume[81363]: DEBUG cinder.volume.drivers.lvm [None req-5fd8aed7-ea94-4f4c-9416-3eb297b3b1a4 None None] Updating volume stats {{(pid=81363) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jun 15 15:42:15 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-5fd8aed7-ea94-4f4c-9416-3eb297b3b1a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:42:15 devstack sudo[82454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 15 15:42:15 devstack sudo[82454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:42:16 devstack sudo[82454]: pam_unix(sudo:session): session closed for user root
Jun 15 15:42:16 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-5fd8aed7-ea94-4f4c-9416-3eb297b3b1a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.628s {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:42:16 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-5fd8aed7-ea94-4f4c-9416-3eb297b3b1a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:42:16 devstack sudo[82457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 15 15:42:16 devstack sudo[82457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:42:16 devstack sudo[82457]: pam_unix(sudo:session): session closed for user root
Jun 15 15:42:16 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-5fd8aed7-ea94-4f4c-9416-3eb297b3b1a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.616s {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:42:16 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-5fd8aed7-ea94-4f4c-9416-3eb297b3b1a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:42:16 devstack sudo[82460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 15 15:42:16 devstack sudo[82460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:42:17 devstack sudo[82460]: pam_unix(sudo:session): session closed for user root
Jun 15 15:42:17 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-5fd8aed7-ea94-4f4c-9416-3eb297b3b1a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.618s {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:42:17 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-5fd8aed7-ea94-4f4c-9416-3eb297b3b1a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:42:17 devstack sudo[82467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 15 15:42:17 devstack sudo[82467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:42:18 devstack sudo[82467]: pam_unix(sudo:session): session closed for user root
Jun 15 15:42:18 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-5fd8aed7-ea94-4f4c-9416-3eb297b3b1a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.604s {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:42:18 devstack cinder-volume[81363]: DEBUG cinder.manager [None req-5fd8aed7-ea94-4f4c-9416-3eb297b3b1a4 None None] Notifying Schedulers of capabilities ... {{(pid=81363) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:42:18 devstack cinder-volume[81363]: INFO cinder.volume.manager [None req-5fd8aed7-ea94-4f4c-9416-3eb297b3b1a4 None None] Driver initialization completed successfully.
Jun 15 15:42:18 devstack cinder-volume[81363]: INFO cinder.manager [None req-5fd8aed7-ea94-4f4c-9416-3eb297b3b1a4 None None] Initiating service 2 cleanup
Jun 15 15:42:18 devstack cinder-volume[81363]: INFO cinder.manager [None req-5fd8aed7-ea94-4f4c-9416-3eb297b3b1a4 None None] Service 2 cleanup completed.
Jun 15 15:42:18 devstack cinder-volume[81363]: DEBUG cinder.service [None req-5fd8aed7-ea94-4f4c-9416-3eb297b3b1a4 None None] Creating RPC server for service cinder-volume {{(pid=81363) start /opt/stack/cinder/cinder/service.py:231}}
Jun 15 15:42:18 devstack cinder-volume[81363]: DEBUG cinder.service [None req-5fd8aed7-ea94-4f4c-9416-3eb297b3b1a4 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=81363) start /opt/stack/cinder/cinder/service.py:237}}
Jun 15 15:42:18 devstack cinder-volume[81363]: INFO cinder.volume.manager [None req-5fd8aed7-ea94-4f4c-9416-3eb297b3b1a4 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Jun 15 15:42:18 devstack cinder-volume[81363]: DEBUG cinder.volume.drivers.lvm [None req-5fd8aed7-ea94-4f4c-9416-3eb297b3b1a4 None None] Updating volume stats {{(pid=81363) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jun 15 15:42:18 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-5fd8aed7-ea94-4f4c-9416-3eb297b3b1a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:42:18 devstack sudo[82471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 15 15:42:18 devstack sudo[82471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:42:18 devstack sudo[82471]: pam_unix(sudo:session): session closed for user root
Jun 15 15:42:18 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-5fd8aed7-ea94-4f4c-9416-3eb297b3b1a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.631s {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:42:18 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-5fd8aed7-ea94-4f4c-9416-3eb297b3b1a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:42:18 devstack sudo[82475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 15 15:42:18 devstack sudo[82475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:42:19 devstack sudo[82475]: pam_unix(sudo:session): session closed for user root
Jun 15 15:42:19 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-5fd8aed7-ea94-4f4c-9416-3eb297b3b1a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.629s {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:42:19 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-5fd8aed7-ea94-4f4c-9416-3eb297b3b1a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:42:19 devstack sudo[82478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 15 15:42:19 devstack sudo[82478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:42:20 devstack sudo[82478]: pam_unix(sudo:session): session closed for user root
Jun 15 15:42:20 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-5fd8aed7-ea94-4f4c-9416-3eb297b3b1a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.600s {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:42:20 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-5fd8aed7-ea94-4f4c-9416-3eb297b3b1a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:42:20 devstack sudo[82557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 15 15:42:20 devstack sudo[82557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:42:20 devstack sudo[82557]: pam_unix(sudo:session): session closed for user root
Jun 15 15:42:20 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-5fd8aed7-ea94-4f4c-9416-3eb297b3b1a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.592s {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:42:20 devstack cinder-volume[81363]: INFO cinder.volume.manager [None req-5fd8aed7-ea94-4f4c-9416-3eb297b3b1a4 None None] Driver post RPC initialization completed successfully.
Jun 15 15:42:30 devstack cinder-volume[81363]: DEBUG dbcounter [-] [81363] Writing DB stats cinder:SELECT=13,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=81363) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 15:42:30 devstack cinder-volume[81363]: DEBUG dbcounter [-] [81363] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=81363) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 15:43:13 devstack cinder-volume[81363]: DEBUG oslo_service.periodic_task [None req-33b04335-e362-4010-9849-e516b5215214 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81363) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 15:43:13 devstack cinder-volume[81363]: DEBUG cinder.volume.drivers.lvm [None req-33b04335-e362-4010-9849-e516b5215214 None None] Updating volume stats {{(pid=81363) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jun 15 15:43:13 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-33b04335-e362-4010-9849-e516b5215214 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:43:13 devstack sudo[84446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 15 15:43:13 devstack sudo[84446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:43:14 devstack sudo[84446]: pam_unix(sudo:session): session closed for user root
Jun 15 15:43:14 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-33b04335-e362-4010-9849-e516b5215214 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.582s {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:43:14 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-33b04335-e362-4010-9849-e516b5215214 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:43:14 devstack sudo[84452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 15 15:43:14 devstack sudo[84452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:43:14 devstack sudo[84452]: pam_unix(sudo:session): session closed for user root
Jun 15 15:43:14 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-33b04335-e362-4010-9849-e516b5215214 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.580s {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:43:14 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-33b04335-e362-4010-9849-e516b5215214 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:43:14 devstack sudo[84458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 15 15:43:14 devstack sudo[84458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:43:15 devstack sudo[84458]: pam_unix(sudo:session): session closed for user root
Jun 15 15:43:15 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-33b04335-e362-4010-9849-e516b5215214 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.573s {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:43:15 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-33b04335-e362-4010-9849-e516b5215214 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:43:15 devstack sudo[84461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 15 15:43:15 devstack sudo[84461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:43:15 devstack sudo[84461]: pam_unix(sudo:session): session closed for user root
Jun 15 15:43:15 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-33b04335-e362-4010-9849-e516b5215214 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.568s {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:43:15 devstack cinder-volume[81363]: DEBUG cinder.manager [None req-33b04335-e362-4010-9849-e516b5215214 None None] Notifying Schedulers of capabilities ... {{(pid=81363) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:43:16 devstack cinder-volume[81363]: DEBUG oslo_service.periodic_task [None req-33b04335-e362-4010-9849-e516b5215214 None None] Running periodic task VolumeManager._thread_info {{(pid=81363) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 15:43:16 devstack cinder-volume[81363]: DEBUG cinder.volume.manager [None req-33b04335-e362-4010-9849-e516b5215214 None None] thread count: 6 {{(pid=81363) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 15 15:43:16 devstack cinder-volume[81363]: DEBUG cinder.volume.manager [None req-33b04335-e362-4010-9849-e516b5215214 None None] thread info: [<_MainThread(MainThread, started 125777947627648)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125777837368128)>, <Thread(Thread-3 (stat_writer), started daemon 125777837939200)>, <Thread(Rabbit-heartbeat, started daemon 125777836536512)>, <Thread(Thread-5 (_runner), started daemon 125777840770560)>, <Thread(Thread-7 (_runner), started daemon 125777836739712)>] {{(pid=81363) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 15 15:44:13 devstack cinder-volume[81363]: DEBUG oslo_service.periodic_task [None req-33b04335-e362-4010-9849-e516b5215214 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81363) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 15:44:13 devstack cinder-volume[81363]: DEBUG cinder.volume.drivers.lvm [None req-33b04335-e362-4010-9849-e516b5215214 None None] Updating volume stats {{(pid=81363) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jun 15 15:44:13 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-33b04335-e362-4010-9849-e516b5215214 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:44:13 devstack sudo[87564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 15 15:44:13 devstack sudo[87564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:44:14 devstack sudo[87564]: pam_unix(sudo:session): session closed for user root
Jun 15 15:44:14 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-33b04335-e362-4010-9849-e516b5215214 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.594s {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:44:14 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-33b04335-e362-4010-9849-e516b5215214 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:44:14 devstack sudo[87583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 15 15:44:14 devstack sudo[87583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:44:14 devstack sudo[87583]: pam_unix(sudo:session): session closed for user root
Jun 15 15:44:14 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-33b04335-e362-4010-9849-e516b5215214 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.568s {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:44:14 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-33b04335-e362-4010-9849-e516b5215214 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:44:14 devstack sudo[87586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 15 15:44:14 devstack sudo[87586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:44:15 devstack sudo[87586]: pam_unix(sudo:session): session closed for user root
Jun 15 15:44:15 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-33b04335-e362-4010-9849-e516b5215214 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.603s {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:44:15 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-33b04335-e362-4010-9849-e516b5215214 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:44:15 devstack sudo[87589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 15 15:44:15 devstack sudo[87589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:44:16 devstack sudo[87589]: pam_unix(sudo:session): session closed for user root
Jun 15 15:44:16 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-33b04335-e362-4010-9849-e516b5215214 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.569s {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:44:16 devstack cinder-volume[81363]: DEBUG cinder.manager [None req-33b04335-e362-4010-9849-e516b5215214 None None] Notifying Schedulers of capabilities ... {{(pid=81363) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:44:16 devstack cinder-volume[81363]: DEBUG oslo_service.periodic_task [None req-33b04335-e362-4010-9849-e516b5215214 None None] Running periodic task VolumeManager._thread_info {{(pid=81363) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 15:44:16 devstack cinder-volume[81363]: DEBUG cinder.volume.manager [None req-33b04335-e362-4010-9849-e516b5215214 None None] thread count: 6 {{(pid=81363) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 15 15:44:16 devstack cinder-volume[81363]: DEBUG cinder.volume.manager [None req-33b04335-e362-4010-9849-e516b5215214 None None] thread info: [<_MainThread(MainThread, started 125777947627648)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125777837368128)>, <Thread(Thread-3 (stat_writer), started daemon 125777837939200)>, <Thread(Rabbit-heartbeat, started daemon 125777836536512)>, <Thread(Thread-5 (_runner), started daemon 125777840770560)>, <Thread(Thread-7 (_runner), started daemon 125777836739712)>] {{(pid=81363) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 15 15:44:30 devstack cinder-volume[81363]: DEBUG dbcounter [-] [81363] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=81363) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 15:45:13 devstack cinder-volume[81363]: DEBUG oslo_service.periodic_task [None req-33b04335-e362-4010-9849-e516b5215214 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81363) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 15:45:13 devstack cinder-volume[81363]: DEBUG cinder.volume.drivers.lvm [None req-33b04335-e362-4010-9849-e516b5215214 None None] Updating volume stats {{(pid=81363) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jun 15 15:45:13 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-33b04335-e362-4010-9849-e516b5215214 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:45:13 devstack sudo[89315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 15 15:45:13 devstack sudo[89315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:45:14 devstack sudo[89315]: pam_unix(sudo:session): session closed for user root
Jun 15 15:45:14 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-33b04335-e362-4010-9849-e516b5215214 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.594s {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:45:14 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-33b04335-e362-4010-9849-e516b5215214 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:45:14 devstack sudo[89338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 15 15:45:14 devstack sudo[89338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:45:14 devstack sudo[89338]: pam_unix(sudo:session): session closed for user root
Jun 15 15:45:14 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-33b04335-e362-4010-9849-e516b5215214 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.585s {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:45:14 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-33b04335-e362-4010-9849-e516b5215214 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:45:14 devstack sudo[89358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 15 15:45:14 devstack sudo[89358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:45:15 devstack sudo[89358]: pam_unix(sudo:session): session closed for user root
Jun 15 15:45:15 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-33b04335-e362-4010-9849-e516b5215214 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.592s {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:45:15 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-33b04335-e362-4010-9849-e516b5215214 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:45:15 devstack sudo[89377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 15 15:45:15 devstack sudo[89377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:45:16 devstack sudo[89377]: pam_unix(sudo:session): session closed for user root
Jun 15 15:45:16 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-33b04335-e362-4010-9849-e516b5215214 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.633s {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:45:16 devstack cinder-volume[81363]: DEBUG cinder.manager [None req-33b04335-e362-4010-9849-e516b5215214 None None] Notifying Schedulers of capabilities ... {{(pid=81363) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:46:13 devstack cinder-volume[81363]: DEBUG oslo_service.periodic_task [None req-33b04335-e362-4010-9849-e516b5215214 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81363) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 15:46:13 devstack cinder-volume[81363]: DEBUG cinder.volume.drivers.lvm [None req-33b04335-e362-4010-9849-e516b5215214 None None] Updating volume stats {{(pid=81363) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jun 15 15:46:13 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-33b04335-e362-4010-9849-e516b5215214 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:46:13 devstack sudo[90507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 15 15:46:13 devstack sudo[90507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:46:14 devstack sudo[90507]: pam_unix(sudo:session): session closed for user root
Jun 15 15:46:14 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-33b04335-e362-4010-9849-e516b5215214 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.606s {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:46:14 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-33b04335-e362-4010-9849-e516b5215214 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:46:14 devstack sudo[90521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 15 15:46:14 devstack sudo[90521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:46:14 devstack sudo[90521]: pam_unix(sudo:session): session closed for user root
Jun 15 15:46:14 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-33b04335-e362-4010-9849-e516b5215214 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.588s {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:46:14 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-33b04335-e362-4010-9849-e516b5215214 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:46:14 devstack sudo[90547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 15 15:46:14 devstack sudo[90547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:46:15 devstack sudo[90547]: pam_unix(sudo:session): session closed for user root
Jun 15 15:46:15 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-33b04335-e362-4010-9849-e516b5215214 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.563s {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:46:15 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-33b04335-e362-4010-9849-e516b5215214 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:46:15 devstack sudo[90553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 15 15:46:15 devstack sudo[90553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:46:15 devstack sudo[90553]: pam_unix(sudo:session): session closed for user root
Jun 15 15:46:15 devstack cinder-volume[81363]: DEBUG oslo_concurrency.processutils [None req-33b04335-e362-4010-9849-e516b5215214 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.552s {{(pid=81363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:46:15 devstack cinder-volume[81363]: DEBUG cinder.manager [None req-33b04335-e362-4010-9849-e516b5215214 None None] Notifying Schedulers of capabilities ... {{(pid=81363) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:46:15 devstack cinder-volume[81363]: DEBUG oslo_service.periodic_task [None req-33b04335-e362-4010-9849-e516b5215214 None None] Running periodic task VolumeManager._thread_info {{(pid=81363) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 15:46:15 devstack cinder-volume[81363]: DEBUG cinder.volume.manager [None req-33b04335-e362-4010-9849-e516b5215214 None None] thread count: 6 {{(pid=81363) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 15 15:46:15 devstack cinder-volume[81363]: DEBUG cinder.volume.manager [None req-33b04335-e362-4010-9849-e516b5215214 None None] thread info: [<_MainThread(MainThread, started 125777947627648)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125777837368128)>, <Thread(Thread-3 (stat_writer), started daemon 125777837939200)>, <Thread(Rabbit-heartbeat, started daemon 125777836536512)>, <Thread(Thread-5 (_runner), started daemon 125777840770560)>, <Thread(Thread-7 (_runner), started daemon 125777836739712)>] {{(pid=81363) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 15 15:46:30 devstack cinder-volume[81363]: DEBUG dbcounter [-] [81363] Writing DB stats cinder:SELECT=1 {{(pid=81363) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 15:46:30 devstack cinder-volume[81363]: DEBUG dbcounter [-] [81363] Writing DB stats cinder:UPDATE=1 {{(pid=81363) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 15:46:33 devstack cinder-volume[81199]: INFO oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] Caught SIGTERM, stopping children
Jun 15 15:46:33 devstack cinder-volume[81199]: DEBUG oslo_concurrency.lockutils [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] Acquiring lock "singleton_lock" {{(pid=81199) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
Jun 15 15:46:33 devstack cinder-volume[81199]: DEBUG oslo_concurrency.lockutils [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] Acquired lock "singleton_lock" {{(pid=81199) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
Jun 15 15:46:33 devstack cinder-volume[81199]: DEBUG oslo_concurrency.lockutils [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] Releasing lock "singleton_lock" {{(pid=81199) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
Jun 15 15:46:33 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] Stop services. {{(pid=81199) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Jun 15 15:46:33 devstack cinder-volume[81199]: DEBUG oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] Killing children. {{(pid=81199) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Jun 15 15:46:33 devstack cinder-volume[81199]: INFO oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] Waiting on 1 children to exit
Jun 15 15:46:38 devstack cinder-volume[81363]: DEBUG oslo_concurrency.lockutils [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] Acquiring lock "singleton_lock" {{(pid=81363) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
Jun 15 15:46:38 devstack cinder-volume[81363]: DEBUG oslo_concurrency.lockutils [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] Acquired lock "singleton_lock" {{(pid=81363) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
Jun 15 15:46:38 devstack cinder-volume[81363]: DEBUG oslo_concurrency.lockutils [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] Releasing lock "singleton_lock" {{(pid=81363) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
Jun 15 15:46:38 devstack cinder-volume[81363]: WARNING amqp [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jun 15 15:46:38 devstack cinder-volume[81363]: WARNING amqp [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jun 15 15:46:38 devstack cinder-volume[81199]: INFO oslo_service.backend._eventlet.service [None req-de75a8f5-3284-40dc-b978-a95dee256cc2 None None] Child 81363 exited with status 0
Jun 15 15:46:40 devstack cinder-volume[91095]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=91095) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
Jun 15 15:46:40 devstack cinder-volume[91095]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=91095) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
Jun 15 15:46:40 devstack cinder-volume[91095]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=91095) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
Jun 15 15:46:41 devstack cinder-volume[91095]: INFO dbcounter [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] Registered counter for database cinder
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_db.sqlalchemy.engines [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91095) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG dbcounter [-] [91095] Writer thread running {{(pid=91095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jun 15 15:46:41 devstack cinder-volume[91095]: INFO cinder.rpc [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jun 15 15:46:41 devstack cinder-volume[91095]: INFO cinder.rpc [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_db.sqlalchemy.engines [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91095) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 15 15:46:41 devstack cinder-volume[91095]: INFO cinder.volume.manager [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] Determined volume DB was empty at startup.
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG cinder.volume.manager [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=91095) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jun 15 15:46:41 devstack cinder-volume[91095]: INFO cinder.volume.manager [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] Service not found for updating active_backend_id, assuming default for driver init.
Jun 15 15:46:41 devstack cinder-volume[91095]: WARNING stevedore.named [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jun 15 15:46:41 devstack cinder-volume[91095]: WARNING castellan.key_manager [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jun 15 15:46:41 devstack cinder-volume[91095]: WARNING cinder.keymgr.conf_key_mgr [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jun 15 15:46:41 devstack cinder-volume[91095]: INFO cinder.volume.manager [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_db.sqlalchemy.engines [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91095) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 15 15:46:41 devstack cinder-volume[91095]: INFO oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] Starting 1 workers
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] Started child 91306 {{(pid=91095) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] Full set of CONF: {{(pid=91095) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] ******************************************************************************** {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] Configuration options gathered from: {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] ================================================================================ {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] allow_availability_zone_fallback = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] allow_compression_on_image_upload = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] allowed_direct_url_schemes     = [] {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91306]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] api_rate_limit                 = True {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] auth_strategy                  = keystone {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] backend_availability_zone      = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] backend_host                   = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] backend_name                   = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] backend_stats_polling_interval = 60 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] backup_api_class               = cinder.backup.api.API {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] backup_name_template           = backup-%s {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] backup_use_same_host           = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] backup_use_temp_snapshot       = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] chap_password                  = **** {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] chap_username                  =  {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] cinder_internal_tenant_project_id = b3e869f071ed46cebff83ab881255643 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] cinder_internal_tenant_user_id = ef7d0f0b44dc4298b6f9b3f49fc5698d {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] cluster                        = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] compression_format             = gzip {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] compute_api_class              = cinder.compute.nova.API {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] config_dir                     = [] {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] config_source                  = [] {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] control_exchange               = openstack {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] debug                          = True {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] default_availability_zone      = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] default_group_type             = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] default_volume_type            = QuobyteHD {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] disk_geometry                  = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] driver_client_cert             = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] driver_client_cert_key         = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] driver_data_namespace          = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] driver_ssl_cert_path           = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] driver_ssl_cert_verify         = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] driver_use_ssl                 = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] enable_new_services            = True {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] enable_unsupported_driver      = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] enabled_backends               = ['QuobyteHD'] {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] enforce_multipath_for_image_xfer = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] filter_function                = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] glance_api_insecure            = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] glance_api_servers             = ['http://192.168.122.131/image'] {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] glance_api_ssl_compression     = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] glance_ca_certificates_file    = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] glance_catalog_info            = image:glance:publicURL {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] glance_certfile                = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] glance_keyfile                 = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] glance_num_retries             = 3 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] glance_request_timeout         = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] goodness_function              = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] graceful_shutdown_timeout      = 5 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] group_api_class                = cinder.group.api.API {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] host                           = devstack {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] image_compress_on_upload       = True {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] image_conversion_address_space_limit = 1 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] image_conversion_cpu_limit     = 60 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] image_conversion_disable       = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] image_upload_use_cinder_backend = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] image_upload_use_internal_tenant = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] image_volume_cache_enabled     = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] image_volume_cache_max_count   = 0 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] image_volume_cache_max_size_gb = 0 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] init_host_max_objects_retrieval = 0 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] instance_format                = [instance: %(uuid)s]  {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] iscsi_target_flags             =  {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] iscsi_write_cache              = on {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] iser_helper                    = tgtadm {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] iser_ip_address                = 192.168.122.131 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] iser_port                      = 3260 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] log_color                      = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] log_config_append              = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] log_dir                        = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] log_file                       = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] log_options                    = True {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] log_rotate_interval            = 1 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] log_rotate_interval_type       = days {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] log_rotation_type              = none {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91306]: INFO cinder.volume.manager [None req-7b821619-065d-4cb8-a896-fa2b5306a0bd None None] Starting volume driver QuobyteDriver (1.1.14)
Jun 15 15:46:41 devstack cinder-volume[91306]: DEBUG cinder.volume.drivers.remotefs [None req-7b821619-065d-4cb8-a896-fa2b5306a0bd None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=91306) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] max_age                        = 0 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] max_logfile_count              = 30 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] max_logfile_size_mb            = 200 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] max_over_subscription_ratio    = 20.0 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] message_reap_interval          = 86400 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] message_ttl                    = 2592000 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] migration_create_volume_timeout_secs = 300 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] monkey_patch                   = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] monkey_patch_modules           = [] {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] my_ip                          = 192.168.122.131 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] no_snapshot_gb_quota           = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] num_iser_scan_tries            = 3 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] num_shell_tries                = 3 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] num_volume_device_scan_tries   = 3 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] nvmeof_conn_info_version       = 1 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] nvmet_ns_id                    = 10 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] nvmet_port_id                  = 1 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] osapi_max_limit                = 1000 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] osapi_volume_ext_list          = [] {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] osapi_volume_listen_port       = 8776 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] osapi_volume_use_ssl           = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] osapi_volume_workers           = 2 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] per_volume_size_limit          = -1 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] periodic_fuzzy_delay           = 60 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] periodic_interval              = 60 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] public_endpoint                = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] publish_errors                 = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] quota_backup_gigabytes         = 1000 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] quota_backups                  = 10 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] quota_gigabytes                = 1000 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] quota_groups                   = 10 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] quota_snapshots                = 10 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] quota_volumes                  = 10 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] rate_limit_burst               = 0 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] rate_limit_except_level        = CRITICAL {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] rate_limit_interval            = 0 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] reinit_driver_count            = 3 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] replication_device             = **** {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] report_discard_supported       = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] report_interval                = 120 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] reservation_clean_interval     = 86400 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] reservation_expire             = 86400 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] reserved_image_namespaces      = [] {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] reserved_percentage            = 0 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] rpc_response_timeout           = 120 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] run_external_periodic_tasks    = True {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] scst_target_driver             = iscsi {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] scst_target_iqn_name           = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] service_down_time              = 720 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] shell_completion               = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] snapshot_name_template         = snapshot-%s {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] split_loggers                  = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] state_path                     = /opt/stack/data/cinder {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] storage_availability_zone      = nova {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] storage_protocol               = iSCSI {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] syslog_log_facility            = LOG_USER {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] target_helper                  = lioadm {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] target_ip_address              = 192.168.122.131 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] target_port                    = 3260 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] target_protocol                = iscsi {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] target_secondary_ip_addresses  = [] {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] trace_flags                    = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] transport_url                  = **** {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] until_refresh                  = 0 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] use_chap_auth                  = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] use_default_quota_class        = True {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] use_journal                    = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] use_json                       = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] use_multipath_for_image_xfer   = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] use_stderr                     = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] use_syslog                     = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] verify_glance_signatures       = enabled {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] volume_api_class               = cinder.volume.api.API {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] volume_backend_name            = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] volume_clear                   = zero {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] volume_clear_ionice            = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] volume_clear_size              = 0 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] volume_copy_bps_limit          = 0 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] volume_dd_blocksize            = 1M {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] volume_name_template           = volume-%s {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] volume_service_inithost_offload = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] volume_usage_audit_period      = month {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] zoning_mode                    = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] oslo_concurrency.disable_process_locking = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] keystone_authtoken.admin_password = **** {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] keystone_authtoken.admin_token = **** {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] keystone_authtoken.admin_user  = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] keystone_authtoken.auth_port   = 35357 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] keystone_authtoken.auth_protocol = https {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] keystone_authtoken.auth_section = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] keystone_authtoken.auth_type   = password {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] keystone_authtoken.auth_uri    = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] keystone_authtoken.auth_version = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] keystone_authtoken.cache       = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] keystone_authtoken.certfile    = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] keystone_authtoken.delay_auth_decision = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] keystone_authtoken.http_connect_timeout = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] keystone_authtoken.identity_uri = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] keystone_authtoken.include_service_catalog = True {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] keystone_authtoken.insecure    = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] keystone_authtoken.interface   = public {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] keystone_authtoken.keyfile     = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] keystone_authtoken.memcache_password =  {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91306]: DEBUG cinder.volume.drivers.quobyte [None req-7b821619-065d-4cb8-a896-fa2b5306a0bd None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=91306) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Jun 15 15:46:41 devstack cinder-volume[91306]: WARNING cinder.volume.drivers.quobyte [None req-7b821619-065d-4cb8-a896-fa2b5306a0bd None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Jun 15 15:46:41 devstack cinder-volume[91306]: WARNING cinder.volume.drivers.quobyte [None req-7b821619-065d-4cb8-a896-fa2b5306a0bd None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91306]: DEBUG oslo_concurrency.processutils [None req-7b821619-065d-4cb8-a896-fa2b5306a0bd None None] Running cmd (subprocess): mount.quobyte {{(pid=91306) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] keystone_authtoken.memcache_username =  {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] keystone_authtoken.region_name = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] keystone_authtoken.service_token_roles_required = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] keystone_authtoken.service_type = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] keystone_authtoken.token_cache_time = 300 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.131/identity {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] cache.backend                  = dogpile.cache.null {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] cache.backend_argument         = **** {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] cache.backend_expiration_time  = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] cache.config_prefix            = cache.oslo {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] cache.debug_cache_backend      = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] cache.enable_retry_client      = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] cache.enable_socket_keepalive  = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] cache.enabled                  = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] cache.enforce_fips_mode        = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] cache.expiration_time          = 600 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] cache.hashclient_retry_attempts = 2 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] cache.memcache_dead_retry      = 300 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] cache.memcache_pool_maxsize    = 10 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] cache.memcache_sasl_enabled    = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] cache.password                 = **** {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] cache.proxies                  = [] {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] cache.redis_db                 = 0 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] cache.redis_sentinel_service_name = mymaster {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] cache.redis_server             = localhost:6379 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] cache.retry_attempts           = 2 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] cache.retry_delay              = 0.0 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] cache.socket_keepalive_count   = 1 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] cache.socket_keepalive_idle    = 1 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] cache.socket_keepalive_interval = 1 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] cache.socket_timeout           = 1.0 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] cache.tls_allowed_ciphers      = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] cache.tls_cafile               = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] cache.tls_certfile             = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] cache.tls_enabled              = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] cache.tls_keyfile              = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] cache.username                 = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] database.asyncio_connection    = **** {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] database.asyncio_slave_connection = **** {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] database.backend               = sqlalchemy {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] database.connection            = **** {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] database.connection_debug      = 0 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] database.connection_parameters =  {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] database.connection_recycle_time = 3600 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] database.connection_trace      = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] database.db_inc_retry_interval = True {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] database.db_max_retries        = 20 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] database.db_max_retry_interval = 10 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] database.db_retry_interval     = 1 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] database.max_overflow          = 50 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] database.max_pool_size         = 5 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] database.max_retries           = 10 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] database.mysql_wsrep_sync_wait = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] database.pool_timeout          = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] database.retry_interval        = 10 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] database.slave_connection      = **** {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] database.sqlite_synchronous    = True {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] database.synchronous_reader    = True {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] database.use_db_reconnect      = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] profiler.connection_string     = messaging:// {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] profiler.enabled               = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] profiler.es_doc_type           = notification {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] profiler.es_scroll_size        = 10000 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] profiler.es_scroll_time        = 2m {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] profiler.filter_error_trace    = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] profiler.hmac_keys             = **** {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] profiler.sentinel_service_name = mymaster {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] profiler.socket_timeout        = 0.1 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] profiler.trace_requests        = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] profiler.trace_sqlalchemy      = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] profiler_jaeger.process_tags   = {} {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] profiler_jaeger.service_name_prefix = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] profiler_otlp.service_name_prefix = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] oslo_policy.enforce_new_defaults = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: WARNING oslo_config.cfg [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] oslo_policy.enforce_scope      = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] oslo_policy.policy_default_rule = default {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] oslo_policy.policy_file        = policy.yaml {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] coordination.backend_url       = **** {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] privsep_osbrick.group          = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] privsep_osbrick.helper_command = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] privsep_osbrick.user           = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] cinder_sys_admin.group         = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] cinder_sys_admin.helper_command = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] cinder_sys_admin.user          = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] service_user.auth_section      = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] service_user.auth_type         = password {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] service_user.cafile            = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] service_user.certfile          = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] service_user.collect_timing    = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] service_user.insecure          = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] service_user.keyfile           = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] service_user.send_service_user_token = True {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] service_user.split_loggers     = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] service_user.timeout           = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] glance.auth_section            = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] glance.auth_type               = password {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] glance.certfile                = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] glance.collect_timing          = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] glance.insecure                = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] glance.keyfile                 = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] glance.region_name             = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] glance.split_loggers           = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] glance.timeout                 = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] backend_defaults.backend_availability_zone = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] backend_defaults.chap_password = **** {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] backend_defaults.chap_username =  {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] backend_defaults.disk_geometry = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] backend_defaults.driver_client_cert = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] backend_defaults.driver_client_cert_key = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] backend_defaults.driver_data_namespace = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] backend_defaults.driver_use_ssl = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] backend_defaults.enable_unsupported_driver = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] backend_defaults.extra_capabilities = {} {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] backend_defaults.filter_function = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] backend_defaults.goodness_function = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] backend_defaults.iscsi_target_flags =  {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] backend_defaults.iscsi_write_cache = on {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] backend_defaults.iser_helper   = tgtadm {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] backend_defaults.iser_ip_address = 192.168.122.131 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] backend_defaults.iser_port     = 3260 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] backend_defaults.nas_host      =  {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] backend_defaults.nas_login     = admin {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] backend_defaults.nas_mount_options = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] backend_defaults.nas_password  = **** {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] backend_defaults.nas_private_key =  {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] backend_defaults.nas_share_path =  {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] backend_defaults.num_shell_tries = 3 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] backend_defaults.nvmet_port_id = 1 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] backend_defaults.quobyte_client_cfg = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] backend_defaults.quobyte_volume_url = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] backend_defaults.replication_device = **** {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] backend_defaults.report_discard_supported = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] backend_defaults.reserved_percentage = 0 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] backend_defaults.scst_target_driver = iscsi {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] backend_defaults.scst_target_iqn_name = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] backend_defaults.storage_protocol = iSCSI {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] backend_defaults.target_helper = tgtadm {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] backend_defaults.target_ip_address = 192.168.122.131 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] backend_defaults.target_port   = 3260 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] backend_defaults.target_protocol = iscsi {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] backend_defaults.trace_flags   = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] backend_defaults.unique_fqdn_network = True {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:41 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] backend_defaults.use_chap_auth = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] backend_defaults.volume_backend_name = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] backend_defaults.volume_clear  = zero {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] backend_defaults.volume_clear_ionice = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] backend_defaults.volume_clear_size = 0 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] oslo_reports.file_event_handler = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] oslo_reports.log_dir           = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] QuobyteHD.backend_availability_zone = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] QuobyteHD.backend_host         = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack quobyte-client[91312]: Reading configuration file: /etc/quobyte/client.cfg
Jun 15 15:46:42 devstack quobyte-client[91312]: Invalid parameters found, error: missing mount point.
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] QuobyteHD.chap_password        = **** {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] QuobyteHD.chap_username        = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] QuobyteHD.chiscsi_conf         = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] QuobyteHD.disk_geometry        = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] QuobyteHD.driver_client_cert   = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] QuobyteHD.driver_client_cert_key = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] QuobyteHD.driver_data_namespace = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack quobyte-client[91312]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] QuobyteHD.driver_use_ssl       = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack quobyte-client[91312]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] QuobyteHD.extra_capabilities   = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] QuobyteHD.filter_function      = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] QuobyteHD.goodness_function    = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] QuobyteHD.iser_helper          = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] QuobyteHD.iser_ip_address      = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] QuobyteHD.iser_port            = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] QuobyteHD.iser_target_prefix   = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] QuobyteHD.nas_host             = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] QuobyteHD.nas_login            = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] QuobyteHD.nas_mount_options    = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] QuobyteHD.nas_password         = **** {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] QuobyteHD.nas_private_key      = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] QuobyteHD.nas_share_path       = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] QuobyteHD.nas_ssh_port         = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91306]: DEBUG oslo_concurrency.processutils [None req-7b821619-065d-4cb8-a896-fa2b5306a0bd None None] CMD "mount.quobyte" returned: 1 in 0.140s {{(pid=91306) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:46:42 devstack cinder-volume[91306]: DEBUG oslo_concurrency.lockutils [None req-7b821619-065d-4cb8-a896-fa2b5306a0bd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91306) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:46:42 devstack cinder-volume[91306]: DEBUG oslo_concurrency.lockutils [None req-7b821619-065d-4cb8-a896-fa2b5306a0bd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91306) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:46:42 devstack cinder-volume[91306]: DEBUG cinder.volume.drivers.quobyte [None req-7b821619-065d-4cb8-a896-fa2b5306a0bd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91306) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] QuobyteHD.num_shell_tries      = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] QuobyteHD.nvmet_port_id        = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91306]: INFO cinder.volume.drivers.quobyte [None req-7b821619-065d-4cb8-a896-fa2b5306a0bd None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc ...
Jun 15 15:46:42 devstack cinder-volume[91306]: DEBUG oslo_concurrency.processutils [None req-7b821619-065d-4cb8-a896-fa2b5306a0bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 -c /etc/quobyte/client-cinder.cfg {{(pid=91306) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] QuobyteHD.replication_device   = **** {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] QuobyteHD.report_discard_supported = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] QuobyteHD.reserved_percentage  = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] QuobyteHD.scst_target_driver   = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] QuobyteHD.storage_protocol     = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] QuobyteHD.target_helper        = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] QuobyteHD.target_ip_address    = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] QuobyteHD.target_port          = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] QuobyteHD.target_prefix        = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] QuobyteHD.target_protocol      = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] QuobyteHD.trace_flags          = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] QuobyteHD.use_chap_auth        = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] QuobyteHD.volume_clear         = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] QuobyteHD.volume_clear_size    = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] QuobyteHD.volumes_dir          = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack sudo[91313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 -c /etc/quobyte/client-cinder.cfg
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] oslo_messaging_rabbit.ssl      = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack sudo[91313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] oslo_messaging_notifications.driver = [] {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] oslo_messaging_notifications.retry = -1 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] oslo_messaging_notifications.transport_url = **** {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] key_manager.fixed_key          = **** {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] barbican.barbican_api_version  = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] barbican.barbican_endpoint     = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] barbican.barbican_endpoint_type = public {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] barbican.barbican_region_name  = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] barbican.cafile                = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] barbican.certfile              = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] barbican.collect_timing        = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] barbican.insecure              = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] barbican.keyfile               = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] barbican.number_of_retries     = 60 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] barbican.retry_delay           = 1 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] barbican.send_service_user_token = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] barbican.split_loggers         = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] barbican.timeout               = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] barbican.verify_ssl            = True {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] barbican.verify_ssl_path       = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] barbican_service_user.auth_section = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] barbican_service_user.auth_type = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] barbican_service_user.cafile   = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] barbican_service_user.certfile = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] barbican_service_user.collect_timing = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] barbican_service_user.insecure = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] barbican_service_user.keyfile  = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] barbican_service_user.split_loggers = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] barbican_service_user.timeout  = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] vault.approle_role_id          = **** {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] vault.approle_secret_id        = **** {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] vault.kv_mountpoint            = secret {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] vault.kv_path                  = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] vault.kv_version               = 2 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] vault.namespace                = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] vault.root_token_id            = **** {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] vault.ssl_ca_crt_file          = None {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] vault.timeout                  = 60.0 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] vault.use_ssl                  = False {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:42 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] ******************************************************************************** {{(pid=91095) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}}
Jun 15 15:46:42 devstack sudo[91313]: pam_unix(sudo:session): session closed for user root
Jun 15 15:46:42 devstack cinder-volume[91306]: DEBUG oslo_concurrency.processutils [None req-7b821619-065d-4cb8-a896-fa2b5306a0bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.806s {{(pid=91306) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:46:42 devstack cinder-volume[91306]: INFO cinder.volume.drivers.quobyte [None req-7b821619-065d-4cb8-a896-fa2b5306a0bd None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc succeeded
Jun 15 15:46:42 devstack cinder-volume[91306]: DEBUG cinder.volume.drivers.quobyte [None req-7b821619-065d-4cb8-a896-fa2b5306a0bd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91306) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:46:42 devstack cinder-volume[91306]: DEBUG oslo_concurrency.lockutils [None req-7b821619-065d-4cb8-a896-fa2b5306a0bd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.820s {{(pid=91306) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:46:42 devstack cinder-volume[91306]: DEBUG oslo_concurrency.processutils [None req-7b821619-065d-4cb8-a896-fa2b5306a0bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91306) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:46:42 devstack sudo[91386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:46:42 devstack sudo[91386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:46:43 devstack sudo[91386]: pam_unix(sudo:session): session closed for user root
Jun 15 15:46:43 devstack cinder-volume[91306]: DEBUG oslo_concurrency.processutils [None req-7b821619-065d-4cb8-a896-fa2b5306a0bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.589s {{(pid=91306) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:46:43 devstack cinder-volume[91306]: INFO cinder.volume.driver [None req-7b821619-065d-4cb8-a896-fa2b5306a0bd None None] Driver hasn't implemented _init_vendor_properties()
Jun 15 15:46:43 devstack cinder-volume[91306]: DEBUG cinder.volume.driver [None req-7b821619-065d-4cb8-a896-fa2b5306a0bd None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7578392028809, 'free_capacity_gb': 1775.7578392028809, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=91306) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jun 15 15:46:43 devstack cinder-volume[91306]: DEBUG oslo_db.sqlalchemy.engines [None req-7b821619-065d-4cb8-a896-fa2b5306a0bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91306) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 15 15:46:43 devstack cinder-volume[91306]: DEBUG dbcounter [-] [91306] Writer thread running {{(pid=91306) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jun 15 15:46:43 devstack cinder-volume[91306]: DEBUG cinder.db.sqlalchemy.api [None req-7b821619-065d-4cb8-a896-fa2b5306a0bd None None] Building query based on filter {{(pid=91306) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3979}}
Jun 15 15:46:43 devstack cinder-volume[91306]: DEBUG cinder.image.image_utils [None req-7b821619-065d-4cb8-a896-fa2b5306a0bd None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=91306) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jun 15 15:46:43 devstack cinder-volume[91306]: INFO cinder.keymgr.migration [None req-555839b6-fcad-4df4-a528-9419c0cf4b0f None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jun 15 15:46:43 devstack cinder-volume[91306]: DEBUG oslo_concurrency.lockutils [None req-7b821619-065d-4cb8-a896-fa2b5306a0bd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91306) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:46:43 devstack cinder-volume[91306]: DEBUG oslo_concurrency.lockutils [None req-7b821619-065d-4cb8-a896-fa2b5306a0bd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91306) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:46:43 devstack cinder-volume[91306]: DEBUG cinder.volume.drivers.quobyte [None req-7b821619-065d-4cb8-a896-fa2b5306a0bd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91306) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:46:43 devstack cinder-volume[91306]: DEBUG cinder.volume.drivers.quobyte [None req-7b821619-065d-4cb8-a896-fa2b5306a0bd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91306) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:46:43 devstack cinder-volume[91306]: DEBUG oslo_concurrency.lockutils [None req-7b821619-065d-4cb8-a896-fa2b5306a0bd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91306) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:46:43 devstack cinder-volume[91306]: DEBUG oslo_concurrency.processutils [None req-7b821619-065d-4cb8-a896-fa2b5306a0bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91306) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:46:43 devstack sudo[91389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:46:43 devstack sudo[91389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:46:44 devstack sudo[91389]: pam_unix(sudo:session): session closed for user root
Jun 15 15:46:44 devstack cinder-volume[91306]: DEBUG oslo_concurrency.processutils [None req-7b821619-065d-4cb8-a896-fa2b5306a0bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.605s {{(pid=91306) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:46:44 devstack cinder-volume[91306]: DEBUG cinder.manager [None req-7b821619-065d-4cb8-a896-fa2b5306a0bd None None] Notifying Schedulers of capabilities ... {{(pid=91306) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:46:44 devstack cinder-volume[91306]: INFO cinder.volume.manager [None req-7b821619-065d-4cb8-a896-fa2b5306a0bd None None] Driver initialization completed successfully.
Jun 15 15:46:44 devstack cinder-volume[91306]: INFO cinder.manager [None req-7b821619-065d-4cb8-a896-fa2b5306a0bd None None] Initiating service 3 cleanup
Jun 15 15:46:44 devstack cinder-volume[91306]: INFO cinder.manager [None req-7b821619-065d-4cb8-a896-fa2b5306a0bd None None] Service 3 cleanup completed.
Jun 15 15:46:44 devstack cinder-volume[91306]: DEBUG cinder.service [None req-7b821619-065d-4cb8-a896-fa2b5306a0bd None None] Creating RPC server for service cinder-volume {{(pid=91306) start /opt/stack/cinder/cinder/service.py:231}}
Jun 15 15:46:44 devstack cinder-volume[91306]: DEBUG cinder.service [None req-7b821619-065d-4cb8-a896-fa2b5306a0bd None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=91306) start /opt/stack/cinder/cinder/service.py:237}}
Jun 15 15:46:44 devstack cinder-volume[91306]: INFO cinder.volume.manager [None req-7b821619-065d-4cb8-a896-fa2b5306a0bd None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Jun 15 15:46:44 devstack cinder-volume[91306]: DEBUG oslo_concurrency.lockutils [None req-7b821619-065d-4cb8-a896-fa2b5306a0bd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91306) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:46:44 devstack cinder-volume[91306]: DEBUG oslo_concurrency.lockutils [None req-7b821619-065d-4cb8-a896-fa2b5306a0bd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91306) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:46:44 devstack cinder-volume[91306]: DEBUG cinder.volume.drivers.quobyte [None req-7b821619-065d-4cb8-a896-fa2b5306a0bd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91306) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:46:44 devstack cinder-volume[91306]: DEBUG cinder.volume.drivers.quobyte [None req-7b821619-065d-4cb8-a896-fa2b5306a0bd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91306) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:46:44 devstack cinder-volume[91306]: DEBUG oslo_concurrency.lockutils [None req-7b821619-065d-4cb8-a896-fa2b5306a0bd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91306) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:46:44 devstack cinder-volume[91306]: DEBUG oslo_concurrency.processutils [None req-7b821619-065d-4cb8-a896-fa2b5306a0bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91306) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:46:44 devstack sudo[91396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:46:44 devstack sudo[91396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:46:44 devstack sudo[91396]: pam_unix(sudo:session): session closed for user root
Jun 15 15:46:44 devstack cinder-volume[91306]: DEBUG oslo_concurrency.processutils [None req-7b821619-065d-4cb8-a896-fa2b5306a0bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.629s {{(pid=91306) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:46:44 devstack cinder-volume[91306]: INFO cinder.volume.manager [None req-7b821619-065d-4cb8-a896-fa2b5306a0bd None None] Driver post RPC initialization completed successfully.
Jun 15 15:46:48 devstack cinder-volume[91306]: DEBUG oslo_concurrency.lockutils [None req-96dc0e93-c6ee-402c-836d-5b745c5bd5ab None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91306) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:46:48 devstack cinder-volume[91306]: DEBUG oslo_concurrency.lockutils [None req-96dc0e93-c6ee-402c-836d-5b745c5bd5ab None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91306) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:46:48 devstack cinder-volume[91306]: DEBUG cinder.volume.drivers.quobyte [None req-96dc0e93-c6ee-402c-836d-5b745c5bd5ab None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91306) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:46:48 devstack cinder-volume[91306]: DEBUG cinder.volume.drivers.quobyte [None req-96dc0e93-c6ee-402c-836d-5b745c5bd5ab None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91306) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:46:48 devstack cinder-volume[91306]: DEBUG oslo_concurrency.lockutils [None req-96dc0e93-c6ee-402c-836d-5b745c5bd5ab None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91306) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:46:48 devstack cinder-volume[91306]: DEBUG oslo_concurrency.processutils [None req-96dc0e93-c6ee-402c-836d-5b745c5bd5ab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91306) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:46:48 devstack sudo[91521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:46:48 devstack sudo[91521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:46:49 devstack sudo[91521]: pam_unix(sudo:session): session closed for user root
Jun 15 15:46:49 devstack cinder-volume[91306]: DEBUG oslo_concurrency.processutils [None req-96dc0e93-c6ee-402c-836d-5b745c5bd5ab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.583s {{(pid=91306) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:46:49 devstack cinder-volume[91306]: DEBUG cinder.manager [None req-96dc0e93-c6ee-402c-836d-5b745c5bd5ab None None] Notifying Schedulers of capabilities ... {{(pid=91306) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:46:49 devstack cinder-volume[91095]: INFO oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] Caught SIGTERM, stopping children
Jun 15 15:46:49 devstack cinder-volume[91095]: DEBUG oslo_concurrency.lockutils [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] Acquiring lock "singleton_lock" {{(pid=91095) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
Jun 15 15:46:49 devstack cinder-volume[91095]: DEBUG oslo_concurrency.lockutils [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] Acquired lock "singleton_lock" {{(pid=91095) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
Jun 15 15:46:49 devstack cinder-volume[91095]: DEBUG oslo_concurrency.lockutils [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] Releasing lock "singleton_lock" {{(pid=91095) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
Jun 15 15:46:49 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] Stop services. {{(pid=91095) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Jun 15 15:46:49 devstack cinder-volume[91095]: DEBUG oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] Killing children. {{(pid=91095) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Jun 15 15:46:49 devstack cinder-volume[91095]: INFO oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] Waiting on 1 children to exit
Jun 15 15:46:52 devstack cinder-volume[91306]: DEBUG oslo_concurrency.lockutils [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] Acquiring lock "singleton_lock" {{(pid=91306) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
Jun 15 15:46:52 devstack cinder-volume[91306]: DEBUG oslo_concurrency.lockutils [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] Acquired lock "singleton_lock" {{(pid=91306) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
Jun 15 15:46:52 devstack cinder-volume[91306]: DEBUG oslo_concurrency.lockutils [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] Releasing lock "singleton_lock" {{(pid=91306) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
Jun 15 15:46:52 devstack cinder-volume[91306]: WARNING amqp [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jun 15 15:46:52 devstack cinder-volume[91306]: WARNING amqp [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jun 15 15:46:52 devstack cinder-volume[91095]: INFO oslo_service.backend._eventlet.service [None req-58308353-e841-4e97-8d50-9eb0b5248771 None None] Child 91306 exited with status 0
Jun 15 15:46:55 devstack cinder-volume[91592]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=91592) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
Jun 15 15:46:55 devstack cinder-volume[91592]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=91592) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
Jun 15 15:46:55 devstack cinder-volume[91592]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=91592) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
Jun 15 15:46:56 devstack cinder-volume[91592]: INFO dbcounter [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] Registered counter for database cinder
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_db.sqlalchemy.engines [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91592) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG dbcounter [-] [91592] Writer thread running {{(pid=91592) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jun 15 15:46:56 devstack cinder-volume[91592]: INFO cinder.rpc [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jun 15 15:46:56 devstack cinder-volume[91592]: INFO cinder.rpc [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_db.sqlalchemy.engines [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91592) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 15 15:46:56 devstack cinder-volume[91592]: INFO cinder.volume.manager [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] Determined volume DB was empty at startup.
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG cinder.volume.manager [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=91592) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jun 15 15:46:56 devstack cinder-volume[91592]: WARNING stevedore.named [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jun 15 15:46:56 devstack cinder-volume[91592]: WARNING castellan.key_manager [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jun 15 15:46:56 devstack cinder-volume[91592]: WARNING cinder.keymgr.conf_key_mgr [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jun 15 15:46:56 devstack cinder-volume[91592]: INFO cinder.volume.manager [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_db.sqlalchemy.engines [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91592) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 15 15:46:56 devstack cinder-volume[91592]: INFO oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] Starting 1 workers
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] Started child 91863 {{(pid=91592) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] Full set of CONF: {{(pid=91592) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] ******************************************************************************** {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] Configuration options gathered from: {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] ================================================================================ {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] allow_availability_zone_fallback = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] allow_compression_on_image_upload = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] allowed_direct_url_schemes     = [] {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] api_rate_limit                 = True {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] auth_strategy                  = keystone {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] backend_availability_zone      = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] backend_host                   = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] backend_name                   = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] backend_stats_polling_interval = 60 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] backup_api_class               = cinder.backup.api.API {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] backup_name_template           = backup-%s {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] backup_use_same_host           = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] backup_use_temp_snapshot       = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] chap_password                  = **** {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91863]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] chap_username                  =  {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] cinder_internal_tenant_project_id = b3e869f071ed46cebff83ab881255643 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] cinder_internal_tenant_user_id = ef7d0f0b44dc4298b6f9b3f49fc5698d {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] cluster                        = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] compression_format             = gzip {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] compute_api_class              = cinder.compute.nova.API {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] config_dir                     = [] {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] config_source                  = [] {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] control_exchange               = openstack {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] debug                          = True {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] default_availability_zone      = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] default_group_type             = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] default_volume_type            = QuobyteHD {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] disk_geometry                  = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] driver_client_cert             = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] driver_client_cert_key         = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] driver_data_namespace          = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] driver_ssl_cert_path           = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] driver_ssl_cert_verify         = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] driver_use_ssl                 = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] enable_new_services            = True {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] enable_unsupported_driver      = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] enabled_backends               = ['QuobyteHD'] {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] enforce_multipath_for_image_xfer = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] filter_function                = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] glance_api_insecure            = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] glance_api_servers             = ['http://192.168.122.131/image'] {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] glance_api_ssl_compression     = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] glance_ca_certificates_file    = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] glance_catalog_info            = image:glance:publicURL {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] glance_certfile                = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] glance_keyfile                 = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] glance_num_retries             = 3 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] glance_request_timeout         = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] goodness_function              = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] graceful_shutdown_timeout      = 5 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] group_api_class                = cinder.group.api.API {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] host                           = devstack {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] image_compress_on_upload       = True {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] image_conversion_address_space_limit = 1 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] image_conversion_cpu_limit     = 60 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] image_conversion_disable       = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] image_upload_use_cinder_backend = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] image_upload_use_internal_tenant = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] image_volume_cache_enabled     = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] image_volume_cache_max_count   = 0 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] image_volume_cache_max_size_gb = 0 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] init_host_max_objects_retrieval = 0 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] instance_format                = [instance: %(uuid)s]  {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] iscsi_target_flags             =  {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] iscsi_write_cache              = on {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] iser_helper                    = tgtadm {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] iser_ip_address                = 192.168.122.131 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] iser_port                      = 3260 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] log_color                      = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] log_config_append              = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] log_dir                        = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] log_file                       = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] log_options                    = True {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] log_rotate_interval            = 1 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] log_rotate_interval_type       = days {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] log_rotation_type              = none {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] max_age                        = 0 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] max_logfile_count              = 30 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] max_logfile_size_mb            = 200 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] max_over_subscription_ratio    = 20.0 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] message_reap_interval          = 86400 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] message_ttl                    = 2592000 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] migration_create_volume_timeout_secs = 300 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] monkey_patch                   = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] monkey_patch_modules           = [] {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] my_ip                          = 192.168.122.131 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] no_snapshot_gb_quota           = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] num_iser_scan_tries            = 3 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] num_shell_tries                = 3 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] num_volume_device_scan_tries   = 3 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] nvmeof_conn_info_version       = 1 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] nvmet_ns_id                    = 10 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] nvmet_port_id                  = 1 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] osapi_max_limit                = 1000 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] osapi_volume_ext_list          = [] {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] osapi_volume_listen_port       = 8776 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] osapi_volume_use_ssl           = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] osapi_volume_workers           = 2 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] per_volume_size_limit          = -1 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] periodic_fuzzy_delay           = 60 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] periodic_interval              = 60 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] public_endpoint                = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] publish_errors                 = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] quota_backup_gigabytes         = 1000 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] quota_backups                  = 10 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] quota_gigabytes                = 1000 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] quota_groups                   = 10 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] quota_snapshots                = 10 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] quota_volumes                  = 10 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] rate_limit_burst               = 0 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] rate_limit_except_level        = CRITICAL {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] rate_limit_interval            = 0 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] reinit_driver_count            = 3 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] replication_device             = **** {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] report_discard_supported       = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] report_interval                = 120 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] reservation_clean_interval     = 86400 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] reservation_expire             = 86400 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] reserved_image_namespaces      = [] {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] reserved_percentage            = 0 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] rpc_response_timeout           = 120 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] run_external_periodic_tasks    = True {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-3a4b87e4-59c8-49eb-86d1-ee52e5d6ecb7 None None] Starting volume driver QuobyteDriver (1.1.14)
Jun 15 15:46:56 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-3a4b87e4-59c8-49eb-86d1-ee52e5d6ecb7 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=91863) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] scst_target_driver             = iscsi {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] scst_target_iqn_name           = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] service_down_time              = 720 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] shell_completion               = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] snapshot_name_template         = snapshot-%s {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] split_loggers                  = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] state_path                     = /opt/stack/data/cinder {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] storage_availability_zone      = nova {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] storage_protocol               = iSCSI {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] syslog_log_facility            = LOG_USER {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] target_helper                  = lioadm {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] target_ip_address              = 192.168.122.131 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] target_port                    = 3260 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] target_protocol                = iscsi {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] target_secondary_ip_addresses  = [] {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] trace_flags                    = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:56 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] transport_url                  = **** {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] until_refresh                  = 0 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] use_chap_auth                  = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] use_default_quota_class        = True {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] use_journal                    = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] use_json                       = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] use_multipath_for_image_xfer   = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] use_stderr                     = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] use_syslog                     = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] verify_glance_signatures       = enabled {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] volume_api_class               = cinder.volume.api.API {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] volume_backend_name            = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] volume_clear                   = zero {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] volume_clear_ionice            = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] volume_clear_size              = 0 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] volume_copy_bps_limit          = 0 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] volume_dd_blocksize            = 1M {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] volume_name_template           = volume-%s {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] volume_service_inithost_offload = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] volume_usage_audit_period      = month {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] zoning_mode                    = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] oslo_concurrency.disable_process_locking = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] keystone_authtoken.admin_password = **** {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] keystone_authtoken.admin_token = **** {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] keystone_authtoken.admin_user  = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] keystone_authtoken.auth_port   = 35357 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] keystone_authtoken.auth_protocol = https {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] keystone_authtoken.auth_section = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] keystone_authtoken.auth_type   = password {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] keystone_authtoken.auth_uri    = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] keystone_authtoken.auth_version = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] keystone_authtoken.cache       = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] keystone_authtoken.certfile    = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] keystone_authtoken.delay_auth_decision = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] keystone_authtoken.http_connect_timeout = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] keystone_authtoken.identity_uri = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] keystone_authtoken.include_service_catalog = True {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] keystone_authtoken.insecure    = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] keystone_authtoken.interface   = public {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] keystone_authtoken.keyfile     = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] keystone_authtoken.memcache_password =  {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] keystone_authtoken.memcache_username =  {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] keystone_authtoken.region_name = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] keystone_authtoken.service_token_roles_required = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] keystone_authtoken.service_type = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] keystone_authtoken.token_cache_time = 300 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.131/identity {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] cache.backend                  = dogpile.cache.null {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] cache.backend_argument         = **** {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] cache.backend_expiration_time  = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] cache.config_prefix            = cache.oslo {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] cache.debug_cache_backend      = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] cache.enable_retry_client      = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] cache.enable_socket_keepalive  = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] cache.enabled                  = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] cache.enforce_fips_mode        = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] cache.expiration_time          = 600 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] cache.hashclient_retry_attempts = 2 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] cache.memcache_dead_retry      = 300 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] cache.memcache_pool_maxsize    = 10 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] cache.memcache_sasl_enabled    = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] cache.password                 = **** {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] cache.proxies                  = [] {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] cache.redis_db                 = 0 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] cache.redis_sentinel_service_name = mymaster {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] cache.redis_server             = localhost:6379 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] cache.retry_attempts           = 2 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] cache.retry_delay              = 0.0 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] cache.socket_keepalive_count   = 1 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] cache.socket_keepalive_idle    = 1 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] cache.socket_keepalive_interval = 1 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] cache.socket_timeout           = 1.0 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] cache.tls_allowed_ciphers      = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-3a4b87e4-59c8-49eb-86d1-ee52e5d6ecb7 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=91863) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Jun 15 15:46:57 devstack cinder-volume[91863]: WARNING cinder.volume.drivers.quobyte [None req-3a4b87e4-59c8-49eb-86d1-ee52e5d6ecb7 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Jun 15 15:46:57 devstack cinder-volume[91863]: WARNING cinder.volume.drivers.quobyte [None req-3a4b87e4-59c8-49eb-86d1-ee52e5d6ecb7 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] cache.tls_cafile               = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] cache.tls_certfile             = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] cache.tls_enabled              = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3a4b87e4-59c8-49eb-86d1-ee52e5d6ecb7 None None] Running cmd (subprocess): mount.quobyte {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] cache.tls_keyfile              = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] cache.username                 = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] database.asyncio_connection    = **** {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] database.asyncio_slave_connection = **** {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] database.backend               = sqlalchemy {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] database.connection            = **** {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] database.connection_debug      = 0 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] database.connection_parameters =  {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] database.connection_recycle_time = 3600 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] database.connection_trace      = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] database.db_inc_retry_interval = True {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] database.db_max_retries        = 20 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] database.db_max_retry_interval = 10 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] database.db_retry_interval     = 1 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] database.max_overflow          = 50 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] database.max_pool_size         = 5 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] database.max_retries           = 10 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] database.mysql_wsrep_sync_wait = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] database.pool_timeout          = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] database.retry_interval        = 10 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] database.slave_connection      = **** {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] database.sqlite_synchronous    = True {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] database.synchronous_reader    = True {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] database.use_db_reconnect      = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] profiler.connection_string     = messaging:// {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] profiler.enabled               = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] profiler.es_doc_type           = notification {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] profiler.es_scroll_size        = 10000 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] profiler.es_scroll_time        = 2m {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] profiler.filter_error_trace    = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] profiler.hmac_keys             = **** {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] profiler.sentinel_service_name = mymaster {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] profiler.socket_timeout        = 0.1 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] profiler.trace_requests        = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] profiler.trace_sqlalchemy      = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] profiler_jaeger.process_tags   = {} {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] profiler_jaeger.service_name_prefix = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] profiler_otlp.service_name_prefix = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] oslo_policy.enforce_new_defaults = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: WARNING oslo_config.cfg [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] oslo_policy.enforce_scope      = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] oslo_policy.policy_default_rule = default {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] oslo_policy.policy_file        = policy.yaml {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] coordination.backend_url       = **** {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] privsep_osbrick.group          = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] privsep_osbrick.helper_command = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] privsep_osbrick.user           = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] cinder_sys_admin.group         = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] cinder_sys_admin.helper_command = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] cinder_sys_admin.user          = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] service_user.auth_section      = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] service_user.auth_type         = password {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] service_user.cafile            = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] service_user.certfile          = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] service_user.collect_timing    = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] service_user.insecure          = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] service_user.keyfile           = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] service_user.send_service_user_token = True {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] service_user.split_loggers     = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] service_user.timeout           = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] glance.auth_section            = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] glance.auth_type               = password {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] glance.certfile                = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] glance.collect_timing          = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] glance.insecure                = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] glance.keyfile                 = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] glance.region_name             = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] glance.split_loggers           = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] glance.timeout                 = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] backend_defaults.backend_availability_zone = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] backend_defaults.chap_password = **** {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] backend_defaults.chap_username =  {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] backend_defaults.disk_geometry = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] backend_defaults.driver_client_cert = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] backend_defaults.driver_client_cert_key = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] backend_defaults.driver_data_namespace = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] backend_defaults.driver_use_ssl = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] backend_defaults.enable_unsupported_driver = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] backend_defaults.extra_capabilities = {} {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] backend_defaults.filter_function = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] backend_defaults.goodness_function = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] backend_defaults.iscsi_target_flags =  {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] backend_defaults.iscsi_write_cache = on {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] backend_defaults.iser_helper   = tgtadm {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] backend_defaults.iser_ip_address = 192.168.122.131 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] backend_defaults.iser_port     = 3260 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] backend_defaults.nas_host      =  {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] backend_defaults.nas_login     = admin {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] backend_defaults.nas_mount_options = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] backend_defaults.nas_password  = **** {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] backend_defaults.nas_private_key =  {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] backend_defaults.nas_share_path =  {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] backend_defaults.num_shell_tries = 3 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] backend_defaults.nvmet_port_id = 1 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] backend_defaults.quobyte_client_cfg = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] backend_defaults.quobyte_volume_url = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] backend_defaults.replication_device = **** {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] backend_defaults.report_discard_supported = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] backend_defaults.reserved_percentage = 0 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] backend_defaults.scst_target_driver = iscsi {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] backend_defaults.scst_target_iqn_name = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] backend_defaults.storage_protocol = iSCSI {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] backend_defaults.target_helper = tgtadm {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] backend_defaults.target_ip_address = 192.168.122.131 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] backend_defaults.target_port   = 3260 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] backend_defaults.target_protocol = iscsi {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] backend_defaults.trace_flags   = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] backend_defaults.unique_fqdn_network = True {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] backend_defaults.use_chap_auth = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] backend_defaults.volume_backend_name = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] backend_defaults.volume_clear  = zero {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] backend_defaults.volume_clear_ionice = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] backend_defaults.volume_clear_size = 0 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] oslo_reports.file_event_handler = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] oslo_reports.log_dir           = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] QuobyteHD.backend_availability_zone = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] QuobyteHD.backend_host         = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] QuobyteHD.chap_password        = **** {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] QuobyteHD.chap_username        = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] QuobyteHD.chiscsi_conf         = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack quobyte-client[91869]: Reading configuration file: /etc/quobyte/client.cfg
Jun 15 15:46:57 devstack quobyte-client[91869]: Invalid parameters found, error: missing mount point.
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] QuobyteHD.disk_geometry        = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] QuobyteHD.driver_client_cert   = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] QuobyteHD.driver_client_cert_key = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] QuobyteHD.driver_data_namespace = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] QuobyteHD.driver_use_ssl       = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack quobyte-client[91869]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack quobyte-client[91869]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Jun 15 15:46:57 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3a4b87e4-59c8-49eb-86d1-ee52e5d6ecb7 None None] CMD "mount.quobyte" returned: 1 in 0.070s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] QuobyteHD.extra_capabilities   = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] QuobyteHD.filter_function      = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-3a4b87e4-59c8-49eb-86d1-ee52e5d6ecb7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] QuobyteHD.goodness_function    = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-3a4b87e4-59c8-49eb-86d1-ee52e5d6ecb7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-3a4b87e4-59c8-49eb-86d1-ee52e5d6ecb7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] QuobyteHD.iser_helper          = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] QuobyteHD.iser_ip_address      = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] QuobyteHD.iser_port            = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] QuobyteHD.iser_target_prefix   = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] QuobyteHD.nas_host             = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] QuobyteHD.nas_login            = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] QuobyteHD.nas_mount_options    = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] QuobyteHD.nas_password         = **** {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] QuobyteHD.nas_private_key      = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] QuobyteHD.nas_share_path       = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] QuobyteHD.nas_ssh_port         = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] QuobyteHD.num_shell_tries      = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-3a4b87e4-59c8-49eb-86d1-ee52e5d6ecb7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-3a4b87e4-59c8-49eb-86d1-ee52e5d6ecb7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] QuobyteHD.nvmet_port_id        = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3a4b87e4-59c8-49eb-86d1-ee52e5d6ecb7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] QuobyteHD.replication_device   = **** {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] QuobyteHD.report_discard_supported = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] QuobyteHD.reserved_percentage  = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] QuobyteHD.scst_target_driver   = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] QuobyteHD.storage_protocol     = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] QuobyteHD.target_helper        = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] QuobyteHD.target_ip_address    = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] QuobyteHD.target_port          = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] QuobyteHD.target_prefix        = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] QuobyteHD.target_protocol      = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] QuobyteHD.trace_flags          = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] QuobyteHD.use_chap_auth        = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] QuobyteHD.volume_clear         = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] QuobyteHD.volume_clear_size    = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] QuobyteHD.volumes_dir          = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack sudo[91870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:46:57 devstack sudo[91870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] oslo_messaging_rabbit.ssl      = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] oslo_messaging_notifications.driver = [] {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] oslo_messaging_notifications.retry = -1 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] oslo_messaging_notifications.transport_url = **** {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] key_manager.fixed_key          = **** {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] barbican.barbican_api_version  = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] barbican.barbican_endpoint     = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] barbican.barbican_endpoint_type = public {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] barbican.barbican_region_name  = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] barbican.cafile                = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] barbican.certfile              = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] barbican.collect_timing        = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] barbican.insecure              = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] barbican.keyfile               = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] barbican.number_of_retries     = 60 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] barbican.retry_delay           = 1 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] barbican.send_service_user_token = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] barbican.split_loggers         = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] barbican.timeout               = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] barbican.verify_ssl            = True {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] barbican.verify_ssl_path       = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] barbican_service_user.auth_section = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] barbican_service_user.auth_type = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] barbican_service_user.cafile   = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] barbican_service_user.certfile = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] barbican_service_user.collect_timing = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] barbican_service_user.insecure = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] barbican_service_user.keyfile  = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] barbican_service_user.split_loggers = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] barbican_service_user.timeout  = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] vault.approle_role_id          = **** {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] vault.approle_secret_id        = **** {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] vault.kv_mountpoint            = secret {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] vault.kv_path                  = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] vault.kv_version               = 2 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] vault.namespace                = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] vault.root_token_id            = **** {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] vault.ssl_ca_crt_file          = None {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] vault.timeout                  = 60.0 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] vault.use_ssl                  = False {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Jun 15 15:46:57 devstack cinder-volume[91592]: DEBUG oslo_service.backend._eventlet.service [None req-e31927d2-75b5-4d63-8b81-63f562ac1091 None None] ******************************************************************************** {{(pid=91592) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}}
Jun 15 15:46:57 devstack sudo[91870]: pam_unix(sudo:session): session closed for user root
Jun 15 15:46:57 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3a4b87e4-59c8-49eb-86d1-ee52e5d6ecb7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.598s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:46:57 devstack cinder-volume[91863]: INFO cinder.volume.driver [None req-3a4b87e4-59c8-49eb-86d1-ee52e5d6ecb7 None None] Driver hasn't implemented _init_vendor_properties()
Jun 15 15:46:57 devstack cinder-volume[91863]: DEBUG cinder.volume.driver [None req-3a4b87e4-59c8-49eb-86d1-ee52e5d6ecb7 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7578392028809, 'free_capacity_gb': 1775.7578392028809, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=91863) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jun 15 15:46:57 devstack cinder-volume[91863]: DEBUG oslo_db.sqlalchemy.engines [None req-3a4b87e4-59c8-49eb-86d1-ee52e5d6ecb7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91863) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 15 15:46:57 devstack cinder-volume[91863]: DEBUG dbcounter [-] [91863] Writer thread running {{(pid=91863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jun 15 15:46:57 devstack cinder-volume[91863]: DEBUG cinder.db.sqlalchemy.api [None req-3a4b87e4-59c8-49eb-86d1-ee52e5d6ecb7 None None] Building query based on filter {{(pid=91863) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3979}}
Jun 15 15:46:57 devstack cinder-volume[91863]: DEBUG cinder.image.image_utils [None req-3a4b87e4-59c8-49eb-86d1-ee52e5d6ecb7 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=91863) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jun 15 15:46:57 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-3a4b87e4-59c8-49eb-86d1-ee52e5d6ecb7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:46:57 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-3a4b87e4-59c8-49eb-86d1-ee52e5d6ecb7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:46:57 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-3a4b87e4-59c8-49eb-86d1-ee52e5d6ecb7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:46:57 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-3a4b87e4-59c8-49eb-86d1-ee52e5d6ecb7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:46:57 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-3a4b87e4-59c8-49eb-86d1-ee52e5d6ecb7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:46:57 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3a4b87e4-59c8-49eb-86d1-ee52e5d6ecb7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:46:57 devstack cinder-volume[91863]: INFO cinder.keymgr.migration [None req-44a3f373-7574-4a43-b92c-1ee3ba600ed8 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jun 15 15:46:57 devstack sudo[91889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:46:57 devstack sudo[91889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:46:58 devstack sudo[91889]: pam_unix(sudo:session): session closed for user root
Jun 15 15:46:58 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3a4b87e4-59c8-49eb-86d1-ee52e5d6ecb7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.576s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:46:58 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-3a4b87e4-59c8-49eb-86d1-ee52e5d6ecb7 None None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:46:58 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-3a4b87e4-59c8-49eb-86d1-ee52e5d6ecb7 None None] Driver initialization completed successfully.
Jun 15 15:46:58 devstack cinder-volume[91863]: INFO cinder.manager [None req-3a4b87e4-59c8-49eb-86d1-ee52e5d6ecb7 None None] Initiating service 3 cleanup
Jun 15 15:46:58 devstack cinder-volume[91863]: INFO cinder.manager [None req-3a4b87e4-59c8-49eb-86d1-ee52e5d6ecb7 None None] Service 3 cleanup completed.
Jun 15 15:46:58 devstack cinder-volume[91863]: DEBUG cinder.service [None req-3a4b87e4-59c8-49eb-86d1-ee52e5d6ecb7 None None] Creating RPC server for service cinder-volume {{(pid=91863) start /opt/stack/cinder/cinder/service.py:231}}
Jun 15 15:46:58 devstack cinder-volume[91863]: DEBUG cinder.service [None req-3a4b87e4-59c8-49eb-86d1-ee52e5d6ecb7 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=91863) start /opt/stack/cinder/cinder/service.py:237}}
Jun 15 15:46:58 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-3a4b87e4-59c8-49eb-86d1-ee52e5d6ecb7 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Jun 15 15:46:58 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-3a4b87e4-59c8-49eb-86d1-ee52e5d6ecb7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:46:58 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-3a4b87e4-59c8-49eb-86d1-ee52e5d6ecb7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:46:58 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-3a4b87e4-59c8-49eb-86d1-ee52e5d6ecb7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:46:58 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-3a4b87e4-59c8-49eb-86d1-ee52e5d6ecb7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:46:58 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-3a4b87e4-59c8-49eb-86d1-ee52e5d6ecb7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:46:58 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3a4b87e4-59c8-49eb-86d1-ee52e5d6ecb7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:46:58 devstack sudo[91903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:46:58 devstack sudo[91903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:46:59 devstack sudo[91903]: pam_unix(sudo:session): session closed for user root
Jun 15 15:46:59 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3a4b87e4-59c8-49eb-86d1-ee52e5d6ecb7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.545s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:46:59 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-3a4b87e4-59c8-49eb-86d1-ee52e5d6ecb7 None None] Driver post RPC initialization completed successfully.
Jun 15 15:47:06 devstack cinder-volume[91592]: DEBUG dbcounter [-] [91592] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=91592) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 15:47:08 devstack cinder-volume[91863]: DEBUG dbcounter [-] [91863] Writing DB stats cinder:SELECT=4 {{(pid=91863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 15:47:09 devstack cinder-volume[91863]: DEBUG dbcounter [-] [91863] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=91863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 15:47:31 devstack cinder-volume[91863]: DEBUG oslo_service.periodic_task [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Running periodic task VolumeManager._thread_info {{(pid=91863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 15:47:31 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] thread count: 6 {{(pid=91863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 15 15:47:31 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] thread info: [<_MainThread(MainThread, started 131088232640640)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131088122704576)>, <Thread(Thread-3 (stat_writer), started daemon 131088123058112)>, <Thread(Rabbit-heartbeat, started daemon 131088121268864)>, <Thread(Thread-5 (_runner), started daemon 131088121904192)>, <Thread(Thread-7 (_runner), started daemon 131088122037248)>] {{(pid=91863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 15 15:47:56 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-3001e616-955e-4d0f-bd4c-d9d95ff78121 tempest-TaggedAttachmentsTest-1059968385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 15:47:56 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-3001e616-955e-4d0f-bd4c-d9d95ff78121 tempest-TaggedAttachmentsTest-1059968385 None] Flow 'volume_create_manager' (3b2e4dcf-e4f8-4759-a193-bd1202ea7df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:47:56 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-3001e616-955e-4d0f-bd4c-d9d95ff78121 tempest-TaggedAttachmentsTest-1059968385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd408323-3cd6-4902-9aa9-44f22d427201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:47:57 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-3001e616-955e-4d0f-bd4c-d9d95ff78121 tempest-TaggedAttachmentsTest-1059968385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd408323-3cd6-4902-9aa9-44f22d427201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:47:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1159921712',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=278ebdee-3395-4459-acee-cd6e2232f939,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97cba6b64b4e4d4f98d0e39876ece520',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:47:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:47:57Z,use_quota=True,user_id='e259baee2108423d9a14c139c2df2608',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:47:57 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-3001e616-955e-4d0f-bd4c-d9d95ff78121 tempest-TaggedAttachmentsTest-1059968385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6259f74f-c1b7-45e2-abd5-031369b95b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:47:57 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-3001e616-955e-4d0f-bd4c-d9d95ff78121 tempest-TaggedAttachmentsTest-1059968385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6259f74f-c1b7-45e2-abd5-031369b95b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:47:57 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-3001e616-955e-4d0f-bd4c-d9d95ff78121 tempest-TaggedAttachmentsTest-1059968385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f840d4e5-8fd1-4bde-9ea1-361f37de43b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:47:57 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-3001e616-955e-4d0f-bd4c-d9d95ff78121 tempest-TaggedAttachmentsTest-1059968385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f840d4e5-8fd1-4bde-9ea1-361f37de43b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '278ebdee-3395-4459-acee-cd6e2232f939', 'volume_name': 'volume-278ebdee-3395-4459-acee-cd6e2232f939', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:47:57 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-3001e616-955e-4d0f-bd4c-d9d95ff78121 tempest-TaggedAttachmentsTest-1059968385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c65c6871-0e68-4c81-8168-30a41933f073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:47:57 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-3001e616-955e-4d0f-bd4c-d9d95ff78121 tempest-TaggedAttachmentsTest-1059968385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c65c6871-0e68-4c81-8168-30a41933f073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:47:57 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-3001e616-955e-4d0f-bd4c-d9d95ff78121 tempest-TaggedAttachmentsTest-1059968385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe183539-6cd1-4c73-a772-5725510edb98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:47:57 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-3001e616-955e-4d0f-bd4c-d9d95ff78121 tempest-TaggedAttachmentsTest-1059968385 None] Volume 278ebdee-3395-4459-acee-cd6e2232f939: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-278ebdee-3395-4459-acee-cd6e2232f939', 'volume_size': 1}
Jun 15 15:47:57 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-3001e616-955e-4d0f-bd4c-d9d95ff78121 tempest-TaggedAttachmentsTest-1059968385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:47:57 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-3001e616-955e-4d0f-bd4c-d9d95ff78121 tempest-TaggedAttachmentsTest-1059968385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:47:57 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-3001e616-955e-4d0f-bd4c-d9d95ff78121 tempest-TaggedAttachmentsTest-1059968385 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:47:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1159921712',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=278ebdee-3395-4459-acee-cd6e2232f939,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97cba6b64b4e4d4f98d0e39876ece520',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:47:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:47:57Z,use_quota=True,user_id='e259baee2108423d9a14c139c2df2608',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 15:47:57 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-3001e616-955e-4d0f-bd4c-d9d95ff78121 tempest-TaggedAttachmentsTest-1059968385 None] Creating volume 278ebdee-3395-4459-acee-cd6e2232f939 {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 15:47:57 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-3001e616-955e-4d0f-bd4c-d9d95ff78121 tempest-TaggedAttachmentsTest-1059968385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:47:57 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-3001e616-955e-4d0f-bd4c-d9d95ff78121 tempest-TaggedAttachmentsTest-1059968385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:47:57 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-3001e616-955e-4d0f-bd4c-d9d95ff78121 tempest-TaggedAttachmentsTest-1059968385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:47:57 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-3001e616-955e-4d0f-bd4c-d9d95ff78121 tempest-TaggedAttachmentsTest-1059968385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:47:57 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-3001e616-955e-4d0f-bd4c-d9d95ff78121 tempest-TaggedAttachmentsTest-1059968385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:47:57 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-3001e616-955e-4d0f-bd4c-d9d95ff78121 tempest-TaggedAttachmentsTest-1059968385 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 15:47:57 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-3001e616-955e-4d0f-bd4c-d9d95ff78121 tempest-TaggedAttachmentsTest-1059968385 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 15:47:57 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3001e616-955e-4d0f-bd4c-d9d95ff78121 tempest-TaggedAttachmentsTest-1059968385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-278ebdee-3395-4459-acee-cd6e2232f939 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:47:57 devstack sudo[92277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-278ebdee-3395-4459-acee-cd6e2232f939 1073741824
Jun 15 15:47:57 devstack sudo[92277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:47:58 devstack sudo[92277]: pam_unix(sudo:session): session closed for user root
Jun 15 15:47:58 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3001e616-955e-4d0f-bd4c-d9d95ff78121 tempest-TaggedAttachmentsTest-1059968385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-278ebdee-3395-4459-acee-cd6e2232f939 1073741824" returned: 0 in 1.062s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:47:58 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3001e616-955e-4d0f-bd4c-d9d95ff78121 tempest-TaggedAttachmentsTest-1059968385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-278ebdee-3395-4459-acee-cd6e2232f939 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:47:58 devstack sudo[92596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-278ebdee-3395-4459-acee-cd6e2232f939
Jun 15 15:47:58 devstack sudo[92596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:47:58 devstack sudo[92596]: pam_unix(sudo:session): session closed for user root
Jun 15 15:47:58 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3001e616-955e-4d0f-bd4c-d9d95ff78121 tempest-TaggedAttachmentsTest-1059968385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-278ebdee-3395-4459-acee-cd6e2232f939" returned: 0 in 0.740s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:47:58 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-3001e616-955e-4d0f-bd4c-d9d95ff78121 tempest-TaggedAttachmentsTest-1059968385 None] <== create_volume: return (1866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 15:47:58 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-3001e616-955e-4d0f-bd4c-d9d95ff78121 tempest-TaggedAttachmentsTest-1059968385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.868s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:47:58 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-3001e616-955e-4d0f-bd4c-d9d95ff78121 tempest-TaggedAttachmentsTest-1059968385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe183539-6cd1-4c73-a772-5725510edb98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-278ebdee-3395-4459-acee-cd6e2232f939', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:47:58 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-3001e616-955e-4d0f-bd4c-d9d95ff78121 tempest-TaggedAttachmentsTest-1059968385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c2c1743-8534-446b-bb73-46e43dc7c878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:47:58 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-3001e616-955e-4d0f-bd4c-d9d95ff78121 tempest-TaggedAttachmentsTest-1059968385 None] Volume volume-278ebdee-3395-4459-acee-cd6e2232f939 (278ebdee-3395-4459-acee-cd6e2232f939): created successfully
Jun 15 15:47:58 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-3001e616-955e-4d0f-bd4c-d9d95ff78121 tempest-TaggedAttachmentsTest-1059968385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c2c1743-8534-446b-bb73-46e43dc7c878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:47:58 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-3001e616-955e-4d0f-bd4c-d9d95ff78121 tempest-TaggedAttachmentsTest-1059968385 None] Flow 'volume_create_manager' (3b2e4dcf-e4f8-4759-a193-bd1202ea7df9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:47:58 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-3001e616-955e-4d0f-bd4c-d9d95ff78121 tempest-TaggedAttachmentsTest-1059968385 None] Created volume successfully.
Jun 15 15:48:08 devstack cinder-volume[91863]: DEBUG dbcounter [-] [91863] Writing DB stats cinder:SELECT=1,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=91863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 15:48:09 devstack cinder-volume[91863]: DEBUG dbcounter [-] [91863] Writing DB stats cinder:SELECT=3,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=91863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 15:48:31 devstack cinder-volume[91863]: DEBUG oslo_service.periodic_task [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 15:48:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:48:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:48:31 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:48:31 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:48:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:48:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:48:31 devstack sudo[93148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:48:31 devstack sudo[93148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:48:31 devstack sudo[93148]: pam_unix(sudo:session): session closed for user root
Jun 15 15:48:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.819s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:48:31 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:48:31 devstack cinder-volume[91863]: DEBUG oslo_service.periodic_task [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Running periodic task VolumeManager._thread_info {{(pid=91863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 15:48:31 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] thread count: 6 {{(pid=91863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 15 15:48:31 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] thread info: [<_MainThread(MainThread, started 131088232640640)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131088122704576)>, <Thread(Thread-3 (stat_writer), started daemon 131088123058112)>, <Thread(Rabbit-heartbeat, started daemon 131088121268864)>, <Thread(Thread-5 (_runner), started daemon 131088121904192)>, <Thread(Thread-7 (_runner), started daemon 131088122037248)>] {{(pid=91863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 15 15:48:39 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcf720de-4a2a-48f0-9815-01f656698336 tempest-VolumesAdminNegativeTest-1203390189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 15:48:39 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-bcf720de-4a2a-48f0-9815-01f656698336 tempest-VolumesAdminNegativeTest-1203390189 None] Flow 'volume_create_manager' (2de3a530-6b11-447a-a213-d0c509bd8150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:48:39 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-bcf720de-4a2a-48f0-9815-01f656698336 tempest-VolumesAdminNegativeTest-1203390189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd55cac6-f32c-4d41-9c3a-81a0c31b0aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:48:39 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-bcf720de-4a2a-48f0-9815-01f656698336 tempest-VolumesAdminNegativeTest-1203390189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd55cac6-f32c-4d41-9c3a-81a0c31b0aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:48:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-858356795',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58e953d2-2961-4cdb-8793-b6c73b83cc56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bb7bc133b60425a94ec2812ebd24f33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:48:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:48:39Z,use_quota=True,user_id='3211a6e65ef04aca9cf4453cd9c4d3c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:48:39 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-bcf720de-4a2a-48f0-9815-01f656698336 tempest-VolumesAdminNegativeTest-1203390189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1221906f-c5ce-4f09-b014-897e4518ff15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:48:39 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-bcf720de-4a2a-48f0-9815-01f656698336 tempest-VolumesAdminNegativeTest-1203390189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1221906f-c5ce-4f09-b014-897e4518ff15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:48:39 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-bcf720de-4a2a-48f0-9815-01f656698336 tempest-VolumesAdminNegativeTest-1203390189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (263837a8-4665-4f72-be4c-d68d61ac93b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:48:39 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-bcf720de-4a2a-48f0-9815-01f656698336 tempest-VolumesAdminNegativeTest-1203390189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (263837a8-4665-4f72-be4c-d68d61ac93b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58e953d2-2961-4cdb-8793-b6c73b83cc56', 'volume_name': 'volume-58e953d2-2961-4cdb-8793-b6c73b83cc56', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:48:39 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-bcf720de-4a2a-48f0-9815-01f656698336 tempest-VolumesAdminNegativeTest-1203390189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (348fbb92-de34-455e-acca-a508a8a6eb33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:48:39 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-bcf720de-4a2a-48f0-9815-01f656698336 tempest-VolumesAdminNegativeTest-1203390189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (348fbb92-de34-455e-acca-a508a8a6eb33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:48:39 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-bcf720de-4a2a-48f0-9815-01f656698336 tempest-VolumesAdminNegativeTest-1203390189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba518bdf-2a85-4c35-8882-e5a92cfddecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:48:39 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-bcf720de-4a2a-48f0-9815-01f656698336 tempest-VolumesAdminNegativeTest-1203390189 None] Volume 58e953d2-2961-4cdb-8793-b6c73b83cc56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58e953d2-2961-4cdb-8793-b6c73b83cc56', 'volume_size': 1}
Jun 15 15:48:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-bcf720de-4a2a-48f0-9815-01f656698336 tempest-VolumesAdminNegativeTest-1203390189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:48:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-bcf720de-4a2a-48f0-9815-01f656698336 tempest-VolumesAdminNegativeTest-1203390189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:48:39 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-bcf720de-4a2a-48f0-9815-01f656698336 tempest-VolumesAdminNegativeTest-1203390189 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:48:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-858356795',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58e953d2-2961-4cdb-8793-b6c73b83cc56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bb7bc133b60425a94ec2812ebd24f33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:48:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:48:39Z,use_quota=True,user_id='3211a6e65ef04aca9cf4453cd9c4d3c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 15:48:39 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-bcf720de-4a2a-48f0-9815-01f656698336 tempest-VolumesAdminNegativeTest-1203390189 None] Creating volume 58e953d2-2961-4cdb-8793-b6c73b83cc56 {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 15:48:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-bcf720de-4a2a-48f0-9815-01f656698336 tempest-VolumesAdminNegativeTest-1203390189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:48:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-bcf720de-4a2a-48f0-9815-01f656698336 tempest-VolumesAdminNegativeTest-1203390189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:48:39 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-bcf720de-4a2a-48f0-9815-01f656698336 tempest-VolumesAdminNegativeTest-1203390189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:48:39 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-bcf720de-4a2a-48f0-9815-01f656698336 tempest-VolumesAdminNegativeTest-1203390189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:48:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-bcf720de-4a2a-48f0-9815-01f656698336 tempest-VolumesAdminNegativeTest-1203390189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:48:39 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-bcf720de-4a2a-48f0-9815-01f656698336 tempest-VolumesAdminNegativeTest-1203390189 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 15:48:39 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-bcf720de-4a2a-48f0-9815-01f656698336 tempest-VolumesAdminNegativeTest-1203390189 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 15:48:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-bcf720de-4a2a-48f0-9815-01f656698336 tempest-VolumesAdminNegativeTest-1203390189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-58e953d2-2961-4cdb-8793-b6c73b83cc56 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:48:39 devstack sudo[93206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-58e953d2-2961-4cdb-8793-b6c73b83cc56 1073741824
Jun 15 15:48:39 devstack sudo[93206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:48:41 devstack sudo[93206]: pam_unix(sudo:session): session closed for user root
Jun 15 15:48:41 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-bcf720de-4a2a-48f0-9815-01f656698336 tempest-VolumesAdminNegativeTest-1203390189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-58e953d2-2961-4cdb-8793-b6c73b83cc56 1073741824" returned: 0 in 2.237s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:48:41 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-bcf720de-4a2a-48f0-9815-01f656698336 tempest-VolumesAdminNegativeTest-1203390189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-58e953d2-2961-4cdb-8793-b6c73b83cc56 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:48:41 devstack sudo[93213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-58e953d2-2961-4cdb-8793-b6c73b83cc56
Jun 15 15:48:41 devstack sudo[93213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:48:43 devstack sudo[93213]: pam_unix(sudo:session): session closed for user root
Jun 15 15:48:43 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-bcf720de-4a2a-48f0-9815-01f656698336 tempest-VolumesAdminNegativeTest-1203390189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-58e953d2-2961-4cdb-8793-b6c73b83cc56" returned: 0 in 1.319s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:48:43 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-bcf720de-4a2a-48f0-9815-01f656698336 tempest-VolumesAdminNegativeTest-1203390189 None] <== create_volume: return (3656ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 15:48:43 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-bcf720de-4a2a-48f0-9815-01f656698336 tempest-VolumesAdminNegativeTest-1203390189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.659s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:48:43 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-bcf720de-4a2a-48f0-9815-01f656698336 tempest-VolumesAdminNegativeTest-1203390189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba518bdf-2a85-4c35-8882-e5a92cfddecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58e953d2-2961-4cdb-8793-b6c73b83cc56', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:48:43 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-bcf720de-4a2a-48f0-9815-01f656698336 tempest-VolumesAdminNegativeTest-1203390189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45c2221c-34c5-4118-b72a-21992da3db8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:48:43 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-bcf720de-4a2a-48f0-9815-01f656698336 tempest-VolumesAdminNegativeTest-1203390189 None] Volume volume-58e953d2-2961-4cdb-8793-b6c73b83cc56 (58e953d2-2961-4cdb-8793-b6c73b83cc56): created successfully
Jun 15 15:48:43 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-bcf720de-4a2a-48f0-9815-01f656698336 tempest-VolumesAdminNegativeTest-1203390189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45c2221c-34c5-4118-b72a-21992da3db8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:48:43 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-bcf720de-4a2a-48f0-9815-01f656698336 tempest-VolumesAdminNegativeTest-1203390189 None] Flow 'volume_create_manager' (2de3a530-6b11-447a-a213-d0c509bd8150) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:48:43 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-5713bd76-2e36-4e23-843c-de5454330931 tempest-ServerRescueNegativeTestJSON-61392538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 15:48:43 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5713bd76-2e36-4e23-843c-de5454330931 tempest-ServerRescueNegativeTestJSON-61392538 None] Flow 'volume_create_manager' (c7c7ae3e-8b31-477c-9230-48024e00741b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:48:43 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5713bd76-2e36-4e23-843c-de5454330931 tempest-ServerRescueNegativeTestJSON-61392538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2edd61bc-ee0a-4af0-9cba-5929bafd74fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:48:43 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5713bd76-2e36-4e23-843c-de5454330931 tempest-ServerRescueNegativeTestJSON-61392538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2edd61bc-ee0a-4af0-9cba-5929bafd74fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:48:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-316909818',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4fcf168-bf72-483c-a8de-a9b0ddbb1134,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92649199b0ad4b4b81851677bd1426b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:48:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:48:43Z,use_quota=True,user_id='28fd5557dc2a492a8d6ea76a7199405c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:48:43 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5713bd76-2e36-4e23-843c-de5454330931 tempest-ServerRescueNegativeTestJSON-61392538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de3b6b2d-e6b9-4b33-8dd3-5e24aaff8494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:48:43 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5713bd76-2e36-4e23-843c-de5454330931 tempest-ServerRescueNegativeTestJSON-61392538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de3b6b2d-e6b9-4b33-8dd3-5e24aaff8494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:48:43 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5713bd76-2e36-4e23-843c-de5454330931 tempest-ServerRescueNegativeTestJSON-61392538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47741347-a184-47e7-b9b9-ceb3cf7fa9ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:48:43 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5713bd76-2e36-4e23-843c-de5454330931 tempest-ServerRescueNegativeTestJSON-61392538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47741347-a184-47e7-b9b9-ceb3cf7fa9ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4fcf168-bf72-483c-a8de-a9b0ddbb1134', 'volume_name': 'volume-a4fcf168-bf72-483c-a8de-a9b0ddbb1134', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:48:43 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5713bd76-2e36-4e23-843c-de5454330931 tempest-ServerRescueNegativeTestJSON-61392538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28b2846f-471b-4968-8bb4-7609ea24ac5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:48:43 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5713bd76-2e36-4e23-843c-de5454330931 tempest-ServerRescueNegativeTestJSON-61392538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28b2846f-471b-4968-8bb4-7609ea24ac5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:48:43 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5713bd76-2e36-4e23-843c-de5454330931 tempest-ServerRescueNegativeTestJSON-61392538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8a55b93-a8e3-463c-b673-5b4485f6648d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:48:43 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-5713bd76-2e36-4e23-843c-de5454330931 tempest-ServerRescueNegativeTestJSON-61392538 None] Volume a4fcf168-bf72-483c-a8de-a9b0ddbb1134: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4fcf168-bf72-483c-a8de-a9b0ddbb1134', 'volume_size': 1}
Jun 15 15:48:43 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-5713bd76-2e36-4e23-843c-de5454330931 tempest-ServerRescueNegativeTestJSON-61392538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:48:43 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-5713bd76-2e36-4e23-843c-de5454330931 tempest-ServerRescueNegativeTestJSON-61392538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:48:43 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-5713bd76-2e36-4e23-843c-de5454330931 tempest-ServerRescueNegativeTestJSON-61392538 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:48:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-316909818',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4fcf168-bf72-483c-a8de-a9b0ddbb1134,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92649199b0ad4b4b81851677bd1426b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:48:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:48:43Z,use_quota=True,user_id='28fd5557dc2a492a8d6ea76a7199405c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 15:48:43 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-5713bd76-2e36-4e23-843c-de5454330931 tempest-ServerRescueNegativeTestJSON-61392538 None] Creating volume a4fcf168-bf72-483c-a8de-a9b0ddbb1134 {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 15:48:43 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-5713bd76-2e36-4e23-843c-de5454330931 tempest-ServerRescueNegativeTestJSON-61392538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:48:43 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-5713bd76-2e36-4e23-843c-de5454330931 tempest-ServerRescueNegativeTestJSON-61392538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:48:43 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-5713bd76-2e36-4e23-843c-de5454330931 tempest-ServerRescueNegativeTestJSON-61392538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:48:43 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-5713bd76-2e36-4e23-843c-de5454330931 tempest-ServerRescueNegativeTestJSON-61392538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:48:43 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-5713bd76-2e36-4e23-843c-de5454330931 tempest-ServerRescueNegativeTestJSON-61392538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:48:43 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-5713bd76-2e36-4e23-843c-de5454330931 tempest-ServerRescueNegativeTestJSON-61392538 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 15:48:43 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-5713bd76-2e36-4e23-843c-de5454330931 tempest-ServerRescueNegativeTestJSON-61392538 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 15:48:43 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5713bd76-2e36-4e23-843c-de5454330931 tempest-ServerRescueNegativeTestJSON-61392538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a4fcf168-bf72-483c-a8de-a9b0ddbb1134 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:48:43 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-bcf720de-4a2a-48f0-9815-01f656698336 tempest-VolumesAdminNegativeTest-1203390189 None] Created volume successfully.
Jun 15 15:48:43 devstack sudo[93217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a4fcf168-bf72-483c-a8de-a9b0ddbb1134 1073741824
Jun 15 15:48:43 devstack sudo[93217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:48:44 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-9210843d-2eeb-4344-a916-565d3e8662e5 tempest-VolumesAdminNegativeTest-1203390189 None] Acquiring lock "cinder-58e953d2-2961-4cdb-8793-b6c73b83cc56-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:48:44 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-9210843d-2eeb-4344-a916-565d3e8662e5 tempest-VolumesAdminNegativeTest-1203390189 None] Lock "cinder-58e953d2-2961-4cdb-8793-b6c73b83cc56-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:48:45 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-9210843d-2eeb-4344-a916-565d3e8662e5 tempest-VolumesAdminNegativeTest-1203390189 None] Acquiring lock "cinder-quobyte-58e953d2-2961-4cdb-8793-b6c73b83cc56" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:48:45 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-9210843d-2eeb-4344-a916-565d3e8662e5 tempest-VolumesAdminNegativeTest-1203390189 None] Lock "cinder-quobyte-58e953d2-2961-4cdb-8793-b6c73b83cc56" acquired by "delete_volume" :: waited 0.026s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:48:45 devstack cinder-volume[91863]: INFO oslo.privsep.daemon [None req-9210843d-2eeb-4344-a916-565d3e8662e5 tempest-VolumesAdminNegativeTest-1203390189 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmphl9lkfhn/privsep.sock']
Jun 15 15:48:45 devstack sudo[93223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmphl9lkfhn/privsep.sock
Jun 15 15:48:45 devstack sudo[93223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:48:45 devstack sudo[93217]: pam_unix(sudo:session): session closed for user root
Jun 15 15:48:45 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5713bd76-2e36-4e23-843c-de5454330931 tempest-ServerRescueNegativeTestJSON-61392538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a4fcf168-bf72-483c-a8de-a9b0ddbb1134 1073741824" returned: 0 in 1.834s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:48:45 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5713bd76-2e36-4e23-843c-de5454330931 tempest-ServerRescueNegativeTestJSON-61392538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a4fcf168-bf72-483c-a8de-a9b0ddbb1134 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:48:45 devstack sudo[93225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a4fcf168-bf72-483c-a8de-a9b0ddbb1134
Jun 15 15:48:45 devstack sudo[93225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:48:46 devstack sudo[93225]: pam_unix(sudo:session): session closed for user root
Jun 15 15:48:46 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5713bd76-2e36-4e23-843c-de5454330931 tempest-ServerRescueNegativeTestJSON-61392538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a4fcf168-bf72-483c-a8de-a9b0ddbb1134" returned: 0 in 0.962s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:48:46 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-5713bd76-2e36-4e23-843c-de5454330931 tempest-ServerRescueNegativeTestJSON-61392538 None] <== create_volume: return (2903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 15:48:46 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-5713bd76-2e36-4e23-843c-de5454330931 tempest-ServerRescueNegativeTestJSON-61392538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.910s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:48:46 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5713bd76-2e36-4e23-843c-de5454330931 tempest-ServerRescueNegativeTestJSON-61392538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8a55b93-a8e3-463c-b673-5b4485f6648d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4fcf168-bf72-483c-a8de-a9b0ddbb1134', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:48:46 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5713bd76-2e36-4e23-843c-de5454330931 tempest-ServerRescueNegativeTestJSON-61392538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b296eb33-b5c2-4f92-8195-df3a23da684c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:48:46 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-5713bd76-2e36-4e23-843c-de5454330931 tempest-ServerRescueNegativeTestJSON-61392538 None] Volume volume-a4fcf168-bf72-483c-a8de-a9b0ddbb1134 (a4fcf168-bf72-483c-a8de-a9b0ddbb1134): created successfully
Jun 15 15:48:46 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5713bd76-2e36-4e23-843c-de5454330931 tempest-ServerRescueNegativeTestJSON-61392538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b296eb33-b5c2-4f92-8195-df3a23da684c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:48:46 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5713bd76-2e36-4e23-843c-de5454330931 tempest-ServerRescueNegativeTestJSON-61392538 None] Flow 'volume_create_manager' (c7c7ae3e-8b31-477c-9230-48024e00741b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:48:46 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-5713bd76-2e36-4e23-843c-de5454330931 tempest-ServerRescueNegativeTestJSON-61392538 None] Created volume successfully.
Jun 15 15:48:48 devstack sudo[93223]: pam_unix(sudo:session): session closed for user root
Jun 15 15:48:48 devstack cinder-volume[91863]: INFO oslo.privsep.daemon [None req-9210843d-2eeb-4344-a916-565d3e8662e5 tempest-VolumesAdminNegativeTest-1203390189 None] Spawned new privsep daemon via rootwrap
Jun 15 15:48:48 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [None req-9210843d-2eeb-4344-a916-565d3e8662e5 tempest-VolumesAdminNegativeTest-1203390189 None] Accepted privsep connection to /tmp/tmphl9lkfhn/privsep.sock {{(pid=91863) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:418}}
Jun 15 15:48:48 devstack cinder-volume[91863]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jun 15 15:48:48 devstack cinder-volume[91863]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jun 15 15:48:48 devstack cinder-volume[91863]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Jun 15 15:48:48 devstack cinder-volume[91863]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 93229
Jun 15 15:48:48 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3c69ee-eb12-4bc1-8c59-dd2d540122f3]: (2,) {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:48:48 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9238dd8-42bc-4597-a4a9-7b563e854d43]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:48:48 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-9210843d-2eeb-4344-a916-565d3e8662e5 tempest-VolumesAdminNegativeTest-1203390189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-58e953d2-2961-4cdb-8793-b6c73b83cc56 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:48:48 devstack sudo[93231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-58e953d2-2961-4cdb-8793-b6c73b83cc56
Jun 15 15:48:48 devstack sudo[93231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:48:50 devstack sudo[93231]: pam_unix(sudo:session): session closed for user root
Jun 15 15:48:50 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-9210843d-2eeb-4344-a916-565d3e8662e5 tempest-VolumesAdminNegativeTest-1203390189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-58e953d2-2961-4cdb-8793-b6c73b83cc56" returned: 0 in 1.986s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:48:50 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-9210843d-2eeb-4344-a916-565d3e8662e5 tempest-VolumesAdminNegativeTest-1203390189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-58e953d2-2961-4cdb-8793-b6c73b83cc56 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:48:50 devstack sudo[93237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-58e953d2-2961-4cdb-8793-b6c73b83cc56
Jun 15 15:48:50 devstack sudo[93237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:48:51 devstack sudo[93237]: pam_unix(sudo:session): session closed for user root
Jun 15 15:48:51 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-9210843d-2eeb-4344-a916-565d3e8662e5 tempest-VolumesAdminNegativeTest-1203390189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-58e953d2-2961-4cdb-8793-b6c73b83cc56" returned: 0 in 1.672s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:48:51 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-9210843d-2eeb-4344-a916-565d3e8662e5 tempest-VolumesAdminNegativeTest-1203390189 None] Lock "cinder-quobyte-58e953d2-2961-4cdb-8793-b6c73b83cc56" released by "delete_volume" :: held 6.730s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:48:52 devstack cinder-volume[91863]: WARNING cinder.quota [None req-9210843d-2eeb-4344-a916-565d3e8662e5 tempest-VolumesAdminNegativeTest-1203390189 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jun 15 15:48:52 devstack cinder-volume[91863]: WARNING cinder.quota [None req-9210843d-2eeb-4344-a916-565d3e8662e5 tempest-VolumesAdminNegativeTest-1203390189 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jun 15 15:48:52 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-9210843d-2eeb-4344-a916-565d3e8662e5 tempest-VolumesAdminNegativeTest-1203390189 None] Created reservations ['3c550d1c-04ff-4e94-b382-7299274e68e6', '9e80573e-6fc3-41da-93d0-541a346547de', '43cbe0d7-296e-4896-93aa-59ecc0a9d8e8', '77269129-305e-4c2f-a723-737a3f4c4e94'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:48:52 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-9210843d-2eeb-4344-a916-565d3e8662e5 tempest-VolumesAdminNegativeTest-1203390189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:48:52 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-9210843d-2eeb-4344-a916-565d3e8662e5 tempest-VolumesAdminNegativeTest-1203390189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:48:52 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-9210843d-2eeb-4344-a916-565d3e8662e5 tempest-VolumesAdminNegativeTest-1203390189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:48:52 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-9210843d-2eeb-4344-a916-565d3e8662e5 tempest-VolumesAdminNegativeTest-1203390189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:48:52 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-9210843d-2eeb-4344-a916-565d3e8662e5 tempest-VolumesAdminNegativeTest-1203390189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:48:52 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-9210843d-2eeb-4344-a916-565d3e8662e5 tempest-VolumesAdminNegativeTest-1203390189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:48:52 devstack sudo[93242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:48:52 devstack sudo[93242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:48:54 devstack sudo[93242]: pam_unix(sudo:session): session closed for user root
Jun 15 15:48:54 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-9210843d-2eeb-4344-a916-565d3e8662e5 tempest-VolumesAdminNegativeTest-1203390189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 1.696s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:48:54 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-9210843d-2eeb-4344-a916-565d3e8662e5 tempest-VolumesAdminNegativeTest-1203390189 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:48:54 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-9210843d-2eeb-4344-a916-565d3e8662e5 tempest-VolumesAdminNegativeTest-1203390189 None] Deleted volume successfully.
Jun 15 15:48:54 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-9210843d-2eeb-4344-a916-565d3e8662e5 tempest-VolumesAdminNegativeTest-1203390189 None] Lock "cinder-58e953d2-2961-4cdb-8793-b6c73b83cc56-delete_volume" released by "delete_volume" :: held 9.224s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:49:04 devstack cinder-volume[91863]: DEBUG dbcounter [-] [91863] Writing DB stats cinder:SELECT=11,cinder:UPDATE=11,cinder:DELETE=2,cinder:INSERT=2 {{(pid=91863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 15:49:09 devstack cinder-volume[91863]: DEBUG dbcounter [-] [91863] Writing DB stats cinder:SELECT=8,cinder:UPDATE=18,cinder:INSERT=4,cinder:DELETE=1 {{(pid=91863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 15:49:11 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-b3a3cfb9-7861-4ec9-9a2a-8b6c5d12a239 tempest-ServerRescueNegativeTestJSON-61392538 None] Acquiring lock "cinder-a4fcf168-bf72-483c-a8de-a9b0ddbb1134-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:49:11 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-b3a3cfb9-7861-4ec9-9a2a-8b6c5d12a239 tempest-ServerRescueNegativeTestJSON-61392538 None] Lock "cinder-a4fcf168-bf72-483c-a8de-a9b0ddbb1134-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:49:11 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-b3a3cfb9-7861-4ec9-9a2a-8b6c5d12a239 tempest-ServerRescueNegativeTestJSON-61392538 None] Acquiring lock "cinder-quobyte-a4fcf168-bf72-483c-a8de-a9b0ddbb1134" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:49:11 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-b3a3cfb9-7861-4ec9-9a2a-8b6c5d12a239 tempest-ServerRescueNegativeTestJSON-61392538 None] Lock "cinder-quobyte-a4fcf168-bf72-483c-a8de-a9b0ddbb1134" acquired by "delete_volume" :: waited 0.022s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:49:12 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a5dd4d8-8fbf-44de-81f0-814830c2f67b]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:49:12 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-b3a3cfb9-7861-4ec9-9a2a-8b6c5d12a239 tempest-ServerRescueNegativeTestJSON-61392538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a4fcf168-bf72-483c-a8de-a9b0ddbb1134 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:49:12 devstack sudo[93638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a4fcf168-bf72-483c-a8de-a9b0ddbb1134
Jun 15 15:49:12 devstack sudo[93638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:49:13 devstack sudo[93638]: pam_unix(sudo:session): session closed for user root
Jun 15 15:49:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-b3a3cfb9-7861-4ec9-9a2a-8b6c5d12a239 tempest-ServerRescueNegativeTestJSON-61392538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a4fcf168-bf72-483c-a8de-a9b0ddbb1134" returned: 0 in 1.235s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:49:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-b3a3cfb9-7861-4ec9-9a2a-8b6c5d12a239 tempest-ServerRescueNegativeTestJSON-61392538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a4fcf168-bf72-483c-a8de-a9b0ddbb1134 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:49:13 devstack sudo[93644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a4fcf168-bf72-483c-a8de-a9b0ddbb1134
Jun 15 15:49:13 devstack sudo[93644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:49:14 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdd76010-6aec-434d-a212-4d35ed37e702 tempest-DeleteServersTestJSON-434425613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 15:49:14 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-cdd76010-6aec-434d-a212-4d35ed37e702 tempest-DeleteServersTestJSON-434425613 None] Flow 'volume_create_manager' (e4467c4d-ff70-4a79-973e-6428e57e77c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:49:14 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-cdd76010-6aec-434d-a212-4d35ed37e702 tempest-DeleteServersTestJSON-434425613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc74fa4a-1975-4776-9bb4-6c8f2eab7160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:49:14 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-cdd76010-6aec-434d-a212-4d35ed37e702 tempest-DeleteServersTestJSON-434425613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc74fa4a-1975-4776-9bb4-6c8f2eab7160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:49:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1642961692',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25c214f9-76c5-4ca3-8835-aad4a4a8397a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22855abe8b0840ea87fac0d3eb892b6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:49:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:49:14Z,use_quota=True,user_id='1b871a3ffc39492f9cf83e35f1d9e235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:49:14 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-cdd76010-6aec-434d-a212-4d35ed37e702 tempest-DeleteServersTestJSON-434425613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ea8f8a8-6591-4c9b-8aa0-45c87de3f88a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:49:14 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-cdd76010-6aec-434d-a212-4d35ed37e702 tempest-DeleteServersTestJSON-434425613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ea8f8a8-6591-4c9b-8aa0-45c87de3f88a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:49:14 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-cdd76010-6aec-434d-a212-4d35ed37e702 tempest-DeleteServersTestJSON-434425613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c783c20-945d-473f-b41e-03b92b422bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:49:14 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-cdd76010-6aec-434d-a212-4d35ed37e702 tempest-DeleteServersTestJSON-434425613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c783c20-945d-473f-b41e-03b92b422bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25c214f9-76c5-4ca3-8835-aad4a4a8397a', 'volume_name': 'volume-25c214f9-76c5-4ca3-8835-aad4a4a8397a', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:49:14 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-cdd76010-6aec-434d-a212-4d35ed37e702 tempest-DeleteServersTestJSON-434425613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (204504ff-5c02-4937-a8d7-95cf43cb66c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:49:14 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-cdd76010-6aec-434d-a212-4d35ed37e702 tempest-DeleteServersTestJSON-434425613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (204504ff-5c02-4937-a8d7-95cf43cb66c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:49:14 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-cdd76010-6aec-434d-a212-4d35ed37e702 tempest-DeleteServersTestJSON-434425613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21127faf-2582-40e0-9a59-2e672c0cc8f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:49:14 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-cdd76010-6aec-434d-a212-4d35ed37e702 tempest-DeleteServersTestJSON-434425613 None] Volume 25c214f9-76c5-4ca3-8835-aad4a4a8397a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25c214f9-76c5-4ca3-8835-aad4a4a8397a', 'volume_size': 1}
Jun 15 15:49:14 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-cdd76010-6aec-434d-a212-4d35ed37e702 tempest-DeleteServersTestJSON-434425613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:49:14 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-cdd76010-6aec-434d-a212-4d35ed37e702 tempest-DeleteServersTestJSON-434425613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:49:14 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-cdd76010-6aec-434d-a212-4d35ed37e702 tempest-DeleteServersTestJSON-434425613 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:49:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1642961692',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25c214f9-76c5-4ca3-8835-aad4a4a8397a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22855abe8b0840ea87fac0d3eb892b6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:49:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:49:14Z,use_quota=True,user_id='1b871a3ffc39492f9cf83e35f1d9e235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 15:49:14 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-cdd76010-6aec-434d-a212-4d35ed37e702 tempest-DeleteServersTestJSON-434425613 None] Creating volume 25c214f9-76c5-4ca3-8835-aad4a4a8397a {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 15:49:14 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-cdd76010-6aec-434d-a212-4d35ed37e702 tempest-DeleteServersTestJSON-434425613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:49:14 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-cdd76010-6aec-434d-a212-4d35ed37e702 tempest-DeleteServersTestJSON-434425613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.015s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:49:14 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-cdd76010-6aec-434d-a212-4d35ed37e702 tempest-DeleteServersTestJSON-434425613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:49:14 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-cdd76010-6aec-434d-a212-4d35ed37e702 tempest-DeleteServersTestJSON-434425613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:49:14 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-cdd76010-6aec-434d-a212-4d35ed37e702 tempest-DeleteServersTestJSON-434425613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:49:14 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-cdd76010-6aec-434d-a212-4d35ed37e702 tempest-DeleteServersTestJSON-434425613 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 15:49:14 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-cdd76010-6aec-434d-a212-4d35ed37e702 tempest-DeleteServersTestJSON-434425613 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 15:49:14 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-cdd76010-6aec-434d-a212-4d35ed37e702 tempest-DeleteServersTestJSON-434425613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-25c214f9-76c5-4ca3-8835-aad4a4a8397a 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:49:14 devstack sudo[93648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-25c214f9-76c5-4ca3-8835-aad4a4a8397a 1073741824
Jun 15 15:49:14 devstack sudo[93648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:49:14 devstack sudo[93644]: pam_unix(sudo:session): session closed for user root
Jun 15 15:49:14 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-b3a3cfb9-7861-4ec9-9a2a-8b6c5d12a239 tempest-ServerRescueNegativeTestJSON-61392538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a4fcf168-bf72-483c-a8de-a9b0ddbb1134" returned: 0 in 1.406s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:49:14 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-b3a3cfb9-7861-4ec9-9a2a-8b6c5d12a239 tempest-ServerRescueNegativeTestJSON-61392538 None] Lock "cinder-quobyte-a4fcf168-bf72-483c-a8de-a9b0ddbb1134" released by "delete_volume" :: held 2.718s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:49:14 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-b3a3cfb9-7861-4ec9-9a2a-8b6c5d12a239 tempest-ServerRescueNegativeTestJSON-61392538 None] Created reservations ['97020818-8eff-4360-ae9d-a2df1822760e', '70a10e6c-54cd-43fd-b399-3fe6c30aa9e6', '499aa1fa-df1e-4a3f-86ec-a8a13c7f479a', '5776882b-bdd1-49fb-9164-0e4a3d7c004a'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:49:14 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-b3a3cfb9-7861-4ec9-9a2a-8b6c5d12a239 tempest-ServerRescueNegativeTestJSON-61392538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:49:14 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-b3a3cfb9-7861-4ec9-9a2a-8b6c5d12a239 tempest-ServerRescueNegativeTestJSON-61392538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:49:14 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-b3a3cfb9-7861-4ec9-9a2a-8b6c5d12a239 tempest-ServerRescueNegativeTestJSON-61392538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:49:14 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-b3a3cfb9-7861-4ec9-9a2a-8b6c5d12a239 tempest-ServerRescueNegativeTestJSON-61392538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:49:14 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-b3a3cfb9-7861-4ec9-9a2a-8b6c5d12a239 tempest-ServerRescueNegativeTestJSON-61392538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:49:14 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-b3a3cfb9-7861-4ec9-9a2a-8b6c5d12a239 tempest-ServerRescueNegativeTestJSON-61392538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:49:15 devstack sudo[93650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:49:15 devstack sudo[93650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:49:16 devstack sudo[93650]: pam_unix(sudo:session): session closed for user root
Jun 15 15:49:16 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-b3a3cfb9-7861-4ec9-9a2a-8b6c5d12a239 tempest-ServerRescueNegativeTestJSON-61392538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 1.145s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:49:16 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-b3a3cfb9-7861-4ec9-9a2a-8b6c5d12a239 tempest-ServerRescueNegativeTestJSON-61392538 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:49:16 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-b3a3cfb9-7861-4ec9-9a2a-8b6c5d12a239 tempest-ServerRescueNegativeTestJSON-61392538 None] Deleted volume successfully.
Jun 15 15:49:16 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-b3a3cfb9-7861-4ec9-9a2a-8b6c5d12a239 tempest-ServerRescueNegativeTestJSON-61392538 None] Lock "cinder-a4fcf168-bf72-483c-a8de-a9b0ddbb1134-delete_volume" released by "delete_volume" :: held 4.330s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:49:16 devstack sudo[93648]: pam_unix(sudo:session): session closed for user root
Jun 15 15:49:16 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-cdd76010-6aec-434d-a212-4d35ed37e702 tempest-DeleteServersTestJSON-434425613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-25c214f9-76c5-4ca3-8835-aad4a4a8397a 1073741824" returned: 0 in 2.207s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:49:16 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-cdd76010-6aec-434d-a212-4d35ed37e702 tempest-DeleteServersTestJSON-434425613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-25c214f9-76c5-4ca3-8835-aad4a4a8397a {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:49:16 devstack sudo[93658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-25c214f9-76c5-4ca3-8835-aad4a4a8397a
Jun 15 15:49:16 devstack sudo[93658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:49:18 devstack sudo[93658]: pam_unix(sudo:session): session closed for user root
Jun 15 15:49:18 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-cdd76010-6aec-434d-a212-4d35ed37e702 tempest-DeleteServersTestJSON-434425613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-25c214f9-76c5-4ca3-8835-aad4a4a8397a" returned: 0 in 1.499s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:49:18 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-cdd76010-6aec-434d-a212-4d35ed37e702 tempest-DeleteServersTestJSON-434425613 None] <== create_volume: return (3807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 15:49:18 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-cdd76010-6aec-434d-a212-4d35ed37e702 tempest-DeleteServersTestJSON-434425613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.837s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:49:18 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-cdd76010-6aec-434d-a212-4d35ed37e702 tempest-DeleteServersTestJSON-434425613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21127faf-2582-40e0-9a59-2e672c0cc8f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25c214f9-76c5-4ca3-8835-aad4a4a8397a', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:49:18 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-cdd76010-6aec-434d-a212-4d35ed37e702 tempest-DeleteServersTestJSON-434425613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e3e129e-41b9-4065-b4a0-f3c77c44eaab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:49:18 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-cdd76010-6aec-434d-a212-4d35ed37e702 tempest-DeleteServersTestJSON-434425613 None] Volume volume-25c214f9-76c5-4ca3-8835-aad4a4a8397a (25c214f9-76c5-4ca3-8835-aad4a4a8397a): created successfully
Jun 15 15:49:18 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-cdd76010-6aec-434d-a212-4d35ed37e702 tempest-DeleteServersTestJSON-434425613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e3e129e-41b9-4065-b4a0-f3c77c44eaab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:49:18 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-cdd76010-6aec-434d-a212-4d35ed37e702 tempest-DeleteServersTestJSON-434425613 None] Flow 'volume_create_manager' (e4467c4d-ff70-4a79-973e-6428e57e77c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:49:18 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-cdd76010-6aec-434d-a212-4d35ed37e702 tempest-DeleteServersTestJSON-434425613 None] Created volume successfully.
Jun 15 15:49:26 devstack cinder-volume[91863]: WARNING py.warnings [req-9a16b5e3-a9dd-4967-b75b-74c332db0878 req-34456352-773a-4cb7-b531-1e9defa54060 tempest-DeleteServersTestJSON-434425613 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2505: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment".  Apply join condition(s) between each element to resolve.
Jun 15 15:49:26 devstack cinder-volume[91863]:   .first()
Jun 15 15:49:26 devstack cinder-volume[91863]: 
Jun 15 15:49:26 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [req-9a16b5e3-a9dd-4967-b75b-74c332db0878 req-34456352-773a-4cb7-b531-1e9defa54060 tempest-DeleteServersTestJSON-434425613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:49:26 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [req-9a16b5e3-a9dd-4967-b75b-74c332db0878 req-34456352-773a-4cb7-b531-1e9defa54060 tempest-DeleteServersTestJSON-434425613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:49:26 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ac1981-36ff-4066-a442-4078446c6def]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:49:26 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-9a16b5e3-a9dd-4967-b75b-74c332db0878 req-34456352-773a-4cb7-b531-1e9defa54060 tempest-DeleteServersTestJSON-434425613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-25c214f9-76c5-4ca3-8835-aad4a4a8397a {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:49:27 devstack sudo[93834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-25c214f9-76c5-4ca3-8835-aad4a4a8397a
Jun 15 15:49:27 devstack sudo[93834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:49:27 devstack sudo[93834]: pam_unix(sudo:session): session closed for user root
Jun 15 15:49:27 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-9a16b5e3-a9dd-4967-b75b-74c332db0878 req-34456352-773a-4cb7-b531-1e9defa54060 tempest-DeleteServersTestJSON-434425613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-25c214f9-76c5-4ca3-8835-aad4a4a8397a" returned: 0 in 0.990s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:49:27 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [req-9a16b5e3-a9dd-4967-b75b-74c332db0878 req-34456352-773a-4cb7-b531-1e9defa54060 tempest-DeleteServersTestJSON-434425613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.043s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:49:27 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [req-9a16b5e3-a9dd-4967-b75b-74c332db0878 req-34456352-773a-4cb7-b531-1e9defa54060 tempest-DeleteServersTestJSON-434425613 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc', 'name': 'volume-25c214f9-76c5-4ca3-8835-aad4a4a8397a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5b5bc274-e99c-4229-a6d1-696bdfb2ede6', 'enforce_multipath': True} {{(pid=91863) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 15 15:49:27 devstack cinder-volume[91863]: INFO cinder.volume.manager [req-9a16b5e3-a9dd-4967-b75b-74c332db0878 req-34456352-773a-4cb7-b531-1e9defa54060 tempest-DeleteServersTestJSON-434425613 None] attachment_update completed successfully.
Jun 15 15:49:31 devstack cinder-volume[91863]: DEBUG oslo_service.periodic_task [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 15:49:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:49:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:49:31 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:49:31 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:49:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:49:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:49:31 devstack sudo[94268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:49:31 devstack sudo[94268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:49:31 devstack sudo[94268]: pam_unix(sudo:session): session closed for user root
Jun 15 15:49:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.607s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:49:31 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:49:31 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2172715-864d-4046-a307-8db868e94eb8 tempest-VolumesTestJSON-382396653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 15:49:31 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e2172715-864d-4046-a307-8db868e94eb8 tempest-VolumesTestJSON-382396653 None] Flow 'volume_create_manager' (d0d37b05-a363-4ba1-a7a9-2428d337e8cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:49:31 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e2172715-864d-4046-a307-8db868e94eb8 tempest-VolumesTestJSON-382396653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e771b0cf-6448-481e-ba2f-eb9c8b5b1929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:49:31 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e2172715-864d-4046-a307-8db868e94eb8 tempest-VolumesTestJSON-382396653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e771b0cf-6448-481e-ba2f-eb9c8b5b1929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:49:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1425405687',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48d6a1fd-3959-483a-8700-9fd55262b186,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9b0507c21822426286fa55ba8b70db73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:49:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:49:32Z,use_quota=True,user_id='cc9e7d4b787a42f7b778ba7c5208aab1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:49:31 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e2172715-864d-4046-a307-8db868e94eb8 tempest-VolumesTestJSON-382396653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2cb3696-60ec-454d-95fb-90be61dbb486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:49:31 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e2172715-864d-4046-a307-8db868e94eb8 tempest-VolumesTestJSON-382396653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2cb3696-60ec-454d-95fb-90be61dbb486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:49:31 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e2172715-864d-4046-a307-8db868e94eb8 tempest-VolumesTestJSON-382396653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65a50981-361e-4d8f-b7ed-4f28de72e7f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:49:31 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e2172715-864d-4046-a307-8db868e94eb8 tempest-VolumesTestJSON-382396653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65a50981-361e-4d8f-b7ed-4f28de72e7f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48d6a1fd-3959-483a-8700-9fd55262b186', 'volume_name': 'volume-48d6a1fd-3959-483a-8700-9fd55262b186', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:49:31 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e2172715-864d-4046-a307-8db868e94eb8 tempest-VolumesTestJSON-382396653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffbfcc38-878b-48a5-a5b0-0c9d84a7127e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:49:31 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e2172715-864d-4046-a307-8db868e94eb8 tempest-VolumesTestJSON-382396653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffbfcc38-878b-48a5-a5b0-0c9d84a7127e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:49:31 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e2172715-864d-4046-a307-8db868e94eb8 tempest-VolumesTestJSON-382396653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c66c48d7-d06d-4347-a43c-22bc148599fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:49:31 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-e2172715-864d-4046-a307-8db868e94eb8 tempest-VolumesTestJSON-382396653 None] Volume 48d6a1fd-3959-483a-8700-9fd55262b186: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48d6a1fd-3959-483a-8700-9fd55262b186', 'volume_size': 1}
Jun 15 15:49:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-e2172715-864d-4046-a307-8db868e94eb8 tempest-VolumesTestJSON-382396653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:49:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-e2172715-864d-4046-a307-8db868e94eb8 tempest-VolumesTestJSON-382396653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:49:31 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-e2172715-864d-4046-a307-8db868e94eb8 tempest-VolumesTestJSON-382396653 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:49:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1425405687',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48d6a1fd-3959-483a-8700-9fd55262b186,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9b0507c21822426286fa55ba8b70db73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:49:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:49:32Z,use_quota=True,user_id='cc9e7d4b787a42f7b778ba7c5208aab1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 15:49:31 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-e2172715-864d-4046-a307-8db868e94eb8 tempest-VolumesTestJSON-382396653 None] Creating volume 48d6a1fd-3959-483a-8700-9fd55262b186 {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 15:49:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-e2172715-864d-4046-a307-8db868e94eb8 tempest-VolumesTestJSON-382396653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:49:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-e2172715-864d-4046-a307-8db868e94eb8 tempest-VolumesTestJSON-382396653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:49:31 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-e2172715-864d-4046-a307-8db868e94eb8 tempest-VolumesTestJSON-382396653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:49:31 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-e2172715-864d-4046-a307-8db868e94eb8 tempest-VolumesTestJSON-382396653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:49:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-e2172715-864d-4046-a307-8db868e94eb8 tempest-VolumesTestJSON-382396653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:49:31 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-e2172715-864d-4046-a307-8db868e94eb8 tempest-VolumesTestJSON-382396653 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 15:49:31 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-e2172715-864d-4046-a307-8db868e94eb8 tempest-VolumesTestJSON-382396653 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 15:49:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-e2172715-864d-4046-a307-8db868e94eb8 tempest-VolumesTestJSON-382396653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-48d6a1fd-3959-483a-8700-9fd55262b186 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:49:31 devstack sudo[94271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-48d6a1fd-3959-483a-8700-9fd55262b186 1073741824
Jun 15 15:49:31 devstack sudo[94271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:49:32 devstack sudo[94271]: pam_unix(sudo:session): session closed for user root
Jun 15 15:49:32 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-e2172715-864d-4046-a307-8db868e94eb8 tempest-VolumesTestJSON-382396653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-48d6a1fd-3959-483a-8700-9fd55262b186 1073741824" returned: 0 in 0.841s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:49:32 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-e2172715-864d-4046-a307-8db868e94eb8 tempest-VolumesTestJSON-382396653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-48d6a1fd-3959-483a-8700-9fd55262b186 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:49:32 devstack sudo[94277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-48d6a1fd-3959-483a-8700-9fd55262b186
Jun 15 15:49:32 devstack sudo[94277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:49:33 devstack sudo[94277]: pam_unix(sudo:session): session closed for user root
Jun 15 15:49:33 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-e2172715-864d-4046-a307-8db868e94eb8 tempest-VolumesTestJSON-382396653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-48d6a1fd-3959-483a-8700-9fd55262b186" returned: 0 in 0.722s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:49:33 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-e2172715-864d-4046-a307-8db868e94eb8 tempest-VolumesTestJSON-382396653 None] <== create_volume: return (1611ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 15:49:33 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-e2172715-864d-4046-a307-8db868e94eb8 tempest-VolumesTestJSON-382396653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.613s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:49:33 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e2172715-864d-4046-a307-8db868e94eb8 tempest-VolumesTestJSON-382396653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c66c48d7-d06d-4347-a43c-22bc148599fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48d6a1fd-3959-483a-8700-9fd55262b186', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:49:33 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e2172715-864d-4046-a307-8db868e94eb8 tempest-VolumesTestJSON-382396653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86308a85-b37b-40f5-a64a-470464ea9f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:49:33 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-e2172715-864d-4046-a307-8db868e94eb8 tempest-VolumesTestJSON-382396653 None] Volume volume-48d6a1fd-3959-483a-8700-9fd55262b186 (48d6a1fd-3959-483a-8700-9fd55262b186): created successfully
Jun 15 15:49:33 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e2172715-864d-4046-a307-8db868e94eb8 tempest-VolumesTestJSON-382396653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86308a85-b37b-40f5-a64a-470464ea9f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:49:33 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e2172715-864d-4046-a307-8db868e94eb8 tempest-VolumesTestJSON-382396653 None] Flow 'volume_create_manager' (d0d37b05-a363-4ba1-a7a9-2428d337e8cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:49:33 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-e2172715-864d-4046-a307-8db868e94eb8 tempest-VolumesTestJSON-382396653 None] Created volume successfully.
Jun 15 15:49:34 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-fae5c9f3-59d9-402c-bb73-714451325dc2 tempest-VolumesTestJSON-382396653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 15:49:34 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-fae5c9f3-59d9-402c-bb73-714451325dc2 tempest-VolumesTestJSON-382396653 None] Flow 'volume_create_manager' (eae21413-5bb2-4bfa-9f2c-c0a2fa93ad4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:49:34 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-fae5c9f3-59d9-402c-bb73-714451325dc2 tempest-VolumesTestJSON-382396653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d23cc557-42d0-42b2-8f28-4b0298581bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:49:34 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-fae5c9f3-59d9-402c-bb73-714451325dc2 tempest-VolumesTestJSON-382396653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d23cc557-42d0-42b2-8f28-4b0298581bcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:49:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-692635102',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac9e2dc8-512a-45b7-bd3d-6d39bfc103bd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9b0507c21822426286fa55ba8b70db73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:49:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:49:35Z,use_quota=True,user_id='cc9e7d4b787a42f7b778ba7c5208aab1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:49:34 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-fae5c9f3-59d9-402c-bb73-714451325dc2 tempest-VolumesTestJSON-382396653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (651cd35a-1009-45c6-a9dc-0d4b54ee2767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:49:34 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-fae5c9f3-59d9-402c-bb73-714451325dc2 tempest-VolumesTestJSON-382396653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (651cd35a-1009-45c6-a9dc-0d4b54ee2767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:49:34 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-fae5c9f3-59d9-402c-bb73-714451325dc2 tempest-VolumesTestJSON-382396653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3a31948-d1e0-470c-bcf7-0085bc786339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:49:34 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-fae5c9f3-59d9-402c-bb73-714451325dc2 tempest-VolumesTestJSON-382396653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3a31948-d1e0-470c-bcf7-0085bc786339) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac9e2dc8-512a-45b7-bd3d-6d39bfc103bd', 'volume_name': 'volume-ac9e2dc8-512a-45b7-bd3d-6d39bfc103bd', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:49:34 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-fae5c9f3-59d9-402c-bb73-714451325dc2 tempest-VolumesTestJSON-382396653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (103c1090-1ba4-40cd-874a-480811d2d8df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:49:34 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-fae5c9f3-59d9-402c-bb73-714451325dc2 tempest-VolumesTestJSON-382396653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (103c1090-1ba4-40cd-874a-480811d2d8df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:49:34 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-fae5c9f3-59d9-402c-bb73-714451325dc2 tempest-VolumesTestJSON-382396653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (094a6851-50f7-4c22-8983-214f032324e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:49:34 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-fae5c9f3-59d9-402c-bb73-714451325dc2 tempest-VolumesTestJSON-382396653 None] Volume ac9e2dc8-512a-45b7-bd3d-6d39bfc103bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac9e2dc8-512a-45b7-bd3d-6d39bfc103bd', 'volume_size': 1}
Jun 15 15:49:34 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-fae5c9f3-59d9-402c-bb73-714451325dc2 tempest-VolumesTestJSON-382396653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:49:34 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-fae5c9f3-59d9-402c-bb73-714451325dc2 tempest-VolumesTestJSON-382396653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:49:34 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-fae5c9f3-59d9-402c-bb73-714451325dc2 tempest-VolumesTestJSON-382396653 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:49:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-692635102',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac9e2dc8-512a-45b7-bd3d-6d39bfc103bd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9b0507c21822426286fa55ba8b70db73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:49:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:49:35Z,use_quota=True,user_id='cc9e7d4b787a42f7b778ba7c5208aab1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 15:49:34 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-fae5c9f3-59d9-402c-bb73-714451325dc2 tempest-VolumesTestJSON-382396653 None] Creating volume ac9e2dc8-512a-45b7-bd3d-6d39bfc103bd {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 15:49:34 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-fae5c9f3-59d9-402c-bb73-714451325dc2 tempest-VolumesTestJSON-382396653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:49:34 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-fae5c9f3-59d9-402c-bb73-714451325dc2 tempest-VolumesTestJSON-382396653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:49:34 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-fae5c9f3-59d9-402c-bb73-714451325dc2 tempest-VolumesTestJSON-382396653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:49:34 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-fae5c9f3-59d9-402c-bb73-714451325dc2 tempest-VolumesTestJSON-382396653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:49:34 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-fae5c9f3-59d9-402c-bb73-714451325dc2 tempest-VolumesTestJSON-382396653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:49:34 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-fae5c9f3-59d9-402c-bb73-714451325dc2 tempest-VolumesTestJSON-382396653 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 15:49:34 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-fae5c9f3-59d9-402c-bb73-714451325dc2 tempest-VolumesTestJSON-382396653 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 15:49:34 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-fae5c9f3-59d9-402c-bb73-714451325dc2 tempest-VolumesTestJSON-382396653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-ac9e2dc8-512a-45b7-bd3d-6d39bfc103bd 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:49:34 devstack sudo[94323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-ac9e2dc8-512a-45b7-bd3d-6d39bfc103bd 1073741824
Jun 15 15:49:34 devstack sudo[94323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:49:35 devstack sudo[94323]: pam_unix(sudo:session): session closed for user root
Jun 15 15:49:35 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-fae5c9f3-59d9-402c-bb73-714451325dc2 tempest-VolumesTestJSON-382396653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-ac9e2dc8-512a-45b7-bd3d-6d39bfc103bd 1073741824" returned: 0 in 0.946s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:49:35 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-fae5c9f3-59d9-402c-bb73-714451325dc2 tempest-VolumesTestJSON-382396653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-ac9e2dc8-512a-45b7-bd3d-6d39bfc103bd {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:49:35 devstack sudo[94355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-ac9e2dc8-512a-45b7-bd3d-6d39bfc103bd
Jun 15 15:49:35 devstack sudo[94355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:49:36 devstack sudo[94355]: pam_unix(sudo:session): session closed for user root
Jun 15 15:49:36 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-fae5c9f3-59d9-402c-bb73-714451325dc2 tempest-VolumesTestJSON-382396653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-ac9e2dc8-512a-45b7-bd3d-6d39bfc103bd" returned: 0 in 0.841s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:49:36 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-fae5c9f3-59d9-402c-bb73-714451325dc2 tempest-VolumesTestJSON-382396653 None] <== create_volume: return (1833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 15:49:36 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-fae5c9f3-59d9-402c-bb73-714451325dc2 tempest-VolumesTestJSON-382396653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.836s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:49:36 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-fae5c9f3-59d9-402c-bb73-714451325dc2 tempest-VolumesTestJSON-382396653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (094a6851-50f7-4c22-8983-214f032324e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac9e2dc8-512a-45b7-bd3d-6d39bfc103bd', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:49:36 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-fae5c9f3-59d9-402c-bb73-714451325dc2 tempest-VolumesTestJSON-382396653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f6db601-d42b-4233-828c-9320381d1304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:49:36 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-fae5c9f3-59d9-402c-bb73-714451325dc2 tempest-VolumesTestJSON-382396653 None] Volume volume-ac9e2dc8-512a-45b7-bd3d-6d39bfc103bd (ac9e2dc8-512a-45b7-bd3d-6d39bfc103bd): created successfully
Jun 15 15:49:36 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-fae5c9f3-59d9-402c-bb73-714451325dc2 tempest-VolumesTestJSON-382396653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f6db601-d42b-4233-828c-9320381d1304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:49:36 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-fae5c9f3-59d9-402c-bb73-714451325dc2 tempest-VolumesTestJSON-382396653 None] Flow 'volume_create_manager' (eae21413-5bb2-4bfa-9f2c-c0a2fa93ad4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:49:36 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-fae5c9f3-59d9-402c-bb73-714451325dc2 tempest-VolumesTestJSON-382396653 None] Created volume successfully.
Jun 15 15:49:36 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [req-78a53d5a-815e-4a81-bb67-8f997704b234 req-f56f1d2c-627f-43a5-b0c6-00c8684f4159 tempest-TaggedAttachmentsTest-1059968385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:49:36 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [req-78a53d5a-815e-4a81-bb67-8f997704b234 req-f56f1d2c-627f-43a5-b0c6-00c8684f4159 tempest-TaggedAttachmentsTest-1059968385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:49:36 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd8072cb-dfe3-4023-bdd2-ed34e8ba4d10]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:49:36 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-78a53d5a-815e-4a81-bb67-8f997704b234 req-f56f1d2c-627f-43a5-b0c6-00c8684f4159 tempest-TaggedAttachmentsTest-1059968385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-278ebdee-3395-4459-acee-cd6e2232f939 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:49:37 devstack sudo[94369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-278ebdee-3395-4459-acee-cd6e2232f939
Jun 15 15:49:37 devstack sudo[94369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:49:37 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1a4e3ba-067f-45d1-a615-a2f067897ed6 tempest-VolumesTestJSON-382396653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 15:49:37 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-c1a4e3ba-067f-45d1-a615-a2f067897ed6 tempest-VolumesTestJSON-382396653 None] Flow 'volume_create_manager' (e3186495-21b9-4cb6-9092-458e9dbb24f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:49:37 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-c1a4e3ba-067f-45d1-a615-a2f067897ed6 tempest-VolumesTestJSON-382396653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (551dda73-9b19-43af-b8d1-42a0dd1be468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:49:37 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-c1a4e3ba-067f-45d1-a615-a2f067897ed6 tempest-VolumesTestJSON-382396653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (551dda73-9b19-43af-b8d1-42a0dd1be468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:49:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-613420761',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8b55d86-2645-47af-977a-4d92f2192666,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9b0507c21822426286fa55ba8b70db73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:49:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:49:37Z,use_quota=True,user_id='cc9e7d4b787a42f7b778ba7c5208aab1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:49:37 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-c1a4e3ba-067f-45d1-a615-a2f067897ed6 tempest-VolumesTestJSON-382396653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5124e8fc-5fb3-42b7-bd52-c81f3605dbe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:49:37 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-c1a4e3ba-067f-45d1-a615-a2f067897ed6 tempest-VolumesTestJSON-382396653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5124e8fc-5fb3-42b7-bd52-c81f3605dbe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:49:37 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-c1a4e3ba-067f-45d1-a615-a2f067897ed6 tempest-VolumesTestJSON-382396653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (813fe34d-6584-4469-8787-5a36690ccace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:49:37 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-c1a4e3ba-067f-45d1-a615-a2f067897ed6 tempest-VolumesTestJSON-382396653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (813fe34d-6584-4469-8787-5a36690ccace) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8b55d86-2645-47af-977a-4d92f2192666', 'volume_name': 'volume-d8b55d86-2645-47af-977a-4d92f2192666', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:49:37 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-c1a4e3ba-067f-45d1-a615-a2f067897ed6 tempest-VolumesTestJSON-382396653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (766a6a8b-b7f3-41dc-b8bc-1fe4de2b1100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:49:37 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-c1a4e3ba-067f-45d1-a615-a2f067897ed6 tempest-VolumesTestJSON-382396653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (766a6a8b-b7f3-41dc-b8bc-1fe4de2b1100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:49:37 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-c1a4e3ba-067f-45d1-a615-a2f067897ed6 tempest-VolumesTestJSON-382396653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ffde09a-7034-4b51-a212-87da1fd3f6ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:49:37 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-c1a4e3ba-067f-45d1-a615-a2f067897ed6 tempest-VolumesTestJSON-382396653 None] Volume d8b55d86-2645-47af-977a-4d92f2192666: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8b55d86-2645-47af-977a-4d92f2192666', 'volume_size': 1}
Jun 15 15:49:37 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-c1a4e3ba-067f-45d1-a615-a2f067897ed6 tempest-VolumesTestJSON-382396653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:49:37 devstack cinder-volume[91863]: INFO cinder.volume.manager [req-c9f3a6c8-ff40-4120-a21b-665c7220fdd9 req-620417fd-bea5-4e75-9bb8-b55ed539ebf5 tempest-DeleteServersTestJSON-434425613 None] Terminate volume connection completed successfully.
Jun 15 15:49:37 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [req-c9f3a6c8-ff40-4120-a21b-665c7220fdd9 req-620417fd-bea5-4e75-9bb8-b55ed539ebf5 tempest-DeleteServersTestJSON-434425613 None] Deleting attachment 5b5bc274-e99c-4229-a6d1-696bdfb2ede6. {{(pid=91863) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 15 15:49:37 devstack sudo[94369]: pam_unix(sudo:session): session closed for user root
Jun 15 15:49:37 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-78a53d5a-815e-4a81-bb67-8f997704b234 req-f56f1d2c-627f-43a5-b0c6-00c8684f4159 tempest-TaggedAttachmentsTest-1059968385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-278ebdee-3395-4459-acee-cd6e2232f939" returned: 0 in 0.809s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:49:37 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [req-78a53d5a-815e-4a81-bb67-8f997704b234 req-f56f1d2c-627f-43a5-b0c6-00c8684f4159 tempest-TaggedAttachmentsTest-1059968385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.829s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:49:37 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-c1a4e3ba-067f-45d1-a615-a2f067897ed6 tempest-VolumesTestJSON-382396653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.288s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:49:37 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-c1a4e3ba-067f-45d1-a615-a2f067897ed6 tempest-VolumesTestJSON-382396653 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:49:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-613420761',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8b55d86-2645-47af-977a-4d92f2192666,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9b0507c21822426286fa55ba8b70db73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:49:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:49:37Z,use_quota=True,user_id='cc9e7d4b787a42f7b778ba7c5208aab1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 15:49:37 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-c1a4e3ba-067f-45d1-a615-a2f067897ed6 tempest-VolumesTestJSON-382396653 None] Creating volume d8b55d86-2645-47af-977a-4d92f2192666 {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 15:49:37 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-c1a4e3ba-067f-45d1-a615-a2f067897ed6 tempest-VolumesTestJSON-382396653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:49:37 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-c1a4e3ba-067f-45d1-a615-a2f067897ed6 tempest-VolumesTestJSON-382396653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:49:37 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-c1a4e3ba-067f-45d1-a615-a2f067897ed6 tempest-VolumesTestJSON-382396653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:49:37 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-c1a4e3ba-067f-45d1-a615-a2f067897ed6 tempest-VolumesTestJSON-382396653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:49:37 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-c1a4e3ba-067f-45d1-a615-a2f067897ed6 tempest-VolumesTestJSON-382396653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:49:37 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-c1a4e3ba-067f-45d1-a615-a2f067897ed6 tempest-VolumesTestJSON-382396653 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 15:49:37 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-c1a4e3ba-067f-45d1-a615-a2f067897ed6 tempest-VolumesTestJSON-382396653 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 15:49:37 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c1a4e3ba-067f-45d1-a615-a2f067897ed6 tempest-VolumesTestJSON-382396653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-d8b55d86-2645-47af-977a-4d92f2192666 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:49:37 devstack sudo[94374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-d8b55d86-2645-47af-977a-4d92f2192666 1073741824
Jun 15 15:49:37 devstack sudo[94374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:49:37 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [req-78a53d5a-815e-4a81-bb67-8f997704b234 req-f56f1d2c-627f-43a5-b0c6-00c8684f4159 tempest-TaggedAttachmentsTest-1059968385 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc', 'name': 'volume-278ebdee-3395-4459-acee-cd6e2232f939', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5949f64e-410f-4c65-812e-9e8a6cbab536', 'enforce_multipath': True} {{(pid=91863) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 15 15:49:37 devstack cinder-volume[91863]: INFO cinder.volume.manager [req-78a53d5a-815e-4a81-bb67-8f997704b234 req-f56f1d2c-627f-43a5-b0c6-00c8684f4159 tempest-TaggedAttachmentsTest-1059968385 None] attachment_update completed successfully.
Jun 15 15:49:38 devstack sudo[94374]: pam_unix(sudo:session): session closed for user root
Jun 15 15:49:38 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c1a4e3ba-067f-45d1-a615-a2f067897ed6 tempest-VolumesTestJSON-382396653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-d8b55d86-2645-47af-977a-4d92f2192666 1073741824" returned: 0 in 0.833s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:49:38 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c1a4e3ba-067f-45d1-a615-a2f067897ed6 tempest-VolumesTestJSON-382396653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-d8b55d86-2645-47af-977a-4d92f2192666 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:49:38 devstack sudo[94446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-d8b55d86-2645-47af-977a-4d92f2192666
Jun 15 15:49:38 devstack sudo[94446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:49:39 devstack sudo[94446]: pam_unix(sudo:session): session closed for user root
Jun 15 15:49:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c1a4e3ba-067f-45d1-a615-a2f067897ed6 tempest-VolumesTestJSON-382396653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-d8b55d86-2645-47af-977a-4d92f2192666" returned: 0 in 0.713s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:49:39 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-c1a4e3ba-067f-45d1-a615-a2f067897ed6 tempest-VolumesTestJSON-382396653 None] <== create_volume: return (1580ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 15:49:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-c1a4e3ba-067f-45d1-a615-a2f067897ed6 tempest-VolumesTestJSON-382396653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.583s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:49:39 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-c1a4e3ba-067f-45d1-a615-a2f067897ed6 tempest-VolumesTestJSON-382396653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ffde09a-7034-4b51-a212-87da1fd3f6ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8b55d86-2645-47af-977a-4d92f2192666', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:49:39 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-c1a4e3ba-067f-45d1-a615-a2f067897ed6 tempest-VolumesTestJSON-382396653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc0fc1db-378d-460c-92e0-51719f7cf9a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:49:39 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-c1a4e3ba-067f-45d1-a615-a2f067897ed6 tempest-VolumesTestJSON-382396653 None] Volume volume-d8b55d86-2645-47af-977a-4d92f2192666 (d8b55d86-2645-47af-977a-4d92f2192666): created successfully
Jun 15 15:49:39 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-c1a4e3ba-067f-45d1-a615-a2f067897ed6 tempest-VolumesTestJSON-382396653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc0fc1db-378d-460c-92e0-51719f7cf9a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:49:39 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-c1a4e3ba-067f-45d1-a615-a2f067897ed6 tempest-VolumesTestJSON-382396653 None] Flow 'volume_create_manager' (e3186495-21b9-4cb6-9092-458e9dbb24f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:49:39 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-c1a4e3ba-067f-45d1-a615-a2f067897ed6 tempest-VolumesTestJSON-382396653 None] Created volume successfully.
Jun 15 15:49:41 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-19845450-d0fa-44d1-a8c4-85c61043a227 tempest-DeleteServersTestJSON-434425613 None] Acquiring lock "cinder-25c214f9-76c5-4ca3-8835-aad4a4a8397a-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:49:41 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-19845450-d0fa-44d1-a8c4-85c61043a227 tempest-DeleteServersTestJSON-434425613 None] Lock "cinder-25c214f9-76c5-4ca3-8835-aad4a4a8397a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:49:41 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-de4ed50e-2e7f-460f-a941-c6e9bbb9df3f tempest-VolumesTestJSON-382396653 None] Acquiring lock "cinder-d8b55d86-2645-47af-977a-4d92f2192666-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:49:41 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-de4ed50e-2e7f-460f-a941-c6e9bbb9df3f tempest-VolumesTestJSON-382396653 None] Lock "cinder-d8b55d86-2645-47af-977a-4d92f2192666-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:49:41 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-19845450-d0fa-44d1-a8c4-85c61043a227 tempest-DeleteServersTestJSON-434425613 None] Acquiring lock "cinder-quobyte-25c214f9-76c5-4ca3-8835-aad4a4a8397a" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:49:41 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-19845450-d0fa-44d1-a8c4-85c61043a227 tempest-DeleteServersTestJSON-434425613 None] Lock "cinder-quobyte-25c214f9-76c5-4ca3-8835-aad4a4a8397a" acquired by "delete_volume" :: waited 0.024s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:49:41 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-de4ed50e-2e7f-460f-a941-c6e9bbb9df3f tempest-VolumesTestJSON-382396653 None] Acquiring lock "cinder-quobyte-d8b55d86-2645-47af-977a-4d92f2192666" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:49:41 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b19f0ca-602e-4107-9fb4-acef69a9e944]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:49:41 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-19845450-d0fa-44d1-a8c4-85c61043a227 tempest-DeleteServersTestJSON-434425613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-25c214f9-76c5-4ca3-8835-aad4a4a8397a {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:49:41 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-de4ed50e-2e7f-460f-a941-c6e9bbb9df3f tempest-VolumesTestJSON-382396653 None] Lock "cinder-quobyte-d8b55d86-2645-47af-977a-4d92f2192666" acquired by "delete_volume" :: waited 0.024s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:49:41 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[18016f5e-fea6-4458-afe7-ad859588e44c]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:49:41 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-de4ed50e-2e7f-460f-a941-c6e9bbb9df3f tempest-VolumesTestJSON-382396653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-d8b55d86-2645-47af-977a-4d92f2192666 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:49:41 devstack sudo[94765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-25c214f9-76c5-4ca3-8835-aad4a4a8397a
Jun 15 15:49:41 devstack sudo[94765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:49:42 devstack sudo[94766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-d8b55d86-2645-47af-977a-4d92f2192666
Jun 15 15:49:42 devstack sudo[94766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:49:42 devstack sudo[94765]: pam_unix(sudo:session): session closed for user root
Jun 15 15:49:42 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-19845450-d0fa-44d1-a8c4-85c61043a227 tempest-DeleteServersTestJSON-434425613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-25c214f9-76c5-4ca3-8835-aad4a4a8397a" returned: 0 in 0.819s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:49:42 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-19845450-d0fa-44d1-a8c4-85c61043a227 tempest-DeleteServersTestJSON-434425613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-25c214f9-76c5-4ca3-8835-aad4a4a8397a {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:49:42 devstack sudo[94778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-25c214f9-76c5-4ca3-8835-aad4a4a8397a
Jun 15 15:49:42 devstack sudo[94778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:49:42 devstack sudo[94766]: pam_unix(sudo:session): session closed for user root
Jun 15 15:49:42 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-de4ed50e-2e7f-460f-a941-c6e9bbb9df3f tempest-VolumesTestJSON-382396653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-d8b55d86-2645-47af-977a-4d92f2192666" returned: 0 in 0.915s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:49:42 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-de4ed50e-2e7f-460f-a941-c6e9bbb9df3f tempest-VolumesTestJSON-382396653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-d8b55d86-2645-47af-977a-4d92f2192666 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:49:42 devstack sudo[94781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-d8b55d86-2645-47af-977a-4d92f2192666
Jun 15 15:49:42 devstack sudo[94781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:49:43 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-19845450-d0fa-44d1-a8c4-85c61043a227 tempest-DeleteServersTestJSON-434425613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-25c214f9-76c5-4ca3-8835-aad4a4a8397a" returned: 0 in 0.790s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:49:43 devstack sudo[94778]: pam_unix(sudo:session): session closed for user root
Jun 15 15:49:43 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-19845450-d0fa-44d1-a8c4-85c61043a227 tempest-DeleteServersTestJSON-434425613 None] Lock "cinder-quobyte-25c214f9-76c5-4ca3-8835-aad4a4a8397a" released by "delete_volume" :: held 1.687s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:49:43 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-19845450-d0fa-44d1-a8c4-85c61043a227 tempest-DeleteServersTestJSON-434425613 None] Created reservations ['33926ef8-ae47-421d-8af7-da4860f97b0a', '876e6463-6f64-4300-b3d9-6f9037a59b7c', '78ac53ec-0a58-4526-9dd3-49a0a1618380', '86e39c05-d3d3-4068-8a1c-047063f0b074'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:49:43 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-19845450-d0fa-44d1-a8c4-85c61043a227 tempest-DeleteServersTestJSON-434425613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:49:43 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-19845450-d0fa-44d1-a8c4-85c61043a227 tempest-DeleteServersTestJSON-434425613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:49:43 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-19845450-d0fa-44d1-a8c4-85c61043a227 tempest-DeleteServersTestJSON-434425613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:49:43 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-19845450-d0fa-44d1-a8c4-85c61043a227 tempest-DeleteServersTestJSON-434425613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:49:43 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-19845450-d0fa-44d1-a8c4-85c61043a227 tempest-DeleteServersTestJSON-434425613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:49:43 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-19845450-d0fa-44d1-a8c4-85c61043a227 tempest-DeleteServersTestJSON-434425613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:49:43 devstack sudo[94785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:49:43 devstack sudo[94785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:49:43 devstack sudo[94781]: pam_unix(sudo:session): session closed for user root
Jun 15 15:49:43 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-de4ed50e-2e7f-460f-a941-c6e9bbb9df3f tempest-VolumesTestJSON-382396653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-d8b55d86-2645-47af-977a-4d92f2192666" returned: 0 in 0.907s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:49:43 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-de4ed50e-2e7f-460f-a941-c6e9bbb9df3f tempest-VolumesTestJSON-382396653 None] Lock "cinder-quobyte-d8b55d86-2645-47af-977a-4d92f2192666" released by "delete_volume" :: held 1.882s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:49:43 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-de4ed50e-2e7f-460f-a941-c6e9bbb9df3f tempest-VolumesTestJSON-382396653 None] Created reservations ['5640d0ce-6ce1-47b1-85d4-744d84e4161b', 'edf6b13e-94b7-4463-a7a5-8db218bb0e26', '1905adce-0be1-479a-8136-b2e4bd8ee51f', 'a1e4ba6e-9dca-4ff9-a853-f0fee6a5e66d'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:49:43 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-de4ed50e-2e7f-460f-a941-c6e9bbb9df3f tempest-VolumesTestJSON-382396653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:49:43 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-de4ed50e-2e7f-460f-a941-c6e9bbb9df3f tempest-VolumesTestJSON-382396653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:49:43 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-de4ed50e-2e7f-460f-a941-c6e9bbb9df3f tempest-VolumesTestJSON-382396653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:49:43 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-de4ed50e-2e7f-460f-a941-c6e9bbb9df3f tempest-VolumesTestJSON-382396653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:49:43 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-de4ed50e-2e7f-460f-a941-c6e9bbb9df3f tempest-VolumesTestJSON-382396653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:49:43 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-de4ed50e-2e7f-460f-a941-c6e9bbb9df3f tempest-VolumesTestJSON-382396653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:49:43 devstack sudo[94788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:49:43 devstack sudo[94788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:49:44 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-47597818-a435-4422-a5ba-0e154603fc53 tempest-VolumesTestJSON-382396653 None] Acquiring lock "cinder-ac9e2dc8-512a-45b7-bd3d-6d39bfc103bd-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:49:44 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-47597818-a435-4422-a5ba-0e154603fc53 tempest-VolumesTestJSON-382396653 None] Lock "cinder-ac9e2dc8-512a-45b7-bd3d-6d39bfc103bd-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:49:44 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-47597818-a435-4422-a5ba-0e154603fc53 tempest-VolumesTestJSON-382396653 None] Acquiring lock "cinder-quobyte-ac9e2dc8-512a-45b7-bd3d-6d39bfc103bd" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:49:44 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-47597818-a435-4422-a5ba-0e154603fc53 tempest-VolumesTestJSON-382396653 None] Lock "cinder-quobyte-ac9e2dc8-512a-45b7-bd3d-6d39bfc103bd" acquired by "delete_volume" :: waited 0.018s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:49:44 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e694c8a-e697-4a44-b112-666534520a9e]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:49:44 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-47597818-a435-4422-a5ba-0e154603fc53 tempest-VolumesTestJSON-382396653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-ac9e2dc8-512a-45b7-bd3d-6d39bfc103bd {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:49:44 devstack sudo[94790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-ac9e2dc8-512a-45b7-bd3d-6d39bfc103bd
Jun 15 15:49:44 devstack sudo[94790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:49:44 devstack sudo[94785]: pam_unix(sudo:session): session closed for user root
Jun 15 15:49:44 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-19845450-d0fa-44d1-a8c4-85c61043a227 tempest-DeleteServersTestJSON-434425613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.990s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:49:44 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-19845450-d0fa-44d1-a8c4-85c61043a227 tempest-DeleteServersTestJSON-434425613 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:49:44 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-19845450-d0fa-44d1-a8c4-85c61043a227 tempest-DeleteServersTestJSON-434425613 None] Deleted volume successfully.
Jun 15 15:49:44 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-19845450-d0fa-44d1-a8c4-85c61043a227 tempest-DeleteServersTestJSON-434425613 None] Lock "cinder-25c214f9-76c5-4ca3-8835-aad4a4a8397a-delete_volume" released by "delete_volume" :: held 3.005s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:49:44 devstack sudo[94788]: pam_unix(sudo:session): session closed for user root
Jun 15 15:49:44 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-de4ed50e-2e7f-460f-a941-c6e9bbb9df3f tempest-VolumesTestJSON-382396653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.854s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:49:44 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-de4ed50e-2e7f-460f-a941-c6e9bbb9df3f tempest-VolumesTestJSON-382396653 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:49:44 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-de4ed50e-2e7f-460f-a941-c6e9bbb9df3f tempest-VolumesTestJSON-382396653 None] Deleted volume successfully.
Jun 15 15:49:44 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-de4ed50e-2e7f-460f-a941-c6e9bbb9df3f tempest-VolumesTestJSON-382396653 None] Lock "cinder-d8b55d86-2645-47af-977a-4d92f2192666-delete_volume" released by "delete_volume" :: held 3.018s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:49:45 devstack cinder-volume[91863]: INFO cinder.volume.manager [req-637363d2-375c-40e6-b75b-4dd24ec0c25e req-e03e5e59-40ac-4f83-ab89-b5afffd6a6f1 tempest-TaggedAttachmentsTest-1059968385 None] Terminate volume connection completed successfully.
Jun 15 15:49:45 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [req-637363d2-375c-40e6-b75b-4dd24ec0c25e req-e03e5e59-40ac-4f83-ab89-b5afffd6a6f1 tempest-TaggedAttachmentsTest-1059968385 None] Deleting attachment 5949f64e-410f-4c65-812e-9e8a6cbab536. {{(pid=91863) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 15 15:49:45 devstack sudo[94790]: pam_unix(sudo:session): session closed for user root
Jun 15 15:49:45 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-47597818-a435-4422-a5ba-0e154603fc53 tempest-VolumesTestJSON-382396653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-ac9e2dc8-512a-45b7-bd3d-6d39bfc103bd" returned: 0 in 0.976s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:49:45 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-47597818-a435-4422-a5ba-0e154603fc53 tempest-VolumesTestJSON-382396653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-ac9e2dc8-512a-45b7-bd3d-6d39bfc103bd {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:49:45 devstack sudo[94825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-ac9e2dc8-512a-45b7-bd3d-6d39bfc103bd
Jun 15 15:49:45 devstack sudo[94825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:49:45 devstack sudo[94825]: pam_unix(sudo:session): session closed for user root
Jun 15 15:49:45 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-47597818-a435-4422-a5ba-0e154603fc53 tempest-VolumesTestJSON-382396653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-ac9e2dc8-512a-45b7-bd3d-6d39bfc103bd" returned: 0 in 0.805s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:49:46 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-47597818-a435-4422-a5ba-0e154603fc53 tempest-VolumesTestJSON-382396653 None] Lock "cinder-quobyte-ac9e2dc8-512a-45b7-bd3d-6d39bfc103bd" released by "delete_volume" :: held 1.852s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:49:46 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-47597818-a435-4422-a5ba-0e154603fc53 tempest-VolumesTestJSON-382396653 None] Created reservations ['bc751175-0f49-453a-b07e-2528876add55', 'ffa60b8d-a384-42a7-a10f-5b98b67748e7', 'e3375927-de64-4812-8b77-d993e7db1f06', 'c74711e1-b42f-4bf4-bcd0-417a11a04feb'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:49:46 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-47597818-a435-4422-a5ba-0e154603fc53 tempest-VolumesTestJSON-382396653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:49:46 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-47597818-a435-4422-a5ba-0e154603fc53 tempest-VolumesTestJSON-382396653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:49:46 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-47597818-a435-4422-a5ba-0e154603fc53 tempest-VolumesTestJSON-382396653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:49:46 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-47597818-a435-4422-a5ba-0e154603fc53 tempest-VolumesTestJSON-382396653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:49:46 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-47597818-a435-4422-a5ba-0e154603fc53 tempest-VolumesTestJSON-382396653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:49:46 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-47597818-a435-4422-a5ba-0e154603fc53 tempest-VolumesTestJSON-382396653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:49:46 devstack sudo[94828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:49:46 devstack sudo[94828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:49:46 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-7929ffe7-7454-4804-9375-b9f4b8a13bf6 tempest-VolumesTestJSON-382396653 None] Acquiring lock "cinder-48d6a1fd-3959-483a-8700-9fd55262b186-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:49:46 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-7929ffe7-7454-4804-9375-b9f4b8a13bf6 tempest-VolumesTestJSON-382396653 None] Lock "cinder-48d6a1fd-3959-483a-8700-9fd55262b186-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:49:46 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-7929ffe7-7454-4804-9375-b9f4b8a13bf6 tempest-VolumesTestJSON-382396653 None] Acquiring lock "cinder-quobyte-48d6a1fd-3959-483a-8700-9fd55262b186" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:49:46 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-7929ffe7-7454-4804-9375-b9f4b8a13bf6 tempest-VolumesTestJSON-382396653 None] Lock "cinder-quobyte-48d6a1fd-3959-483a-8700-9fd55262b186" acquired by "delete_volume" :: waited 0.022s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:49:46 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b0838a-ad8f-4a26-946b-5a7f56c027f1]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:49:46 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-7929ffe7-7454-4804-9375-b9f4b8a13bf6 tempest-VolumesTestJSON-382396653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-48d6a1fd-3959-483a-8700-9fd55262b186 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:49:46 devstack sudo[94831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-48d6a1fd-3959-483a-8700-9fd55262b186
Jun 15 15:49:46 devstack sudo[94831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:49:47 devstack sudo[94828]: pam_unix(sudo:session): session closed for user root
Jun 15 15:49:47 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-47597818-a435-4422-a5ba-0e154603fc53 tempest-VolumesTestJSON-382396653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.857s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:49:47 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-47597818-a435-4422-a5ba-0e154603fc53 tempest-VolumesTestJSON-382396653 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:49:47 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-47597818-a435-4422-a5ba-0e154603fc53 tempest-VolumesTestJSON-382396653 None] Deleted volume successfully.
Jun 15 15:49:47 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-47597818-a435-4422-a5ba-0e154603fc53 tempest-VolumesTestJSON-382396653 None] Lock "cinder-ac9e2dc8-512a-45b7-bd3d-6d39bfc103bd-delete_volume" released by "delete_volume" :: held 3.079s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:49:47 devstack sudo[94831]: pam_unix(sudo:session): session closed for user root
Jun 15 15:49:47 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-7929ffe7-7454-4804-9375-b9f4b8a13bf6 tempest-VolumesTestJSON-382396653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-48d6a1fd-3959-483a-8700-9fd55262b186" returned: 0 in 0.986s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:49:47 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-7929ffe7-7454-4804-9375-b9f4b8a13bf6 tempest-VolumesTestJSON-382396653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-48d6a1fd-3959-483a-8700-9fd55262b186 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:49:47 devstack sudo[94840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-48d6a1fd-3959-483a-8700-9fd55262b186
Jun 15 15:49:47 devstack sudo[94840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:49:48 devstack sudo[94840]: pam_unix(sudo:session): session closed for user root
Jun 15 15:49:48 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-7929ffe7-7454-4804-9375-b9f4b8a13bf6 tempest-VolumesTestJSON-382396653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-48d6a1fd-3959-483a-8700-9fd55262b186" returned: 0 in 0.763s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:49:48 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-7929ffe7-7454-4804-9375-b9f4b8a13bf6 tempest-VolumesTestJSON-382396653 None] Lock "cinder-quobyte-48d6a1fd-3959-483a-8700-9fd55262b186" released by "delete_volume" :: held 1.828s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:49:48 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-7929ffe7-7454-4804-9375-b9f4b8a13bf6 tempest-VolumesTestJSON-382396653 None] Created reservations ['0c6b2386-375a-450c-af45-4b555f704fcc', 'b68e7bd8-30ed-48d3-bc43-d25a78dc4d72', '67825be4-6a6e-48a6-8cc9-490d53227d5c', 'ed87186a-b259-42a4-bb86-3ffb9b9c3677'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:49:48 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-7929ffe7-7454-4804-9375-b9f4b8a13bf6 tempest-VolumesTestJSON-382396653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:49:48 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-7929ffe7-7454-4804-9375-b9f4b8a13bf6 tempest-VolumesTestJSON-382396653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:49:48 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-7929ffe7-7454-4804-9375-b9f4b8a13bf6 tempest-VolumesTestJSON-382396653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:49:48 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-7929ffe7-7454-4804-9375-b9f4b8a13bf6 tempest-VolumesTestJSON-382396653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:49:48 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-7929ffe7-7454-4804-9375-b9f4b8a13bf6 tempest-VolumesTestJSON-382396653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:49:48 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-7929ffe7-7454-4804-9375-b9f4b8a13bf6 tempest-VolumesTestJSON-382396653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:49:48 devstack sudo[94860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:49:48 devstack sudo[94860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:49:49 devstack sudo[94860]: pam_unix(sudo:session): session closed for user root
Jun 15 15:49:49 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-7929ffe7-7454-4804-9375-b9f4b8a13bf6 tempest-VolumesTestJSON-382396653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.955s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:49:49 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-7929ffe7-7454-4804-9375-b9f4b8a13bf6 tempest-VolumesTestJSON-382396653 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:49:49 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-7929ffe7-7454-4804-9375-b9f4b8a13bf6 tempest-VolumesTestJSON-382396653 None] Deleted volume successfully.
Jun 15 15:49:49 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-7929ffe7-7454-4804-9375-b9f4b8a13bf6 tempest-VolumesTestJSON-382396653 None] Lock "cinder-48d6a1fd-3959-483a-8700-9fd55262b186-delete_volume" released by "delete_volume" :: held 3.056s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:49:58 devstack cinder-volume[91863]: DEBUG dbcounter [-] [91863] Writing DB stats cinder:SELECT=45,cinder:UPDATE=56,cinder:INSERT=14,cinder:DELETE=4 {{(pid=91863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 15:49:58 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-e3768345-8e07-4ac2-b22e-372c0aa9903c tempest-GroupsTest-1922190928 None] Group tempest-Group1-979605136: creating
Jun 15 15:49:58 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-e3768345-8e07-4ac2-b22e-372c0aa9903c tempest-GroupsTest-1922190928 None] Group tempest-Group1-979605136: created successfully
Jun 15 15:49:58 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-e3768345-8e07-4ac2-b22e-372c0aa9903c tempest-GroupsTest-1922190928 None] Create group completed successfully.
Jun 15 15:49:59 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-534fdc11-6366-4edc-993c-145ab05a7db5 tempest-GroupsTest-1922190928 None] Group tempest-Group2-1358077655: creating
Jun 15 15:49:59 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-534fdc11-6366-4edc-993c-145ab05a7db5 tempest-GroupsTest-1922190928 None] Group tempest-Group2-1358077655: created successfully
Jun 15 15:49:59 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-534fdc11-6366-4edc-993c-145ab05a7db5 tempest-GroupsTest-1922190928 None] Create group completed successfully.
Jun 15 15:50:01 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-62feb122-a43d-40d6-89bf-f4c5b2179a58 tempest-GroupsTest-1922190928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 15:50:01 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-62feb122-a43d-40d6-89bf-f4c5b2179a58 tempest-GroupsTest-1922190928 None] Flow 'volume_create_manager' (771d9540-6ec1-456f-b990-290b3114e820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:50:01 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-62feb122-a43d-40d6-89bf-f4c5b2179a58 tempest-GroupsTest-1922190928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (deb8c082-27f7-45b1-a1ff-2b2c5b87c747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:50:01 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-62feb122-a43d-40d6-89bf-f4c5b2179a58 tempest-GroupsTest-1922190928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (deb8c082-27f7-45b1-a1ff-2b2c5b87c747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:50:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-695217159',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=3f2648b1-4431-4760-97a3-b968d73be0e2,host='devstack@QuobyteHD#QuobyteHD',id=d5db4775-6f28-4101-a59c-d8a383027f22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b4a8638e7ca482eb8651093f2df6eb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:50:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:50:02Z,use_quota=True,user_id='adae6d3d352847ae835d93892c424ce4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8a3aefa-d49a-4a0d-b0b7-08d8a69a0f66),volume_type_id=b8a3aefa-d49a-4a0d-b0b7-08d8a69a0f66)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:50:01 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-62feb122-a43d-40d6-89bf-f4c5b2179a58 tempest-GroupsTest-1922190928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b31bdfb-97b6-4fa6-bb87-a7c5d17e4bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:50:01 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-62feb122-a43d-40d6-89bf-f4c5b2179a58 tempest-GroupsTest-1922190928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b31bdfb-97b6-4fa6-bb87-a7c5d17e4bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:50:01 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-62feb122-a43d-40d6-89bf-f4c5b2179a58 tempest-GroupsTest-1922190928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74ffdf99-6858-41d6-89cc-fdaf3df5b669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:50:01 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-62feb122-a43d-40d6-89bf-f4c5b2179a58 tempest-GroupsTest-1922190928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74ffdf99-6858-41d6-89cc-fdaf3df5b669) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5db4775-6f28-4101-a59c-d8a383027f22', 'volume_name': 'volume-d5db4775-6f28-4101-a59c-d8a383027f22', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:50:01 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-62feb122-a43d-40d6-89bf-f4c5b2179a58 tempest-GroupsTest-1922190928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72e64abc-9557-4187-8bf8-b2dc9eb5daec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:50:01 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-62feb122-a43d-40d6-89bf-f4c5b2179a58 tempest-GroupsTest-1922190928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72e64abc-9557-4187-8bf8-b2dc9eb5daec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:50:01 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-62feb122-a43d-40d6-89bf-f4c5b2179a58 tempest-GroupsTest-1922190928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0304a6f-0723-42cb-8844-eba741db8fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:50:01 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-62feb122-a43d-40d6-89bf-f4c5b2179a58 tempest-GroupsTest-1922190928 None] Volume d5db4775-6f28-4101-a59c-d8a383027f22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5db4775-6f28-4101-a59c-d8a383027f22', 'volume_size': 1}
Jun 15 15:50:01 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-62feb122-a43d-40d6-89bf-f4c5b2179a58 tempest-GroupsTest-1922190928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:50:01 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-62feb122-a43d-40d6-89bf-f4c5b2179a58 tempest-GroupsTest-1922190928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:50:01 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-62feb122-a43d-40d6-89bf-f4c5b2179a58 tempest-GroupsTest-1922190928 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=3f2648b1-4431-4760-97a3-b968d73be0e2,created_at=2026-06-15T13:50:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-695217159',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=3f2648b1-4431-4760-97a3-b968d73be0e2,host='devstack@QuobyteHD#QuobyteHD',id=d5db4775-6f28-4101-a59c-d8a383027f22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b4a8638e7ca482eb8651093f2df6eb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:50:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:50:02Z,use_quota=True,user_id='adae6d3d352847ae835d93892c424ce4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8a3aefa-d49a-4a0d-b0b7-08d8a69a0f66),volume_type_id=b8a3aefa-d49a-4a0d-b0b7-08d8a69a0f66)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 15:50:01 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-62feb122-a43d-40d6-89bf-f4c5b2179a58 tempest-GroupsTest-1922190928 None] Creating volume d5db4775-6f28-4101-a59c-d8a383027f22 {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 15:50:01 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-62feb122-a43d-40d6-89bf-f4c5b2179a58 tempest-GroupsTest-1922190928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:50:01 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-62feb122-a43d-40d6-89bf-f4c5b2179a58 tempest-GroupsTest-1922190928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:50:01 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-62feb122-a43d-40d6-89bf-f4c5b2179a58 tempest-GroupsTest-1922190928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:50:01 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-62feb122-a43d-40d6-89bf-f4c5b2179a58 tempest-GroupsTest-1922190928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:50:01 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-62feb122-a43d-40d6-89bf-f4c5b2179a58 tempest-GroupsTest-1922190928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:50:01 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-62feb122-a43d-40d6-89bf-f4c5b2179a58 tempest-GroupsTest-1922190928 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 15:50:01 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-62feb122-a43d-40d6-89bf-f4c5b2179a58 tempest-GroupsTest-1922190928 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 15:50:01 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-62feb122-a43d-40d6-89bf-f4c5b2179a58 tempest-GroupsTest-1922190928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-d5db4775-6f28-4101-a59c-d8a383027f22 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:50:01 devstack sudo[94915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-d5db4775-6f28-4101-a59c-d8a383027f22 1073741824
Jun 15 15:50:01 devstack sudo[94915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:50:02 devstack sudo[94915]: pam_unix(sudo:session): session closed for user root
Jun 15 15:50:02 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-62feb122-a43d-40d6-89bf-f4c5b2179a58 tempest-GroupsTest-1922190928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-d5db4775-6f28-4101-a59c-d8a383027f22 1073741824" returned: 0 in 1.066s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:50:02 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-62feb122-a43d-40d6-89bf-f4c5b2179a58 tempest-GroupsTest-1922190928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-d5db4775-6f28-4101-a59c-d8a383027f22 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:50:02 devstack sudo[94923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-d5db4775-6f28-4101-a59c-d8a383027f22
Jun 15 15:50:02 devstack sudo[94923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:50:03 devstack sudo[94923]: pam_unix(sudo:session): session closed for user root
Jun 15 15:50:03 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-62feb122-a43d-40d6-89bf-f4c5b2179a58 tempest-GroupsTest-1922190928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-d5db4775-6f28-4101-a59c-d8a383027f22" returned: 0 in 0.657s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:50:03 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-62feb122-a43d-40d6-89bf-f4c5b2179a58 tempest-GroupsTest-1922190928 None] <== create_volume: return (1782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 15:50:03 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-62feb122-a43d-40d6-89bf-f4c5b2179a58 tempest-GroupsTest-1922190928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.786s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:50:03 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-62feb122-a43d-40d6-89bf-f4c5b2179a58 tempest-GroupsTest-1922190928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0304a6f-0723-42cb-8844-eba741db8fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5db4775-6f28-4101-a59c-d8a383027f22', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:50:03 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-62feb122-a43d-40d6-89bf-f4c5b2179a58 tempest-GroupsTest-1922190928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af9dd79f-de9d-40cb-9dab-ce55da57978f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:50:03 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-62feb122-a43d-40d6-89bf-f4c5b2179a58 tempest-GroupsTest-1922190928 None] Volume volume-d5db4775-6f28-4101-a59c-d8a383027f22 (d5db4775-6f28-4101-a59c-d8a383027f22): created successfully
Jun 15 15:50:03 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-62feb122-a43d-40d6-89bf-f4c5b2179a58 tempest-GroupsTest-1922190928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af9dd79f-de9d-40cb-9dab-ce55da57978f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:50:03 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-62feb122-a43d-40d6-89bf-f4c5b2179a58 tempest-GroupsTest-1922190928 None] Flow 'volume_create_manager' (771d9540-6ec1-456f-b990-290b3114e820) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:50:03 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-62feb122-a43d-40d6-89bf-f4c5b2179a58 tempest-GroupsTest-1922190928 None] Created volume successfully.
Jun 15 15:50:04 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-bd4b9680-bca0-4580-b604-d0f8687045e8 tempest-GroupsTest-1922190928 None] Acquiring lock "cinder-quobyte-d5db4775-6f28-4101-a59c-d8a383027f22" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:50:04 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-bd4b9680-bca0-4580-b604-d0f8687045e8 tempest-GroupsTest-1922190928 None] Lock "cinder-quobyte-d5db4775-6f28-4101-a59c-d8a383027f22" acquired by "delete_volume" :: waited 0.021s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:50:04 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e02c6284-b355-427c-9109-f83fe1d12469]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:50:04 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-bd4b9680-bca0-4580-b604-d0f8687045e8 tempest-GroupsTest-1922190928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-d5db4775-6f28-4101-a59c-d8a383027f22 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:50:04 devstack sudo[94929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-d5db4775-6f28-4101-a59c-d8a383027f22
Jun 15 15:50:04 devstack sudo[94929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:50:05 devstack sudo[94929]: pam_unix(sudo:session): session closed for user root
Jun 15 15:50:05 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-bd4b9680-bca0-4580-b604-d0f8687045e8 tempest-GroupsTest-1922190928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-d5db4775-6f28-4101-a59c-d8a383027f22" returned: 0 in 1.164s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:50:05 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-bd4b9680-bca0-4580-b604-d0f8687045e8 tempest-GroupsTest-1922190928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-d5db4775-6f28-4101-a59c-d8a383027f22 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:50:05 devstack sudo[94939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-d5db4775-6f28-4101-a59c-d8a383027f22
Jun 15 15:50:05 devstack sudo[94939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:50:06 devstack sudo[94939]: pam_unix(sudo:session): session closed for user root
Jun 15 15:50:06 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-bd4b9680-bca0-4580-b604-d0f8687045e8 tempest-GroupsTest-1922190928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-d5db4775-6f28-4101-a59c-d8a383027f22" returned: 0 in 0.699s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:50:06 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-bd4b9680-bca0-4580-b604-d0f8687045e8 tempest-GroupsTest-1922190928 None] Lock "cinder-quobyte-d5db4775-6f28-4101-a59c-d8a383027f22" released by "delete_volume" :: held 1.924s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:50:06 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-bd4b9680-bca0-4580-b604-d0f8687045e8 tempest-GroupsTest-1922190928 None] Created reservations ['72cec650-8841-44e3-94a9-6a9e67730528'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:50:06 devstack cinder-volume[91863]: WARNING cinder.quota [None req-bd4b9680-bca0-4580-b604-d0f8687045e8 tempest-GroupsTest-1922190928 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1208815828 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1208815828, it is now deprecated. Please use the default quota class for default quota.
Jun 15 15:50:06 devstack cinder-volume[91863]: WARNING cinder.quota [None req-bd4b9680-bca0-4580-b604-d0f8687045e8 tempest-GroupsTest-1922190928 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1208815828 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1208815828, it is now deprecated. Please use the default quota class for default quota.
Jun 15 15:50:06 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-bd4b9680-bca0-4580-b604-d0f8687045e8 tempest-GroupsTest-1922190928 None] Created reservations ['ca1e5f69-c767-4cfe-aace-58af09e7e8df', 'f82f2562-8901-4e35-9522-12ce45d5d3dd', '6585688b-60f4-4e3a-9d9a-4cc74f4e5234', '8a27cef9-b072-47cf-83b6-faf42d248b2c'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:50:06 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-bd4b9680-bca0-4580-b604-d0f8687045e8 tempest-GroupsTest-1922190928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:50:06 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-bd4b9680-bca0-4580-b604-d0f8687045e8 tempest-GroupsTest-1922190928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:50:06 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-bd4b9680-bca0-4580-b604-d0f8687045e8 tempest-GroupsTest-1922190928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:50:06 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-bd4b9680-bca0-4580-b604-d0f8687045e8 tempest-GroupsTest-1922190928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:50:06 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-bd4b9680-bca0-4580-b604-d0f8687045e8 tempest-GroupsTest-1922190928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:50:06 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-bd4b9680-bca0-4580-b604-d0f8687045e8 tempest-GroupsTest-1922190928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:50:06 devstack sudo[94956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:50:06 devstack sudo[94956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:50:07 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-dfbfc523-1aac-45e0-8814-1ea4be87b93f tempest-GroupsTest-1922190928 None] Created reservations ['1aad56ea-b1b7-4438-b2ac-8026e54d9748'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:50:07 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-dfbfc523-1aac-45e0-8814-1ea4be87b93f tempest-GroupsTest-1922190928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:50:07 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-dfbfc523-1aac-45e0-8814-1ea4be87b93f tempest-GroupsTest-1922190928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:50:07 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-dfbfc523-1aac-45e0-8814-1ea4be87b93f tempest-GroupsTest-1922190928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:50:07 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-dfbfc523-1aac-45e0-8814-1ea4be87b93f tempest-GroupsTest-1922190928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:50:07 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-dfbfc523-1aac-45e0-8814-1ea4be87b93f tempest-GroupsTest-1922190928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:50:07 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-dfbfc523-1aac-45e0-8814-1ea4be87b93f tempest-GroupsTest-1922190928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:50:07 devstack sudo[94959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:50:07 devstack sudo[94959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:50:07 devstack sudo[94956]: pam_unix(sudo:session): session closed for user root
Jun 15 15:50:07 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-bd4b9680-bca0-4580-b604-d0f8687045e8 tempest-GroupsTest-1922190928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.741s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:50:07 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-bd4b9680-bca0-4580-b604-d0f8687045e8 tempest-GroupsTest-1922190928 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:50:07 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-bd4b9680-bca0-4580-b604-d0f8687045e8 tempest-GroupsTest-1922190928 None] Delete group completed successfully.
Jun 15 15:50:07 devstack sudo[94959]: pam_unix(sudo:session): session closed for user root
Jun 15 15:50:07 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-dfbfc523-1aac-45e0-8814-1ea4be87b93f tempest-GroupsTest-1922190928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.692s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:50:07 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-dfbfc523-1aac-45e0-8814-1ea4be87b93f tempest-GroupsTest-1922190928 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:50:07 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-dfbfc523-1aac-45e0-8814-1ea4be87b93f tempest-GroupsTest-1922190928 None] Delete group completed successfully.
Jun 15 15:50:08 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-1108d098-a1a2-4207-a10c-bd9d7572be31 tempest-GroupsTest-1922190928 None] Group tempest-GroupsTest-Group-911927574: creating
Jun 15 15:50:08 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-1108d098-a1a2-4207-a10c-bd9d7572be31 tempest-GroupsTest-1922190928 None] Group tempest-GroupsTest-Group-911927574: created successfully
Jun 15 15:50:08 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-1108d098-a1a2-4207-a10c-bd9d7572be31 tempest-GroupsTest-1922190928 None] Create group completed successfully.
Jun 15 15:50:09 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-b5f3d4fb-e572-4283-8ff9-4330b838e852 tempest-TaggedAttachmentsTest-1059968385 None] Acquiring lock "cinder-278ebdee-3395-4459-acee-cd6e2232f939-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:50:09 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-b5f3d4fb-e572-4283-8ff9-4330b838e852 tempest-TaggedAttachmentsTest-1059968385 None] Lock "cinder-278ebdee-3395-4459-acee-cd6e2232f939-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:50:09 devstack cinder-volume[91863]: DEBUG dbcounter [-] [91863] Writing DB stats cinder:SELECT=72,cinder:UPDATE=75,cinder:INSERT=11,cinder:DELETE=6 {{(pid=91863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 15:50:09 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-b5f3d4fb-e572-4283-8ff9-4330b838e852 tempest-TaggedAttachmentsTest-1059968385 None] Acquiring lock "cinder-quobyte-278ebdee-3395-4459-acee-cd6e2232f939" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:50:09 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-b5f3d4fb-e572-4283-8ff9-4330b838e852 tempest-TaggedAttachmentsTest-1059968385 None] Lock "cinder-quobyte-278ebdee-3395-4459-acee-cd6e2232f939" acquired by "delete_volume" :: waited 0.021s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:50:10 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3531173e-b49e-4b1f-b933-a37530672484]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:50:10 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-b5f3d4fb-e572-4283-8ff9-4330b838e852 tempest-TaggedAttachmentsTest-1059968385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-278ebdee-3395-4459-acee-cd6e2232f939 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:50:10 devstack sudo[94965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-278ebdee-3395-4459-acee-cd6e2232f939
Jun 15 15:50:10 devstack sudo[94965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:50:10 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f920fa0-cd61-47b1-9e54-c0e6aff0bb4b tempest-GroupsTest-1922190928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 15:50:10 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-7f920fa0-cd61-47b1-9e54-c0e6aff0bb4b tempest-GroupsTest-1922190928 None] Flow 'volume_create_manager' (e1a6e74d-5c6d-4ce1-9a86-cc986d07247f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:50:10 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-7f920fa0-cd61-47b1-9e54-c0e6aff0bb4b tempest-GroupsTest-1922190928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3681ca6-3a14-4fc7-a439-45c7676c4020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:50:10 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-7f920fa0-cd61-47b1-9e54-c0e6aff0bb4b tempest-GroupsTest-1922190928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3681ca6-3a14-4fc7-a439-45c7676c4020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:50:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1976112769',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a4105ea1-6490-4e6a-8cbd-b0196c4d22ca,host='devstack@QuobyteHD#QuobyteHD',id=3fc1498f-888a-463a-b480-828e4cde5448,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b4a8638e7ca482eb8651093f2df6eb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:50:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:50:10Z,use_quota=True,user_id='adae6d3d352847ae835d93892c424ce4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bdde494-9000-4f77-b1a4-e78aab871b2e),volume_type_id=7bdde494-9000-4f77-b1a4-e78aab871b2e)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:50:10 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-7f920fa0-cd61-47b1-9e54-c0e6aff0bb4b tempest-GroupsTest-1922190928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c485dde0-bf05-41cc-97ab-8965150092c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:50:10 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-7f920fa0-cd61-47b1-9e54-c0e6aff0bb4b tempest-GroupsTest-1922190928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c485dde0-bf05-41cc-97ab-8965150092c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:50:10 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-7f920fa0-cd61-47b1-9e54-c0e6aff0bb4b tempest-GroupsTest-1922190928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76c4542d-3f36-43af-9bb5-60172265a8b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:50:10 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-7f920fa0-cd61-47b1-9e54-c0e6aff0bb4b tempest-GroupsTest-1922190928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76c4542d-3f36-43af-9bb5-60172265a8b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fc1498f-888a-463a-b480-828e4cde5448', 'volume_name': 'volume-3fc1498f-888a-463a-b480-828e4cde5448', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:50:10 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-7f920fa0-cd61-47b1-9e54-c0e6aff0bb4b tempest-GroupsTest-1922190928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb62c98d-68a3-4f47-a684-76a970c37bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:50:10 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-7f920fa0-cd61-47b1-9e54-c0e6aff0bb4b tempest-GroupsTest-1922190928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb62c98d-68a3-4f47-a684-76a970c37bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:50:10 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-7f920fa0-cd61-47b1-9e54-c0e6aff0bb4b tempest-GroupsTest-1922190928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2962734c-82cd-46d9-a29b-24d58e92814e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:50:10 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-7f920fa0-cd61-47b1-9e54-c0e6aff0bb4b tempest-GroupsTest-1922190928 None] Volume 3fc1498f-888a-463a-b480-828e4cde5448: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fc1498f-888a-463a-b480-828e4cde5448', 'volume_size': 1}
Jun 15 15:50:10 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-7f920fa0-cd61-47b1-9e54-c0e6aff0bb4b tempest-GroupsTest-1922190928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:50:10 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-7f920fa0-cd61-47b1-9e54-c0e6aff0bb4b tempest-GroupsTest-1922190928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:50:10 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-7f920fa0-cd61-47b1-9e54-c0e6aff0bb4b tempest-GroupsTest-1922190928 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=a4105ea1-6490-4e6a-8cbd-b0196c4d22ca,created_at=2026-06-15T13:50:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1976112769',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a4105ea1-6490-4e6a-8cbd-b0196c4d22ca,host='devstack@QuobyteHD#QuobyteHD',id=3fc1498f-888a-463a-b480-828e4cde5448,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b4a8638e7ca482eb8651093f2df6eb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:50:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:50:10Z,use_quota=True,user_id='adae6d3d352847ae835d93892c424ce4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bdde494-9000-4f77-b1a4-e78aab871b2e),volume_type_id=7bdde494-9000-4f77-b1a4-e78aab871b2e)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 15:50:10 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-7f920fa0-cd61-47b1-9e54-c0e6aff0bb4b tempest-GroupsTest-1922190928 None] Creating volume 3fc1498f-888a-463a-b480-828e4cde5448 {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 15:50:10 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-7f920fa0-cd61-47b1-9e54-c0e6aff0bb4b tempest-GroupsTest-1922190928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:50:10 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-7f920fa0-cd61-47b1-9e54-c0e6aff0bb4b tempest-GroupsTest-1922190928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:50:10 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-7f920fa0-cd61-47b1-9e54-c0e6aff0bb4b tempest-GroupsTest-1922190928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:50:10 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-7f920fa0-cd61-47b1-9e54-c0e6aff0bb4b tempest-GroupsTest-1922190928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:50:10 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-7f920fa0-cd61-47b1-9e54-c0e6aff0bb4b tempest-GroupsTest-1922190928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:50:10 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-7f920fa0-cd61-47b1-9e54-c0e6aff0bb4b tempest-GroupsTest-1922190928 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 15:50:10 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-7f920fa0-cd61-47b1-9e54-c0e6aff0bb4b tempest-GroupsTest-1922190928 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 15:50:10 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-7f920fa0-cd61-47b1-9e54-c0e6aff0bb4b tempest-GroupsTest-1922190928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3fc1498f-888a-463a-b480-828e4cde5448 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:50:10 devstack sudo[94967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3fc1498f-888a-463a-b480-828e4cde5448 1073741824
Jun 15 15:50:10 devstack sudo[94967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:50:10 devstack sudo[94965]: pam_unix(sudo:session): session closed for user root
Jun 15 15:50:10 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-b5f3d4fb-e572-4283-8ff9-4330b838e852 tempest-TaggedAttachmentsTest-1059968385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-278ebdee-3395-4459-acee-cd6e2232f939" returned: 0 in 0.936s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:50:10 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-b5f3d4fb-e572-4283-8ff9-4330b838e852 tempest-TaggedAttachmentsTest-1059968385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-278ebdee-3395-4459-acee-cd6e2232f939 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:50:10 devstack sudo[94975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-278ebdee-3395-4459-acee-cd6e2232f939
Jun 15 15:50:10 devstack sudo[94975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:50:11 devstack sudo[94975]: pam_unix(sudo:session): session closed for user root
Jun 15 15:50:11 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-b5f3d4fb-e572-4283-8ff9-4330b838e852 tempest-TaggedAttachmentsTest-1059968385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-278ebdee-3395-4459-acee-cd6e2232f939" returned: 0 in 0.680s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:50:11 devstack sudo[94967]: pam_unix(sudo:session): session closed for user root
Jun 15 15:50:11 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-7f920fa0-cd61-47b1-9e54-c0e6aff0bb4b tempest-GroupsTest-1922190928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3fc1498f-888a-463a-b480-828e4cde5448 1073741824" returned: 0 in 1.036s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:50:11 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-b5f3d4fb-e572-4283-8ff9-4330b838e852 tempest-TaggedAttachmentsTest-1059968385 None] Lock "cinder-quobyte-278ebdee-3395-4459-acee-cd6e2232f939" released by "delete_volume" :: held 1.675s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:50:11 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-7f920fa0-cd61-47b1-9e54-c0e6aff0bb4b tempest-GroupsTest-1922190928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3fc1498f-888a-463a-b480-828e4cde5448 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:50:11 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-b5f3d4fb-e572-4283-8ff9-4330b838e852 tempest-TaggedAttachmentsTest-1059968385 None] Created reservations ['ce9c2ea6-30aa-4084-b1a7-07d32b59e9bf', 'ec367a05-14d1-4624-a9ec-586656baf3e8', '0719e097-dd7e-47fa-a111-d9728c7fb427', 'd8bee04a-7d72-4a1c-9c95-661f5e87b7a0'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:50:11 devstack sudo[94982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3fc1498f-888a-463a-b480-828e4cde5448
Jun 15 15:50:11 devstack sudo[94982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:50:11 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-b5f3d4fb-e572-4283-8ff9-4330b838e852 tempest-TaggedAttachmentsTest-1059968385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:50:11 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-b5f3d4fb-e572-4283-8ff9-4330b838e852 tempest-TaggedAttachmentsTest-1059968385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:50:11 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-b5f3d4fb-e572-4283-8ff9-4330b838e852 tempest-TaggedAttachmentsTest-1059968385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:50:11 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-b5f3d4fb-e572-4283-8ff9-4330b838e852 tempest-TaggedAttachmentsTest-1059968385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:50:11 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-b5f3d4fb-e572-4283-8ff9-4330b838e852 tempest-TaggedAttachmentsTest-1059968385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:50:11 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-b5f3d4fb-e572-4283-8ff9-4330b838e852 tempest-TaggedAttachmentsTest-1059968385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:50:11 devstack sudo[94984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:50:11 devstack sudo[94984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:50:12 devstack sudo[94982]: pam_unix(sudo:session): session closed for user root
Jun 15 15:50:12 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-7f920fa0-cd61-47b1-9e54-c0e6aff0bb4b tempest-GroupsTest-1922190928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3fc1498f-888a-463a-b480-828e4cde5448" returned: 0 in 0.743s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:50:12 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-7f920fa0-cd61-47b1-9e54-c0e6aff0bb4b tempest-GroupsTest-1922190928 None] <== create_volume: return (1868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 15:50:12 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-7f920fa0-cd61-47b1-9e54-c0e6aff0bb4b tempest-GroupsTest-1922190928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.872s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:50:12 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-7f920fa0-cd61-47b1-9e54-c0e6aff0bb4b tempest-GroupsTest-1922190928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2962734c-82cd-46d9-a29b-24d58e92814e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fc1498f-888a-463a-b480-828e4cde5448', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:50:12 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-7f920fa0-cd61-47b1-9e54-c0e6aff0bb4b tempest-GroupsTest-1922190928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0191e90-6a05-47fc-8b48-c3a921184b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:50:12 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-7f920fa0-cd61-47b1-9e54-c0e6aff0bb4b tempest-GroupsTest-1922190928 None] Volume volume-3fc1498f-888a-463a-b480-828e4cde5448 (3fc1498f-888a-463a-b480-828e4cde5448): created successfully
Jun 15 15:50:12 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-7f920fa0-cd61-47b1-9e54-c0e6aff0bb4b tempest-GroupsTest-1922190928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0191e90-6a05-47fc-8b48-c3a921184b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:50:12 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-7f920fa0-cd61-47b1-9e54-c0e6aff0bb4b tempest-GroupsTest-1922190928 None] Flow 'volume_create_manager' (e1a6e74d-5c6d-4ce1-9a86-cc986d07247f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:50:12 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-7f920fa0-cd61-47b1-9e54-c0e6aff0bb4b tempest-GroupsTest-1922190928 None] Created volume successfully.
Jun 15 15:50:12 devstack sudo[94984]: pam_unix(sudo:session): session closed for user root
Jun 15 15:50:12 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-b5f3d4fb-e572-4283-8ff9-4330b838e852 tempest-TaggedAttachmentsTest-1059968385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.888s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:50:12 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-b5f3d4fb-e572-4283-8ff9-4330b838e852 tempest-TaggedAttachmentsTest-1059968385 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:50:12 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-b5f3d4fb-e572-4283-8ff9-4330b838e852 tempest-TaggedAttachmentsTest-1059968385 None] Deleted volume successfully.
Jun 15 15:50:12 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-b5f3d4fb-e572-4283-8ff9-4330b838e852 tempest-TaggedAttachmentsTest-1059968385 None] Lock "cinder-278ebdee-3395-4459-acee-cd6e2232f939-delete_volume" released by "delete_volume" :: held 2.931s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:50:13 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-af99171d-0957-4f1d-9a72-10050e93c92c tempest-GroupsTest-1922190928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 15:50:13 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-af99171d-0957-4f1d-9a72-10050e93c92c tempest-GroupsTest-1922190928 None] Flow 'volume_create_manager' (66f1cf75-7c1b-4e0e-80ae-a7ab639cfbd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:50:13 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-af99171d-0957-4f1d-9a72-10050e93c92c tempest-GroupsTest-1922190928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c81ab03-a4ac-432f-9aac-510956d24118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:50:13 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-af99171d-0957-4f1d-9a72-10050e93c92c tempest-GroupsTest-1922190928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c81ab03-a4ac-432f-9aac-510956d24118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:50:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-180310558',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a4105ea1-6490-4e6a-8cbd-b0196c4d22ca,host='devstack@QuobyteHD#QuobyteHD',id=a546b461-61d5-4b77-b580-09947ffc4829,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b4a8638e7ca482eb8651093f2df6eb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:50:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:50:14Z,use_quota=True,user_id='adae6d3d352847ae835d93892c424ce4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bdde494-9000-4f77-b1a4-e78aab871b2e),volume_type_id=7bdde494-9000-4f77-b1a4-e78aab871b2e)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:50:13 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-af99171d-0957-4f1d-9a72-10050e93c92c tempest-GroupsTest-1922190928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5998edb8-427e-4831-8469-f250bea7fa61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:50:13 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-af99171d-0957-4f1d-9a72-10050e93c92c tempest-GroupsTest-1922190928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5998edb8-427e-4831-8469-f250bea7fa61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:50:13 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-af99171d-0957-4f1d-9a72-10050e93c92c tempest-GroupsTest-1922190928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0173cf0b-ec8e-4994-9780-463a959a2da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:50:13 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-af99171d-0957-4f1d-9a72-10050e93c92c tempest-GroupsTest-1922190928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0173cf0b-ec8e-4994-9780-463a959a2da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a546b461-61d5-4b77-b580-09947ffc4829', 'volume_name': 'volume-a546b461-61d5-4b77-b580-09947ffc4829', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:50:13 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-af99171d-0957-4f1d-9a72-10050e93c92c tempest-GroupsTest-1922190928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c40a6849-05e2-4d42-a18d-c626787ba5b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:50:13 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-af99171d-0957-4f1d-9a72-10050e93c92c tempest-GroupsTest-1922190928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c40a6849-05e2-4d42-a18d-c626787ba5b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:50:13 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-af99171d-0957-4f1d-9a72-10050e93c92c tempest-GroupsTest-1922190928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c247cbd-9ea1-49cf-ac68-cd860580df06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:50:13 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-af99171d-0957-4f1d-9a72-10050e93c92c tempest-GroupsTest-1922190928 None] Volume a546b461-61d5-4b77-b580-09947ffc4829: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a546b461-61d5-4b77-b580-09947ffc4829', 'volume_size': 1}
Jun 15 15:50:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-af99171d-0957-4f1d-9a72-10050e93c92c tempest-GroupsTest-1922190928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:50:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-af99171d-0957-4f1d-9a72-10050e93c92c tempest-GroupsTest-1922190928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:50:13 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-af99171d-0957-4f1d-9a72-10050e93c92c tempest-GroupsTest-1922190928 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=a4105ea1-6490-4e6a-8cbd-b0196c4d22ca,created_at=2026-06-15T13:50:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-180310558',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a4105ea1-6490-4e6a-8cbd-b0196c4d22ca,host='devstack@QuobyteHD#QuobyteHD',id=a546b461-61d5-4b77-b580-09947ffc4829,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b4a8638e7ca482eb8651093f2df6eb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:50:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:50:14Z,use_quota=True,user_id='adae6d3d352847ae835d93892c424ce4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bdde494-9000-4f77-b1a4-e78aab871b2e),volume_type_id=7bdde494-9000-4f77-b1a4-e78aab871b2e)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 15:50:13 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-af99171d-0957-4f1d-9a72-10050e93c92c tempest-GroupsTest-1922190928 None] Creating volume a546b461-61d5-4b77-b580-09947ffc4829 {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 15:50:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-af99171d-0957-4f1d-9a72-10050e93c92c tempest-GroupsTest-1922190928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:50:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-af99171d-0957-4f1d-9a72-10050e93c92c tempest-GroupsTest-1922190928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:50:13 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-af99171d-0957-4f1d-9a72-10050e93c92c tempest-GroupsTest-1922190928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:50:13 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-af99171d-0957-4f1d-9a72-10050e93c92c tempest-GroupsTest-1922190928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:50:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-af99171d-0957-4f1d-9a72-10050e93c92c tempest-GroupsTest-1922190928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:50:13 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-af99171d-0957-4f1d-9a72-10050e93c92c tempest-GroupsTest-1922190928 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 15:50:13 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-af99171d-0957-4f1d-9a72-10050e93c92c tempest-GroupsTest-1922190928 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 15:50:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-af99171d-0957-4f1d-9a72-10050e93c92c tempest-GroupsTest-1922190928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a546b461-61d5-4b77-b580-09947ffc4829 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:50:13 devstack sudo[95049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a546b461-61d5-4b77-b580-09947ffc4829 1073741824
Jun 15 15:50:13 devstack sudo[95049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:50:14 devstack sudo[95049]: pam_unix(sudo:session): session closed for user root
Jun 15 15:50:15 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-af99171d-0957-4f1d-9a72-10050e93c92c tempest-GroupsTest-1922190928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a546b461-61d5-4b77-b580-09947ffc4829 1073741824" returned: 0 in 1.181s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:50:15 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-af99171d-0957-4f1d-9a72-10050e93c92c tempest-GroupsTest-1922190928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a546b461-61d5-4b77-b580-09947ffc4829 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:50:15 devstack sudo[95059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a546b461-61d5-4b77-b580-09947ffc4829
Jun 15 15:50:15 devstack sudo[95059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:50:15 devstack sudo[95059]: pam_unix(sudo:session): session closed for user root
Jun 15 15:50:15 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-af99171d-0957-4f1d-9a72-10050e93c92c tempest-GroupsTest-1922190928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a546b461-61d5-4b77-b580-09947ffc4829" returned: 0 in 0.805s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:50:15 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-af99171d-0957-4f1d-9a72-10050e93c92c tempest-GroupsTest-1922190928 None] <== create_volume: return (2063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 15:50:15 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-af99171d-0957-4f1d-9a72-10050e93c92c tempest-GroupsTest-1922190928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.065s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:50:15 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-af99171d-0957-4f1d-9a72-10050e93c92c tempest-GroupsTest-1922190928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c247cbd-9ea1-49cf-ac68-cd860580df06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a546b461-61d5-4b77-b580-09947ffc4829', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:50:15 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-af99171d-0957-4f1d-9a72-10050e93c92c tempest-GroupsTest-1922190928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20306656-090c-4822-9788-f6dc9ca2c643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:50:15 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-af99171d-0957-4f1d-9a72-10050e93c92c tempest-GroupsTest-1922190928 None] Volume volume-a546b461-61d5-4b77-b580-09947ffc4829 (a546b461-61d5-4b77-b580-09947ffc4829): created successfully
Jun 15 15:50:15 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-af99171d-0957-4f1d-9a72-10050e93c92c tempest-GroupsTest-1922190928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20306656-090c-4822-9788-f6dc9ca2c643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:50:15 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-af99171d-0957-4f1d-9a72-10050e93c92c tempest-GroupsTest-1922190928 None] Flow 'volume_create_manager' (66f1cf75-7c1b-4e0e-80ae-a7ab639cfbd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:50:15 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-af99171d-0957-4f1d-9a72-10050e93c92c tempest-GroupsTest-1922190928 None] Created volume successfully.
Jun 15 15:50:17 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-ff3f70db-ffba-4db2-abf5-509d27d01f60 tempest-GroupsTest-1922190928 None] Update group completed successfully.
Jun 15 15:50:18 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-378633ed-8c2f-4457-9a78-172a719e9249 tempest-GroupsTest-1922190928 None] Update group completed successfully.
Jun 15 15:50:20 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-fcfcdb02-62db-4822-aca9-cd599e88305e tempest-GroupsTest-1922190928 None] Acquiring lock "cinder-quobyte-3fc1498f-888a-463a-b480-828e4cde5448" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:50:20 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-fcfcdb02-62db-4822-aca9-cd599e88305e tempest-GroupsTest-1922190928 None] Lock "cinder-quobyte-3fc1498f-888a-463a-b480-828e4cde5448" acquired by "delete_volume" :: waited 0.027s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:50:20 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb40994-0a39-4019-bf08-23759b0cee1f]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:50:20 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-fcfcdb02-62db-4822-aca9-cd599e88305e tempest-GroupsTest-1922190928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3fc1498f-888a-463a-b480-828e4cde5448 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:50:20 devstack sudo[95069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3fc1498f-888a-463a-b480-828e4cde5448
Jun 15 15:50:20 devstack sudo[95069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:50:21 devstack sudo[95069]: pam_unix(sudo:session): session closed for user root
Jun 15 15:50:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-fcfcdb02-62db-4822-aca9-cd599e88305e tempest-GroupsTest-1922190928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3fc1498f-888a-463a-b480-828e4cde5448" returned: 0 in 0.861s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:50:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-fcfcdb02-62db-4822-aca9-cd599e88305e tempest-GroupsTest-1922190928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3fc1498f-888a-463a-b480-828e4cde5448 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:50:21 devstack sudo[95075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3fc1498f-888a-463a-b480-828e4cde5448
Jun 15 15:50:21 devstack sudo[95075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:50:21 devstack sudo[95075]: pam_unix(sudo:session): session closed for user root
Jun 15 15:50:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-fcfcdb02-62db-4822-aca9-cd599e88305e tempest-GroupsTest-1922190928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3fc1498f-888a-463a-b480-828e4cde5448" returned: 0 in 0.768s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:50:22 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-fcfcdb02-62db-4822-aca9-cd599e88305e tempest-GroupsTest-1922190928 None] Lock "cinder-quobyte-3fc1498f-888a-463a-b480-828e4cde5448" released by "delete_volume" :: held 1.709s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:50:22 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-fcfcdb02-62db-4822-aca9-cd599e88305e tempest-GroupsTest-1922190928 None] Acquiring lock "cinder-quobyte-a546b461-61d5-4b77-b580-09947ffc4829" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:50:22 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-fcfcdb02-62db-4822-aca9-cd599e88305e tempest-GroupsTest-1922190928 None] Lock "cinder-quobyte-a546b461-61d5-4b77-b580-09947ffc4829" acquired by "delete_volume" :: waited 0.030s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:50:22 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f5eaef1-c505-4264-9332-4963cad2ae39]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:50:22 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-fcfcdb02-62db-4822-aca9-cd599e88305e tempest-GroupsTest-1922190928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a546b461-61d5-4b77-b580-09947ffc4829 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:50:22 devstack sudo[95085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a546b461-61d5-4b77-b580-09947ffc4829
Jun 15 15:50:22 devstack sudo[95085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:50:22 devstack sudo[95085]: pam_unix(sudo:session): session closed for user root
Jun 15 15:50:22 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-fcfcdb02-62db-4822-aca9-cd599e88305e tempest-GroupsTest-1922190928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a546b461-61d5-4b77-b580-09947ffc4829" returned: 0 in 0.837s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:50:22 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-fcfcdb02-62db-4822-aca9-cd599e88305e tempest-GroupsTest-1922190928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a546b461-61d5-4b77-b580-09947ffc4829 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:50:22 devstack sudo[95090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a546b461-61d5-4b77-b580-09947ffc4829
Jun 15 15:50:22 devstack sudo[95090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:50:23 devstack sudo[95090]: pam_unix(sudo:session): session closed for user root
Jun 15 15:50:23 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-fcfcdb02-62db-4822-aca9-cd599e88305e tempest-GroupsTest-1922190928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a546b461-61d5-4b77-b580-09947ffc4829" returned: 0 in 0.684s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:50:23 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-fcfcdb02-62db-4822-aca9-cd599e88305e tempest-GroupsTest-1922190928 None] Lock "cinder-quobyte-a546b461-61d5-4b77-b580-09947ffc4829" released by "delete_volume" :: held 1.610s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:50:23 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-fcfcdb02-62db-4822-aca9-cd599e88305e tempest-GroupsTest-1922190928 None] Created reservations ['62e7594c-9ff1-4227-b542-bd79a6fca6b2'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:50:23 devstack cinder-volume[91863]: WARNING cinder.quota [None req-fcfcdb02-62db-4822-aca9-cd599e88305e tempest-GroupsTest-1922190928 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-189076109 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-189076109, it is now deprecated. Please use the default quota class for default quota.
Jun 15 15:50:23 devstack cinder-volume[91863]: WARNING cinder.quota [None req-fcfcdb02-62db-4822-aca9-cd599e88305e tempest-GroupsTest-1922190928 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-189076109 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-189076109, it is now deprecated. Please use the default quota class for default quota.
Jun 15 15:50:23 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-fcfcdb02-62db-4822-aca9-cd599e88305e tempest-GroupsTest-1922190928 None] Created reservations ['2e8e2272-ddd4-430d-b8e8-28c490214ad3', '79f22f4d-fdc7-432b-854a-567d136668d8', 'bd5addd8-c47a-4226-ac0c-24f7cb4b5b06', '29d01f52-06a0-407f-b527-c762b403dc20'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:50:24 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-fcfcdb02-62db-4822-aca9-cd599e88305e tempest-GroupsTest-1922190928 None] Created reservations ['838da938-0419-418a-80e4-160715e198d0', 'fcac26c7-5c6e-4039-bb5d-f2e2a8d2842c', '998b99a8-b18e-4a16-95f4-2780069a8a7a', 'ca93f6fe-3a91-4a60-88e8-8d62a2af26b9'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:50:24 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-fcfcdb02-62db-4822-aca9-cd599e88305e tempest-GroupsTest-1922190928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:50:24 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-fcfcdb02-62db-4822-aca9-cd599e88305e tempest-GroupsTest-1922190928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:50:24 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-fcfcdb02-62db-4822-aca9-cd599e88305e tempest-GroupsTest-1922190928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:50:24 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-fcfcdb02-62db-4822-aca9-cd599e88305e tempest-GroupsTest-1922190928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:50:24 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-fcfcdb02-62db-4822-aca9-cd599e88305e tempest-GroupsTest-1922190928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:50:24 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-fcfcdb02-62db-4822-aca9-cd599e88305e tempest-GroupsTest-1922190928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:50:24 devstack sudo[95094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:50:24 devstack sudo[95094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:50:25 devstack sudo[95094]: pam_unix(sudo:session): session closed for user root
Jun 15 15:50:25 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-fcfcdb02-62db-4822-aca9-cd599e88305e tempest-GroupsTest-1922190928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.896s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:50:25 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-fcfcdb02-62db-4822-aca9-cd599e88305e tempest-GroupsTest-1922190928 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:50:25 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-fcfcdb02-62db-4822-aca9-cd599e88305e tempest-GroupsTest-1922190928 None] Delete group completed successfully.
Jun 15 15:50:31 devstack cinder-volume[91863]: DEBUG oslo_service.periodic_task [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 15:50:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:50:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:50:31 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:50:31 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:50:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:50:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:50:31 devstack sudo[95201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:50:31 devstack sudo[95201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:50:31 devstack sudo[95201]: pam_unix(sudo:session): session closed for user root
Jun 15 15:50:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.557s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:50:31 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:50:31 devstack cinder-volume[91863]: DEBUG oslo_service.periodic_task [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Running periodic task VolumeManager._thread_info {{(pid=91863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 15:50:31 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] thread count: 8 {{(pid=91863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 15 15:50:31 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] thread info: [<_MainThread(MainThread, started 131088232640640)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131088122704576)>, <Thread(Thread-3 (stat_writer), started daemon 131088123058112)>, <Thread(Rabbit-heartbeat, started daemon 131088121268864)>, <Thread(Thread-5 (_runner), started daemon 131088121904192)>, <Thread(Thread-7 (_runner), started daemon 131088122037248)>, <Thread(fd_logger, started daemon 131088119630784)>, <Thread(privsep_reader, started daemon 131088119781440)>] {{(pid=91863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 15 15:50:34 devstack cinder-volume[91863]: DEBUG dbcounter [-] [91863] Writing DB stats cinder:SELECT=39,cinder:UPDATE=50,cinder:INSERT=14,cinder:DELETE=1 {{(pid=91863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 15:50:34 devstack cinder-volume[91863]: DEBUG dbcounter [-] [91863] Writing DB stats cinder:SELECT=28,cinder:INSERT=7,cinder:UPDATE=36,cinder:DELETE=2 {{(pid=91863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 15:50:37 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-6e10adab-9441-48e5-9284-061fcaee2154 tempest-GroupsV320Test-1634070627 None] Group tempest-GroupsV320Test-Group-1860784143: creating
Jun 15 15:50:37 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-6e10adab-9441-48e5-9284-061fcaee2154 tempest-GroupsV320Test-1634070627 None] Group tempest-GroupsV320Test-Group-1860784143: created successfully
Jun 15 15:50:37 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-6e10adab-9441-48e5-9284-061fcaee2154 tempest-GroupsV320Test-1634070627 None] Create group completed successfully.
Jun 15 15:50:39 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-d2968d77-b086-46e7-83a1-c5cd9db0f03d tempest-GroupsV320Test-1634070627 None] Created reservations ['c821dd19-b57c-4209-8ef8-7b7dcec2fcd4'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:50:39 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a21028f-382b-428e-ae76-3c0108048d7b tempest-AttachVolumeShelveTestJSON-1587912764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 15:50:39 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-0a21028f-382b-428e-ae76-3c0108048d7b tempest-AttachVolumeShelveTestJSON-1587912764 None] Flow 'volume_create_manager' (4e2cf2da-5602-4239-a1a7-88188bbdbd76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:50:39 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-0a21028f-382b-428e-ae76-3c0108048d7b tempest-AttachVolumeShelveTestJSON-1587912764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (743c02a5-fe1f-4074-ae8a-97213cb46f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:50:39 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-0a21028f-382b-428e-ae76-3c0108048d7b tempest-AttachVolumeShelveTestJSON-1587912764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (743c02a5-fe1f-4074-ae8a-97213cb46f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:50:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-2132597151',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46b7eea4-131a-47a1-a9d9-ec414da9ee27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7db3a91d7d47491299631a4fbac721ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:50:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:50:39Z,use_quota=True,user_id='b89a6c345dfa4dfc8058bc5fa471785d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:50:39 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-0a21028f-382b-428e-ae76-3c0108048d7b tempest-AttachVolumeShelveTestJSON-1587912764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a00b7a5-71c3-4a15-9b52-e2e23bb847e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:50:39 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-0a21028f-382b-428e-ae76-3c0108048d7b tempest-AttachVolumeShelveTestJSON-1587912764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a00b7a5-71c3-4a15-9b52-e2e23bb847e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:50:39 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-0a21028f-382b-428e-ae76-3c0108048d7b tempest-AttachVolumeShelveTestJSON-1587912764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94f24715-5424-4593-996d-bfbcfc0603f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:50:39 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-0a21028f-382b-428e-ae76-3c0108048d7b tempest-AttachVolumeShelveTestJSON-1587912764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94f24715-5424-4593-996d-bfbcfc0603f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46b7eea4-131a-47a1-a9d9-ec414da9ee27', 'volume_name': 'volume-46b7eea4-131a-47a1-a9d9-ec414da9ee27', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:50:39 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-0a21028f-382b-428e-ae76-3c0108048d7b tempest-AttachVolumeShelveTestJSON-1587912764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bf4439d-a8e0-4cce-b125-49f597309321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:50:39 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-0a21028f-382b-428e-ae76-3c0108048d7b tempest-AttachVolumeShelveTestJSON-1587912764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bf4439d-a8e0-4cce-b125-49f597309321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:50:39 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-0a21028f-382b-428e-ae76-3c0108048d7b tempest-AttachVolumeShelveTestJSON-1587912764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2775387b-0f07-4867-8764-01b2fb889363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:50:39 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-0a21028f-382b-428e-ae76-3c0108048d7b tempest-AttachVolumeShelveTestJSON-1587912764 None] Volume 46b7eea4-131a-47a1-a9d9-ec414da9ee27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46b7eea4-131a-47a1-a9d9-ec414da9ee27', 'volume_size': 1}
Jun 15 15:50:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-0a21028f-382b-428e-ae76-3c0108048d7b tempest-AttachVolumeShelveTestJSON-1587912764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:50:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-0a21028f-382b-428e-ae76-3c0108048d7b tempest-AttachVolumeShelveTestJSON-1587912764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:50:39 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-0a21028f-382b-428e-ae76-3c0108048d7b tempest-AttachVolumeShelveTestJSON-1587912764 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:50:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-2132597151',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46b7eea4-131a-47a1-a9d9-ec414da9ee27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7db3a91d7d47491299631a4fbac721ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:50:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:50:39Z,use_quota=True,user_id='b89a6c345dfa4dfc8058bc5fa471785d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 15:50:39 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-0a21028f-382b-428e-ae76-3c0108048d7b tempest-AttachVolumeShelveTestJSON-1587912764 None] Creating volume 46b7eea4-131a-47a1-a9d9-ec414da9ee27 {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 15:50:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-0a21028f-382b-428e-ae76-3c0108048d7b tempest-AttachVolumeShelveTestJSON-1587912764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:50:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-0a21028f-382b-428e-ae76-3c0108048d7b tempest-AttachVolumeShelveTestJSON-1587912764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:50:39 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-0a21028f-382b-428e-ae76-3c0108048d7b tempest-AttachVolumeShelveTestJSON-1587912764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:50:39 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-0a21028f-382b-428e-ae76-3c0108048d7b tempest-AttachVolumeShelveTestJSON-1587912764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:50:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-0a21028f-382b-428e-ae76-3c0108048d7b tempest-AttachVolumeShelveTestJSON-1587912764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:50:39 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-0a21028f-382b-428e-ae76-3c0108048d7b tempest-AttachVolumeShelveTestJSON-1587912764 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 15:50:39 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-0a21028f-382b-428e-ae76-3c0108048d7b tempest-AttachVolumeShelveTestJSON-1587912764 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 15:50:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-0a21028f-382b-428e-ae76-3c0108048d7b tempest-AttachVolumeShelveTestJSON-1587912764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-46b7eea4-131a-47a1-a9d9-ec414da9ee27 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:50:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-d2968d77-b086-46e7-83a1-c5cd9db0f03d tempest-GroupsV320Test-1634070627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:50:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-d2968d77-b086-46e7-83a1-c5cd9db0f03d tempest-GroupsV320Test-1634070627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:50:39 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-d2968d77-b086-46e7-83a1-c5cd9db0f03d tempest-GroupsV320Test-1634070627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:50:39 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-d2968d77-b086-46e7-83a1-c5cd9db0f03d tempest-GroupsV320Test-1634070627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:50:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-d2968d77-b086-46e7-83a1-c5cd9db0f03d tempest-GroupsV320Test-1634070627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:50:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-d2968d77-b086-46e7-83a1-c5cd9db0f03d tempest-GroupsV320Test-1634070627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:50:39 devstack sudo[95274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-46b7eea4-131a-47a1-a9d9-ec414da9ee27 1073741824
Jun 15 15:50:39 devstack sudo[95274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:50:39 devstack sudo[95275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:50:39 devstack sudo[95275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:50:40 devstack sudo[95275]: pam_unix(sudo:session): session closed for user root
Jun 15 15:50:40 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-d2968d77-b086-46e7-83a1-c5cd9db0f03d tempest-GroupsV320Test-1634070627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 1.278s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:50:40 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-d2968d77-b086-46e7-83a1-c5cd9db0f03d tempest-GroupsV320Test-1634070627 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:50:40 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-d2968d77-b086-46e7-83a1-c5cd9db0f03d tempest-GroupsV320Test-1634070627 None] Delete group completed successfully.
Jun 15 15:50:41 devstack sudo[95274]: pam_unix(sudo:session): session closed for user root
Jun 15 15:50:41 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-0a21028f-382b-428e-ae76-3c0108048d7b tempest-AttachVolumeShelveTestJSON-1587912764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-46b7eea4-131a-47a1-a9d9-ec414da9ee27 1073741824" returned: 0 in 1.703s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:50:41 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-0a21028f-382b-428e-ae76-3c0108048d7b tempest-AttachVolumeShelveTestJSON-1587912764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-46b7eea4-131a-47a1-a9d9-ec414da9ee27 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:50:41 devstack sudo[95284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-46b7eea4-131a-47a1-a9d9-ec414da9ee27
Jun 15 15:50:41 devstack sudo[95284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:50:42 devstack sudo[95284]: pam_unix(sudo:session): session closed for user root
Jun 15 15:50:42 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-0a21028f-382b-428e-ae76-3c0108048d7b tempest-AttachVolumeShelveTestJSON-1587912764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-46b7eea4-131a-47a1-a9d9-ec414da9ee27" returned: 0 in 1.239s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:50:42 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-0a21028f-382b-428e-ae76-3c0108048d7b tempest-AttachVolumeShelveTestJSON-1587912764 None] <== create_volume: return (3046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 15:50:42 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-0a21028f-382b-428e-ae76-3c0108048d7b tempest-AttachVolumeShelveTestJSON-1587912764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.054s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:50:42 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-0a21028f-382b-428e-ae76-3c0108048d7b tempest-AttachVolumeShelveTestJSON-1587912764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2775387b-0f07-4867-8764-01b2fb889363) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46b7eea4-131a-47a1-a9d9-ec414da9ee27', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:50:42 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-0a21028f-382b-428e-ae76-3c0108048d7b tempest-AttachVolumeShelveTestJSON-1587912764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9c9694c-4d85-417b-bc42-7c10607752cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:50:42 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-0a21028f-382b-428e-ae76-3c0108048d7b tempest-AttachVolumeShelveTestJSON-1587912764 None] Volume volume-46b7eea4-131a-47a1-a9d9-ec414da9ee27 (46b7eea4-131a-47a1-a9d9-ec414da9ee27): created successfully
Jun 15 15:50:42 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-0a21028f-382b-428e-ae76-3c0108048d7b tempest-AttachVolumeShelveTestJSON-1587912764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9c9694c-4d85-417b-bc42-7c10607752cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:50:42 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-0a21028f-382b-428e-ae76-3c0108048d7b tempest-AttachVolumeShelveTestJSON-1587912764 None] Flow 'volume_create_manager' (4e2cf2da-5602-4239-a1a7-88188bbdbd76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:50:42 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-0a21028f-382b-428e-ae76-3c0108048d7b tempest-AttachVolumeShelveTestJSON-1587912764 None] Created volume successfully.
Jun 15 15:50:52 devstack cinder-volume[91863]: DEBUG dbcounter [-] [91863] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=4 {{(pid=91863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 15:50:52 devstack cinder-volume[91863]: DEBUG dbcounter [-] [91863] Writing DB stats cinder:SELECT=8,cinder:UPDATE=9,cinder:INSERT=1,cinder:DELETE=1 {{(pid=91863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 15:50:58 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-660add8d-5f07-4368-90ea-c61957412a68 tempest-VolumeQuotasAdminTestJSON-1088798833 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 15:50:58 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-660add8d-5f07-4368-90ea-c61957412a68 tempest-VolumeQuotasAdminTestJSON-1088798833 None] Flow 'volume_create_manager' (9d8f04cf-77ce-4e43-bc7f-eee88f18e212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:50:58 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-660add8d-5f07-4368-90ea-c61957412a68 tempest-VolumeQuotasAdminTestJSON-1088798833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d0fae40-ef26-4103-9712-cc46d936437b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:50:58 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-660add8d-5f07-4368-90ea-c61957412a68 tempest-VolumeQuotasAdminTestJSON-1088798833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d0fae40-ef26-4103-9712-cc46d936437b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:50:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-453456393',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fddbed7f-ab3f-4c67-9aed-9e15c24651c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='727e9a55e5fd46e1b78ec755e8d4d646',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:50:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:50:58Z,use_quota=True,user_id='ee66a8e92f624cdaa10a6c57a3934fe4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:50:58 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-660add8d-5f07-4368-90ea-c61957412a68 tempest-VolumeQuotasAdminTestJSON-1088798833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d068f90e-d6c8-4ea7-8052-6a90e3bbc72b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:50:58 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-660add8d-5f07-4368-90ea-c61957412a68 tempest-VolumeQuotasAdminTestJSON-1088798833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d068f90e-d6c8-4ea7-8052-6a90e3bbc72b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:50:58 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-660add8d-5f07-4368-90ea-c61957412a68 tempest-VolumeQuotasAdminTestJSON-1088798833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b08f431-383f-4264-991c-432aefcc97fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:50:58 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-660add8d-5f07-4368-90ea-c61957412a68 tempest-VolumeQuotasAdminTestJSON-1088798833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b08f431-383f-4264-991c-432aefcc97fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fddbed7f-ab3f-4c67-9aed-9e15c24651c9', 'volume_name': 'volume-fddbed7f-ab3f-4c67-9aed-9e15c24651c9', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:50:58 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-660add8d-5f07-4368-90ea-c61957412a68 tempest-VolumeQuotasAdminTestJSON-1088798833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (534c425a-da2b-489c-ad60-45f1f6ab48fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:50:58 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-660add8d-5f07-4368-90ea-c61957412a68 tempest-VolumeQuotasAdminTestJSON-1088798833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (534c425a-da2b-489c-ad60-45f1f6ab48fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:50:58 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-660add8d-5f07-4368-90ea-c61957412a68 tempest-VolumeQuotasAdminTestJSON-1088798833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08d7cb7f-4202-4e4f-8eec-bb03b8069d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:50:58 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-660add8d-5f07-4368-90ea-c61957412a68 tempest-VolumeQuotasAdminTestJSON-1088798833 None] Volume fddbed7f-ab3f-4c67-9aed-9e15c24651c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fddbed7f-ab3f-4c67-9aed-9e15c24651c9', 'volume_size': 1}
Jun 15 15:50:58 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-660add8d-5f07-4368-90ea-c61957412a68 tempest-VolumeQuotasAdminTestJSON-1088798833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:50:58 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-660add8d-5f07-4368-90ea-c61957412a68 tempest-VolumeQuotasAdminTestJSON-1088798833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:50:58 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-660add8d-5f07-4368-90ea-c61957412a68 tempest-VolumeQuotasAdminTestJSON-1088798833 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:50:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-453456393',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fddbed7f-ab3f-4c67-9aed-9e15c24651c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='727e9a55e5fd46e1b78ec755e8d4d646',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:50:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:50:58Z,use_quota=True,user_id='ee66a8e92f624cdaa10a6c57a3934fe4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 15:50:58 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-660add8d-5f07-4368-90ea-c61957412a68 tempest-VolumeQuotasAdminTestJSON-1088798833 None] Creating volume fddbed7f-ab3f-4c67-9aed-9e15c24651c9 {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 15:50:58 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-660add8d-5f07-4368-90ea-c61957412a68 tempest-VolumeQuotasAdminTestJSON-1088798833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:50:58 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-660add8d-5f07-4368-90ea-c61957412a68 tempest-VolumeQuotasAdminTestJSON-1088798833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:50:58 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-660add8d-5f07-4368-90ea-c61957412a68 tempest-VolumeQuotasAdminTestJSON-1088798833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:50:58 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-660add8d-5f07-4368-90ea-c61957412a68 tempest-VolumeQuotasAdminTestJSON-1088798833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:50:58 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-660add8d-5f07-4368-90ea-c61957412a68 tempest-VolumeQuotasAdminTestJSON-1088798833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:50:58 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-660add8d-5f07-4368-90ea-c61957412a68 tempest-VolumeQuotasAdminTestJSON-1088798833 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 15:50:58 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-660add8d-5f07-4368-90ea-c61957412a68 tempest-VolumeQuotasAdminTestJSON-1088798833 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 15:50:58 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-660add8d-5f07-4368-90ea-c61957412a68 tempest-VolumeQuotasAdminTestJSON-1088798833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fddbed7f-ab3f-4c67-9aed-9e15c24651c9 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:50:58 devstack sudo[95390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fddbed7f-ab3f-4c67-9aed-9e15c24651c9 1073741824
Jun 15 15:50:58 devstack sudo[95390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:50:59 devstack sudo[95390]: pam_unix(sudo:session): session closed for user root
Jun 15 15:50:59 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-660add8d-5f07-4368-90ea-c61957412a68 tempest-VolumeQuotasAdminTestJSON-1088798833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fddbed7f-ab3f-4c67-9aed-9e15c24651c9 1073741824" returned: 0 in 1.089s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:50:59 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-660add8d-5f07-4368-90ea-c61957412a68 tempest-VolumeQuotasAdminTestJSON-1088798833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fddbed7f-ab3f-4c67-9aed-9e15c24651c9 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:50:59 devstack sudo[95395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fddbed7f-ab3f-4c67-9aed-9e15c24651c9
Jun 15 15:50:59 devstack sudo[95395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:51:00 devstack sudo[95395]: pam_unix(sudo:session): session closed for user root
Jun 15 15:51:00 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-660add8d-5f07-4368-90ea-c61957412a68 tempest-VolumeQuotasAdminTestJSON-1088798833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fddbed7f-ab3f-4c67-9aed-9e15c24651c9" returned: 0 in 0.670s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:51:00 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-660add8d-5f07-4368-90ea-c61957412a68 tempest-VolumeQuotasAdminTestJSON-1088798833 None] <== create_volume: return (1802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 15:51:00 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-660add8d-5f07-4368-90ea-c61957412a68 tempest-VolumeQuotasAdminTestJSON-1088798833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.805s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:51:00 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-660add8d-5f07-4368-90ea-c61957412a68 tempest-VolumeQuotasAdminTestJSON-1088798833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08d7cb7f-4202-4e4f-8eec-bb03b8069d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fddbed7f-ab3f-4c67-9aed-9e15c24651c9', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:51:00 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-660add8d-5f07-4368-90ea-c61957412a68 tempest-VolumeQuotasAdminTestJSON-1088798833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03ed9959-7603-48a3-a027-855ac17bea3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:51:00 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-660add8d-5f07-4368-90ea-c61957412a68 tempest-VolumeQuotasAdminTestJSON-1088798833 None] Volume volume-fddbed7f-ab3f-4c67-9aed-9e15c24651c9 (fddbed7f-ab3f-4c67-9aed-9e15c24651c9): created successfully
Jun 15 15:51:00 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-660add8d-5f07-4368-90ea-c61957412a68 tempest-VolumeQuotasAdminTestJSON-1088798833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03ed9959-7603-48a3-a027-855ac17bea3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:51:00 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-660add8d-5f07-4368-90ea-c61957412a68 tempest-VolumeQuotasAdminTestJSON-1088798833 None] Flow 'volume_create_manager' (9d8f04cf-77ce-4e43-bc7f-eee88f18e212) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:51:00 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-660add8d-5f07-4368-90ea-c61957412a68 tempest-VolumeQuotasAdminTestJSON-1088798833 None] Created volume successfully.
Jun 15 15:51:00 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-1dc8701d-6c7c-434b-9501-ebc9cf7817aa tempest-VolumeQuotasAdminTestJSON-1088798833 None] Acquiring lock "cinder-fddbed7f-ab3f-4c67-9aed-9e15c24651c9-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:51:00 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-1dc8701d-6c7c-434b-9501-ebc9cf7817aa tempest-VolumeQuotasAdminTestJSON-1088798833 None] Lock "cinder-fddbed7f-ab3f-4c67-9aed-9e15c24651c9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:51:00 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-1dc8701d-6c7c-434b-9501-ebc9cf7817aa tempest-VolumeQuotasAdminTestJSON-1088798833 None] Acquiring lock "cinder-quobyte-fddbed7f-ab3f-4c67-9aed-9e15c24651c9" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:51:00 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-1dc8701d-6c7c-434b-9501-ebc9cf7817aa tempest-VolumeQuotasAdminTestJSON-1088798833 None] Lock "cinder-quobyte-fddbed7f-ab3f-4c67-9aed-9e15c24651c9" acquired by "delete_volume" :: waited 0.026s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:51:00 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc742de1-eb2f-4917-9808-09b2a4316036]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:51:00 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-1dc8701d-6c7c-434b-9501-ebc9cf7817aa tempest-VolumeQuotasAdminTestJSON-1088798833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fddbed7f-ab3f-4c67-9aed-9e15c24651c9 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:51:00 devstack sudo[95398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fddbed7f-ab3f-4c67-9aed-9e15c24651c9
Jun 15 15:51:00 devstack sudo[95398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:51:01 devstack sudo[95398]: pam_unix(sudo:session): session closed for user root
Jun 15 15:51:01 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-1dc8701d-6c7c-434b-9501-ebc9cf7817aa tempest-VolumeQuotasAdminTestJSON-1088798833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fddbed7f-ab3f-4c67-9aed-9e15c24651c9" returned: 0 in 0.834s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:51:01 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-1dc8701d-6c7c-434b-9501-ebc9cf7817aa tempest-VolumeQuotasAdminTestJSON-1088798833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fddbed7f-ab3f-4c67-9aed-9e15c24651c9 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:51:01 devstack sudo[95407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fddbed7f-ab3f-4c67-9aed-9e15c24651c9
Jun 15 15:51:01 devstack sudo[95407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:51:02 devstack sudo[95407]: pam_unix(sudo:session): session closed for user root
Jun 15 15:51:02 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-1dc8701d-6c7c-434b-9501-ebc9cf7817aa tempest-VolumeQuotasAdminTestJSON-1088798833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fddbed7f-ab3f-4c67-9aed-9e15c24651c9" returned: 0 in 0.642s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:51:02 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-1dc8701d-6c7c-434b-9501-ebc9cf7817aa tempest-VolumeQuotasAdminTestJSON-1088798833 None] Lock "cinder-quobyte-fddbed7f-ab3f-4c67-9aed-9e15c24651c9" released by "delete_volume" :: held 1.540s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:51:02 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-1dc8701d-6c7c-434b-9501-ebc9cf7817aa tempest-VolumeQuotasAdminTestJSON-1088798833 None] Created reservations ['094dbd30-5733-4634-8627-482e640ef8e0', 'a671a01d-ba6b-4906-b6f9-96b03fce05eb', '393b1804-7ecb-4c58-b3e0-45eadc530484', '39d21f36-5058-424f-be37-15f45f91468c'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:51:02 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-1dc8701d-6c7c-434b-9501-ebc9cf7817aa tempest-VolumeQuotasAdminTestJSON-1088798833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:51:02 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-1dc8701d-6c7c-434b-9501-ebc9cf7817aa tempest-VolumeQuotasAdminTestJSON-1088798833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:51:02 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-1dc8701d-6c7c-434b-9501-ebc9cf7817aa tempest-VolumeQuotasAdminTestJSON-1088798833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:51:02 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-1dc8701d-6c7c-434b-9501-ebc9cf7817aa tempest-VolumeQuotasAdminTestJSON-1088798833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:51:02 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-1dc8701d-6c7c-434b-9501-ebc9cf7817aa tempest-VolumeQuotasAdminTestJSON-1088798833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:51:02 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-1dc8701d-6c7c-434b-9501-ebc9cf7817aa tempest-VolumeQuotasAdminTestJSON-1088798833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:51:02 devstack sudo[95412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:51:02 devstack sudo[95412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:51:03 devstack sudo[95412]: pam_unix(sudo:session): session closed for user root
Jun 15 15:51:03 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-1dc8701d-6c7c-434b-9501-ebc9cf7817aa tempest-VolumeQuotasAdminTestJSON-1088798833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 1.036s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:51:03 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-1dc8701d-6c7c-434b-9501-ebc9cf7817aa tempest-VolumeQuotasAdminTestJSON-1088798833 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:51:03 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-1dc8701d-6c7c-434b-9501-ebc9cf7817aa tempest-VolumeQuotasAdminTestJSON-1088798833 None] Deleted volume successfully.
Jun 15 15:51:03 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-1dc8701d-6c7c-434b-9501-ebc9cf7817aa tempest-VolumeQuotasAdminTestJSON-1088798833 None] Lock "cinder-fddbed7f-ab3f-4c67-9aed-9e15c24651c9-delete_volume" released by "delete_volume" :: held 2.886s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:51:03 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d80ea2f-51ce-436a-b841-d7963de24d2a tempest-VolumeQuotasAdminTestJSON-1088798833 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 15:51:03 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5d80ea2f-51ce-436a-b841-d7963de24d2a tempest-VolumeQuotasAdminTestJSON-1088798833 None] Flow 'volume_create_manager' (41eceedc-2339-4be9-bb11-e7c4b7bb5201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:51:03 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5d80ea2f-51ce-436a-b841-d7963de24d2a tempest-VolumeQuotasAdminTestJSON-1088798833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba607bca-0784-4008-bf24-72fe23442087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:51:04 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5d80ea2f-51ce-436a-b841-d7963de24d2a tempest-VolumeQuotasAdminTestJSON-1088798833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba607bca-0784-4008-bf24-72fe23442087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:51:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-706355476',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7162501-3638-42bc-bea8-5ac43d4fdf06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='727e9a55e5fd46e1b78ec755e8d4d646',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:51:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:51:04Z,use_quota=True,user_id='ee66a8e92f624cdaa10a6c57a3934fe4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:51:04 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5d80ea2f-51ce-436a-b841-d7963de24d2a tempest-VolumeQuotasAdminTestJSON-1088798833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed19f481-1bcc-4312-b80d-e09ff2a2b799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:51:04 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5d80ea2f-51ce-436a-b841-d7963de24d2a tempest-VolumeQuotasAdminTestJSON-1088798833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed19f481-1bcc-4312-b80d-e09ff2a2b799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:51:04 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5d80ea2f-51ce-436a-b841-d7963de24d2a tempest-VolumeQuotasAdminTestJSON-1088798833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99a0eb1b-4fd3-4f08-8147-25bf6dbf652b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:51:04 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5d80ea2f-51ce-436a-b841-d7963de24d2a tempest-VolumeQuotasAdminTestJSON-1088798833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99a0eb1b-4fd3-4f08-8147-25bf6dbf652b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7162501-3638-42bc-bea8-5ac43d4fdf06', 'volume_name': 'volume-d7162501-3638-42bc-bea8-5ac43d4fdf06', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:51:04 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5d80ea2f-51ce-436a-b841-d7963de24d2a tempest-VolumeQuotasAdminTestJSON-1088798833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c068bd8-a922-4a3c-be34-e02df4f73fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:51:04 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5d80ea2f-51ce-436a-b841-d7963de24d2a tempest-VolumeQuotasAdminTestJSON-1088798833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c068bd8-a922-4a3c-be34-e02df4f73fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:51:04 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5d80ea2f-51ce-436a-b841-d7963de24d2a tempest-VolumeQuotasAdminTestJSON-1088798833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0da99dd5-9bcf-4e7a-ae25-8f26c989c4ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:51:04 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-5d80ea2f-51ce-436a-b841-d7963de24d2a tempest-VolumeQuotasAdminTestJSON-1088798833 None] Volume d7162501-3638-42bc-bea8-5ac43d4fdf06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7162501-3638-42bc-bea8-5ac43d4fdf06', 'volume_size': 1}
Jun 15 15:51:04 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-5d80ea2f-51ce-436a-b841-d7963de24d2a tempest-VolumeQuotasAdminTestJSON-1088798833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:51:04 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-5d80ea2f-51ce-436a-b841-d7963de24d2a tempest-VolumeQuotasAdminTestJSON-1088798833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:51:04 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-5d80ea2f-51ce-436a-b841-d7963de24d2a tempest-VolumeQuotasAdminTestJSON-1088798833 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:51:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-706355476',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7162501-3638-42bc-bea8-5ac43d4fdf06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='727e9a55e5fd46e1b78ec755e8d4d646',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:51:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:51:04Z,use_quota=True,user_id='ee66a8e92f624cdaa10a6c57a3934fe4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 15:51:04 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-5d80ea2f-51ce-436a-b841-d7963de24d2a tempest-VolumeQuotasAdminTestJSON-1088798833 None] Creating volume d7162501-3638-42bc-bea8-5ac43d4fdf06 {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 15:51:04 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-5d80ea2f-51ce-436a-b841-d7963de24d2a tempest-VolumeQuotasAdminTestJSON-1088798833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:51:04 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-5d80ea2f-51ce-436a-b841-d7963de24d2a tempest-VolumeQuotasAdminTestJSON-1088798833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:51:04 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-5d80ea2f-51ce-436a-b841-d7963de24d2a tempest-VolumeQuotasAdminTestJSON-1088798833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:51:04 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-5d80ea2f-51ce-436a-b841-d7963de24d2a tempest-VolumeQuotasAdminTestJSON-1088798833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:51:04 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-5d80ea2f-51ce-436a-b841-d7963de24d2a tempest-VolumeQuotasAdminTestJSON-1088798833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:51:04 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-5d80ea2f-51ce-436a-b841-d7963de24d2a tempest-VolumeQuotasAdminTestJSON-1088798833 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 15:51:04 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-5d80ea2f-51ce-436a-b841-d7963de24d2a tempest-VolumeQuotasAdminTestJSON-1088798833 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 15:51:04 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5d80ea2f-51ce-436a-b841-d7963de24d2a tempest-VolumeQuotasAdminTestJSON-1088798833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-d7162501-3638-42bc-bea8-5ac43d4fdf06 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:51:04 devstack sudo[95493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-d7162501-3638-42bc-bea8-5ac43d4fdf06 1073741824
Jun 15 15:51:04 devstack sudo[95493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:51:05 devstack sudo[95493]: pam_unix(sudo:session): session closed for user root
Jun 15 15:51:05 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5d80ea2f-51ce-436a-b841-d7963de24d2a tempest-VolumeQuotasAdminTestJSON-1088798833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-d7162501-3638-42bc-bea8-5ac43d4fdf06 1073741824" returned: 0 in 0.999s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:51:05 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5d80ea2f-51ce-436a-b841-d7963de24d2a tempest-VolumeQuotasAdminTestJSON-1088798833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-d7162501-3638-42bc-bea8-5ac43d4fdf06 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:51:05 devstack sudo[95502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-d7162501-3638-42bc-bea8-5ac43d4fdf06
Jun 15 15:51:05 devstack sudo[95502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:51:05 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [req-b4874b3e-591c-4b47-b2cb-d68e25e50bfb req-409aa20b-fb66-43bb-a3a3-174fd4076684 tempest-AttachVolumeShelveTestJSON-1587912764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:51:05 devstack sudo[95502]: pam_unix(sudo:session): session closed for user root
Jun 15 15:51:05 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5d80ea2f-51ce-436a-b841-d7963de24d2a tempest-VolumeQuotasAdminTestJSON-1088798833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-d7162501-3638-42bc-bea8-5ac43d4fdf06" returned: 0 in 0.739s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:51:05 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-5d80ea2f-51ce-436a-b841-d7963de24d2a tempest-VolumeQuotasAdminTestJSON-1088798833 None] <== create_volume: return (1807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 15:51:05 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-5d80ea2f-51ce-436a-b841-d7963de24d2a tempest-VolumeQuotasAdminTestJSON-1088798833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.809s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:51:05 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [req-b4874b3e-591c-4b47-b2cb-d68e25e50bfb req-409aa20b-fb66-43bb-a3a3-174fd4076684 tempest-AttachVolumeShelveTestJSON-1587912764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.148s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:51:05 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5d80ea2f-51ce-436a-b841-d7963de24d2a tempest-VolumeQuotasAdminTestJSON-1088798833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0da99dd5-9bcf-4e7a-ae25-8f26c989c4ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7162501-3638-42bc-bea8-5ac43d4fdf06', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:51:05 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5d80ea2f-51ce-436a-b841-d7963de24d2a tempest-VolumeQuotasAdminTestJSON-1088798833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (098cab35-a2a8-4aba-aac0-5c3b584c4ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:51:05 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8543989f-7c9a-46c4-b4f1-27c6f1b8fdf5]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:51:05 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-b4874b3e-591c-4b47-b2cb-d68e25e50bfb req-409aa20b-fb66-43bb-a3a3-174fd4076684 tempest-AttachVolumeShelveTestJSON-1587912764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-46b7eea4-131a-47a1-a9d9-ec414da9ee27 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:51:05 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-5d80ea2f-51ce-436a-b841-d7963de24d2a tempest-VolumeQuotasAdminTestJSON-1088798833 None] Volume volume-d7162501-3638-42bc-bea8-5ac43d4fdf06 (d7162501-3638-42bc-bea8-5ac43d4fdf06): created successfully
Jun 15 15:51:05 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5d80ea2f-51ce-436a-b841-d7963de24d2a tempest-VolumeQuotasAdminTestJSON-1088798833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (098cab35-a2a8-4aba-aac0-5c3b584c4ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:51:05 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5d80ea2f-51ce-436a-b841-d7963de24d2a tempest-VolumeQuotasAdminTestJSON-1088798833 None] Flow 'volume_create_manager' (41eceedc-2339-4be9-bb11-e7c4b7bb5201) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:51:05 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-5d80ea2f-51ce-436a-b841-d7963de24d2a tempest-VolumeQuotasAdminTestJSON-1088798833 None] Created volume successfully.
Jun 15 15:51:06 devstack sudo[95514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-46b7eea4-131a-47a1-a9d9-ec414da9ee27
Jun 15 15:51:06 devstack sudo[95514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:51:06 devstack sudo[95514]: pam_unix(sudo:session): session closed for user root
Jun 15 15:51:06 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-b4874b3e-591c-4b47-b2cb-d68e25e50bfb req-409aa20b-fb66-43bb-a3a3-174fd4076684 tempest-AttachVolumeShelveTestJSON-1587912764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-46b7eea4-131a-47a1-a9d9-ec414da9ee27" returned: 0 in 1.045s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:51:06 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [req-b4874b3e-591c-4b47-b2cb-d68e25e50bfb req-409aa20b-fb66-43bb-a3a3-174fd4076684 tempest-AttachVolumeShelveTestJSON-1587912764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.084s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:51:07 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [req-b4874b3e-591c-4b47-b2cb-d68e25e50bfb req-409aa20b-fb66-43bb-a3a3-174fd4076684 tempest-AttachVolumeShelveTestJSON-1587912764 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc', 'name': 'volume-46b7eea4-131a-47a1-a9d9-ec414da9ee27', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a10449bb-eec8-4781-ac3d-790adfa0571a', 'enforce_multipath': True} {{(pid=91863) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 15 15:51:07 devstack cinder-volume[91863]: INFO cinder.volume.manager [req-b4874b3e-591c-4b47-b2cb-d68e25e50bfb req-409aa20b-fb66-43bb-a3a3-174fd4076684 tempest-AttachVolumeShelveTestJSON-1587912764 None] attachment_update completed successfully.
Jun 15 15:51:07 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-d15f816a-1bf9-430f-ac93-137c432f1009 tempest-VolumeQuotasAdminTestJSON-283803885 None] Transfer volume completed successfully.
Jun 15 15:51:08 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ffc9f5a-00aa-4a8f-bed0-28ce590b102c tempest-ServerActionsTestOtherA-2064227610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 15:51:08 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6ffc9f5a-00aa-4a8f-bed0-28ce590b102c tempest-ServerActionsTestOtherA-2064227610 None] Flow 'volume_create_manager' (1ad03e64-6fdb-4b37-98f1-ded7a7b35413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:51:08 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6ffc9f5a-00aa-4a8f-bed0-28ce590b102c tempest-ServerActionsTestOtherA-2064227610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e665c683-8c16-4925-92e2-b17af739c9ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:51:08 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6ffc9f5a-00aa-4a8f-bed0-28ce590b102c tempest-ServerActionsTestOtherA-2064227610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e665c683-8c16-4925-92e2-b17af739c9ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:51:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-2067430098',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbe53393-aa09-4011-ac08-eaa2ec006039,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aab44c6381434938a125151c2e2508f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:51:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:51:08Z,use_quota=True,user_id='009e93494bd546e4b153ea8fd7fa8b95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:51:08 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6ffc9f5a-00aa-4a8f-bed0-28ce590b102c tempest-ServerActionsTestOtherA-2064227610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b29de194-e37b-4601-b2c5-1a2571c48fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:51:08 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6ffc9f5a-00aa-4a8f-bed0-28ce590b102c tempest-ServerActionsTestOtherA-2064227610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b29de194-e37b-4601-b2c5-1a2571c48fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:51:08 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6ffc9f5a-00aa-4a8f-bed0-28ce590b102c tempest-ServerActionsTestOtherA-2064227610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f78d5dc9-9fd5-4421-b5c7-ee7ce0829a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:51:08 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6ffc9f5a-00aa-4a8f-bed0-28ce590b102c tempest-ServerActionsTestOtherA-2064227610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f78d5dc9-9fd5-4421-b5c7-ee7ce0829a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbe53393-aa09-4011-ac08-eaa2ec006039', 'volume_name': 'volume-fbe53393-aa09-4011-ac08-eaa2ec006039', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:51:08 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6ffc9f5a-00aa-4a8f-bed0-28ce590b102c tempest-ServerActionsTestOtherA-2064227610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86b1a924-5af9-4098-b19b-1651dc5a690c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:51:08 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6ffc9f5a-00aa-4a8f-bed0-28ce590b102c tempest-ServerActionsTestOtherA-2064227610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86b1a924-5af9-4098-b19b-1651dc5a690c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:51:08 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6ffc9f5a-00aa-4a8f-bed0-28ce590b102c tempest-ServerActionsTestOtherA-2064227610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (681f1334-96f5-4d78-964e-5b90e62519f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:51:08 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-6ffc9f5a-00aa-4a8f-bed0-28ce590b102c tempest-ServerActionsTestOtherA-2064227610 None] Volume fbe53393-aa09-4011-ac08-eaa2ec006039: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbe53393-aa09-4011-ac08-eaa2ec006039', 'volume_size': 1}
Jun 15 15:51:08 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6ffc9f5a-00aa-4a8f-bed0-28ce590b102c tempest-ServerActionsTestOtherA-2064227610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:51:08 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6ffc9f5a-00aa-4a8f-bed0-28ce590b102c tempest-ServerActionsTestOtherA-2064227610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:51:08 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6ffc9f5a-00aa-4a8f-bed0-28ce590b102c tempest-ServerActionsTestOtherA-2064227610 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:51:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-2067430098',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbe53393-aa09-4011-ac08-eaa2ec006039,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aab44c6381434938a125151c2e2508f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:51:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:51:08Z,use_quota=True,user_id='009e93494bd546e4b153ea8fd7fa8b95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 15:51:08 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-6ffc9f5a-00aa-4a8f-bed0-28ce590b102c tempest-ServerActionsTestOtherA-2064227610 None] Creating volume fbe53393-aa09-4011-ac08-eaa2ec006039 {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 15:51:08 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6ffc9f5a-00aa-4a8f-bed0-28ce590b102c tempest-ServerActionsTestOtherA-2064227610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:51:08 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6ffc9f5a-00aa-4a8f-bed0-28ce590b102c tempest-ServerActionsTestOtherA-2064227610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:51:08 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6ffc9f5a-00aa-4a8f-bed0-28ce590b102c tempest-ServerActionsTestOtherA-2064227610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:51:08 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6ffc9f5a-00aa-4a8f-bed0-28ce590b102c tempest-ServerActionsTestOtherA-2064227610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:51:08 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6ffc9f5a-00aa-4a8f-bed0-28ce590b102c tempest-ServerActionsTestOtherA-2064227610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:51:08 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6ffc9f5a-00aa-4a8f-bed0-28ce590b102c tempest-ServerActionsTestOtherA-2064227610 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 15:51:08 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-6ffc9f5a-00aa-4a8f-bed0-28ce590b102c tempest-ServerActionsTestOtherA-2064227610 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 15:51:08 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6ffc9f5a-00aa-4a8f-bed0-28ce590b102c tempest-ServerActionsTestOtherA-2064227610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fbe53393-aa09-4011-ac08-eaa2ec006039 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:51:08 devstack sudo[95523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fbe53393-aa09-4011-ac08-eaa2ec006039 1073741824
Jun 15 15:51:08 devstack sudo[95523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:51:08 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-3a46e0b9-5d7a-49d0-8bca-bac70cde3fbf tempest-VolumeQuotasAdminTestJSON-681479869 None] Acquiring lock "cinder-d7162501-3638-42bc-bea8-5ac43d4fdf06-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:51:08 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-3a46e0b9-5d7a-49d0-8bca-bac70cde3fbf tempest-VolumeQuotasAdminTestJSON-681479869 None] Lock "cinder-d7162501-3638-42bc-bea8-5ac43d4fdf06-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:51:08 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-3a46e0b9-5d7a-49d0-8bca-bac70cde3fbf tempest-VolumeQuotasAdminTestJSON-681479869 None] Acquiring lock "cinder-quobyte-d7162501-3638-42bc-bea8-5ac43d4fdf06" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:51:08 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-3a46e0b9-5d7a-49d0-8bca-bac70cde3fbf tempest-VolumeQuotasAdminTestJSON-681479869 None] Lock "cinder-quobyte-d7162501-3638-42bc-bea8-5ac43d4fdf06" acquired by "delete_volume" :: waited 0.035s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:51:08 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[10eef748-dfb7-457f-ab3a-906378bfb97b]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:51:08 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3a46e0b9-5d7a-49d0-8bca-bac70cde3fbf tempest-VolumeQuotasAdminTestJSON-681479869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-d7162501-3638-42bc-bea8-5ac43d4fdf06 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:51:09 devstack sudo[95525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-d7162501-3638-42bc-bea8-5ac43d4fdf06
Jun 15 15:51:09 devstack sudo[95525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:51:09 devstack sudo[95523]: pam_unix(sudo:session): session closed for user root
Jun 15 15:51:09 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6ffc9f5a-00aa-4a8f-bed0-28ce590b102c tempest-ServerActionsTestOtherA-2064227610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fbe53393-aa09-4011-ac08-eaa2ec006039 1073741824" returned: 0 in 1.351s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:51:09 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6ffc9f5a-00aa-4a8f-bed0-28ce590b102c tempest-ServerActionsTestOtherA-2064227610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fbe53393-aa09-4011-ac08-eaa2ec006039 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:51:09 devstack sudo[95535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fbe53393-aa09-4011-ac08-eaa2ec006039
Jun 15 15:51:09 devstack sudo[95535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:51:09 devstack sudo[95525]: pam_unix(sudo:session): session closed for user root
Jun 15 15:51:09 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3a46e0b9-5d7a-49d0-8bca-bac70cde3fbf tempest-VolumeQuotasAdminTestJSON-681479869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-d7162501-3638-42bc-bea8-5ac43d4fdf06" returned: 0 in 1.202s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:51:09 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3a46e0b9-5d7a-49d0-8bca-bac70cde3fbf tempest-VolumeQuotasAdminTestJSON-681479869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-d7162501-3638-42bc-bea8-5ac43d4fdf06 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:51:10 devstack sudo[95537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-d7162501-3638-42bc-bea8-5ac43d4fdf06
Jun 15 15:51:10 devstack sudo[95537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:51:10 devstack sudo[95535]: pam_unix(sudo:session): session closed for user root
Jun 15 15:51:10 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6ffc9f5a-00aa-4a8f-bed0-28ce590b102c tempest-ServerActionsTestOtherA-2064227610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fbe53393-aa09-4011-ac08-eaa2ec006039" returned: 0 in 0.951s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:51:10 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6ffc9f5a-00aa-4a8f-bed0-28ce590b102c tempest-ServerActionsTestOtherA-2064227610 None] <== create_volume: return (2431ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 15:51:10 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6ffc9f5a-00aa-4a8f-bed0-28ce590b102c tempest-ServerActionsTestOtherA-2064227610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.441s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:51:10 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6ffc9f5a-00aa-4a8f-bed0-28ce590b102c tempest-ServerActionsTestOtherA-2064227610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (681f1334-96f5-4d78-964e-5b90e62519f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbe53393-aa09-4011-ac08-eaa2ec006039', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:51:10 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6ffc9f5a-00aa-4a8f-bed0-28ce590b102c tempest-ServerActionsTestOtherA-2064227610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f73c360-a3a1-4a8b-82bb-d595508ac00e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:51:10 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-6ffc9f5a-00aa-4a8f-bed0-28ce590b102c tempest-ServerActionsTestOtherA-2064227610 None] Volume volume-fbe53393-aa09-4011-ac08-eaa2ec006039 (fbe53393-aa09-4011-ac08-eaa2ec006039): created successfully
Jun 15 15:51:10 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6ffc9f5a-00aa-4a8f-bed0-28ce590b102c tempest-ServerActionsTestOtherA-2064227610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f73c360-a3a1-4a8b-82bb-d595508ac00e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:51:10 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6ffc9f5a-00aa-4a8f-bed0-28ce590b102c tempest-ServerActionsTestOtherA-2064227610 None] Flow 'volume_create_manager' (1ad03e64-6fdb-4b37-98f1-ded7a7b35413) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:51:10 devstack sudo[95537]: pam_unix(sudo:session): session closed for user root
Jun 15 15:51:10 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-6ffc9f5a-00aa-4a8f-bed0-28ce590b102c tempest-ServerActionsTestOtherA-2064227610 None] Created volume successfully.
Jun 15 15:51:10 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3a46e0b9-5d7a-49d0-8bca-bac70cde3fbf tempest-VolumeQuotasAdminTestJSON-681479869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-d7162501-3638-42bc-bea8-5ac43d4fdf06" returned: 0 in 0.991s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:51:10 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-3a46e0b9-5d7a-49d0-8bca-bac70cde3fbf tempest-VolumeQuotasAdminTestJSON-681479869 None] Lock "cinder-quobyte-d7162501-3638-42bc-bea8-5ac43d4fdf06" released by "delete_volume" :: held 2.266s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:51:11 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-3a46e0b9-5d7a-49d0-8bca-bac70cde3fbf tempest-VolumeQuotasAdminTestJSON-681479869 None] Created reservations ['5058949c-ecb6-47d6-92c6-22b0a907d022', '84028452-8e4a-47a6-bcc4-b2d73b49f981', 'edab7c68-38c7-4ad8-befe-597f376d1a4f', '070a50eb-1143-4490-b26a-56294b853586'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:51:11 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-3a46e0b9-5d7a-49d0-8bca-bac70cde3fbf tempest-VolumeQuotasAdminTestJSON-681479869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:51:11 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-3a46e0b9-5d7a-49d0-8bca-bac70cde3fbf tempest-VolumeQuotasAdminTestJSON-681479869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:51:11 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-3a46e0b9-5d7a-49d0-8bca-bac70cde3fbf tempest-VolumeQuotasAdminTestJSON-681479869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:51:11 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-3a46e0b9-5d7a-49d0-8bca-bac70cde3fbf tempest-VolumeQuotasAdminTestJSON-681479869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:51:11 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-3a46e0b9-5d7a-49d0-8bca-bac70cde3fbf tempest-VolumeQuotasAdminTestJSON-681479869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:51:11 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3a46e0b9-5d7a-49d0-8bca-bac70cde3fbf tempest-VolumeQuotasAdminTestJSON-681479869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:51:11 devstack sudo[95541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:51:11 devstack sudo[95541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:51:11 devstack sudo[95541]: pam_unix(sudo:session): session closed for user root
Jun 15 15:51:11 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3a46e0b9-5d7a-49d0-8bca-bac70cde3fbf tempest-VolumeQuotasAdminTestJSON-681479869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.719s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:51:11 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-3a46e0b9-5d7a-49d0-8bca-bac70cde3fbf tempest-VolumeQuotasAdminTestJSON-681479869 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:51:11 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-3a46e0b9-5d7a-49d0-8bca-bac70cde3fbf tempest-VolumeQuotasAdminTestJSON-681479869 None] Deleted volume successfully.
Jun 15 15:51:11 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-3a46e0b9-5d7a-49d0-8bca-bac70cde3fbf tempest-VolumeQuotasAdminTestJSON-681479869 None] Lock "cinder-d7162501-3638-42bc-bea8-5ac43d4fdf06-delete_volume" released by "delete_volume" :: held 3.266s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:51:20 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9a9d0b7-e356-47f1-a3db-dc11d9360241 tempest-VolumesServicesTestJSON-636214788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 15:51:20 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e9a9d0b7-e356-47f1-a3db-dc11d9360241 tempest-VolumesServicesTestJSON-636214788 None] Flow 'volume_create_manager' (a92d81cd-db68-4447-819e-8acbcc064cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:51:20 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e9a9d0b7-e356-47f1-a3db-dc11d9360241 tempest-VolumesServicesTestJSON-636214788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f8a6d75-d94f-4eb5-baa8-e1cba5de9f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:51:20 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e9a9d0b7-e356-47f1-a3db-dc11d9360241 tempest-VolumesServicesTestJSON-636214788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f8a6d75-d94f-4eb5-baa8-e1cba5de9f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:51:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1083542957',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4cb73ec-7243-4352-932a-dd15617a59f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='438dc671fd3848a1ac75c902621be969',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:51:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:51:20Z,use_quota=True,user_id='55ce7f5f7010470ab681637329b4a796',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:51:20 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e9a9d0b7-e356-47f1-a3db-dc11d9360241 tempest-VolumesServicesTestJSON-636214788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0dea047-fe6e-4323-8061-56a0e47a13c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:51:20 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e9a9d0b7-e356-47f1-a3db-dc11d9360241 tempest-VolumesServicesTestJSON-636214788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0dea047-fe6e-4323-8061-56a0e47a13c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:51:20 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e9a9d0b7-e356-47f1-a3db-dc11d9360241 tempest-VolumesServicesTestJSON-636214788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e900dc0-d4ea-47bf-a362-452c37638c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:51:20 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e9a9d0b7-e356-47f1-a3db-dc11d9360241 tempest-VolumesServicesTestJSON-636214788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e900dc0-d4ea-47bf-a362-452c37638c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4cb73ec-7243-4352-932a-dd15617a59f0', 'volume_name': 'volume-a4cb73ec-7243-4352-932a-dd15617a59f0', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:51:20 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e9a9d0b7-e356-47f1-a3db-dc11d9360241 tempest-VolumesServicesTestJSON-636214788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da9ce3f2-f4be-450d-9f9f-0615dd054b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:51:20 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e9a9d0b7-e356-47f1-a3db-dc11d9360241 tempest-VolumesServicesTestJSON-636214788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da9ce3f2-f4be-450d-9f9f-0615dd054b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:51:20 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e9a9d0b7-e356-47f1-a3db-dc11d9360241 tempest-VolumesServicesTestJSON-636214788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fa055f6-d78a-42af-9c02-40f05713374f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:51:20 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-e9a9d0b7-e356-47f1-a3db-dc11d9360241 tempest-VolumesServicesTestJSON-636214788 None] Volume a4cb73ec-7243-4352-932a-dd15617a59f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4cb73ec-7243-4352-932a-dd15617a59f0', 'volume_size': 1}
Jun 15 15:51:20 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-e9a9d0b7-e356-47f1-a3db-dc11d9360241 tempest-VolumesServicesTestJSON-636214788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:51:20 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-e9a9d0b7-e356-47f1-a3db-dc11d9360241 tempest-VolumesServicesTestJSON-636214788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:51:20 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-e9a9d0b7-e356-47f1-a3db-dc11d9360241 tempest-VolumesServicesTestJSON-636214788 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:51:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1083542957',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4cb73ec-7243-4352-932a-dd15617a59f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='438dc671fd3848a1ac75c902621be969',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:51:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:51:20Z,use_quota=True,user_id='55ce7f5f7010470ab681637329b4a796',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 15:51:20 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-e9a9d0b7-e356-47f1-a3db-dc11d9360241 tempest-VolumesServicesTestJSON-636214788 None] Creating volume a4cb73ec-7243-4352-932a-dd15617a59f0 {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 15:51:20 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-e9a9d0b7-e356-47f1-a3db-dc11d9360241 tempest-VolumesServicesTestJSON-636214788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:51:20 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-e9a9d0b7-e356-47f1-a3db-dc11d9360241 tempest-VolumesServicesTestJSON-636214788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:51:20 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-e9a9d0b7-e356-47f1-a3db-dc11d9360241 tempest-VolumesServicesTestJSON-636214788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:51:20 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-e9a9d0b7-e356-47f1-a3db-dc11d9360241 tempest-VolumesServicesTestJSON-636214788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:51:20 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-e9a9d0b7-e356-47f1-a3db-dc11d9360241 tempest-VolumesServicesTestJSON-636214788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:51:20 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-e9a9d0b7-e356-47f1-a3db-dc11d9360241 tempest-VolumesServicesTestJSON-636214788 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 15:51:20 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-e9a9d0b7-e356-47f1-a3db-dc11d9360241 tempest-VolumesServicesTestJSON-636214788 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 15:51:20 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-e9a9d0b7-e356-47f1-a3db-dc11d9360241 tempest-VolumesServicesTestJSON-636214788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a4cb73ec-7243-4352-932a-dd15617a59f0 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:51:20 devstack sudo[95615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a4cb73ec-7243-4352-932a-dd15617a59f0 1073741824
Jun 15 15:51:20 devstack sudo[95615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:51:21 devstack sudo[95615]: pam_unix(sudo:session): session closed for user root
Jun 15 15:51:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-e9a9d0b7-e356-47f1-a3db-dc11d9360241 tempest-VolumesServicesTestJSON-636214788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a4cb73ec-7243-4352-932a-dd15617a59f0 1073741824" returned: 0 in 0.968s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:51:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-e9a9d0b7-e356-47f1-a3db-dc11d9360241 tempest-VolumesServicesTestJSON-636214788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a4cb73ec-7243-4352-932a-dd15617a59f0 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:51:21 devstack sudo[95700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a4cb73ec-7243-4352-932a-dd15617a59f0
Jun 15 15:51:21 devstack sudo[95700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:51:21 devstack sudo[95700]: pam_unix(sudo:session): session closed for user root
Jun 15 15:51:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-e9a9d0b7-e356-47f1-a3db-dc11d9360241 tempest-VolumesServicesTestJSON-636214788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a4cb73ec-7243-4352-932a-dd15617a59f0" returned: 0 in 0.593s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:51:21 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-e9a9d0b7-e356-47f1-a3db-dc11d9360241 tempest-VolumesServicesTestJSON-636214788 None] <== create_volume: return (1638ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 15:51:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-e9a9d0b7-e356-47f1-a3db-dc11d9360241 tempest-VolumesServicesTestJSON-636214788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.641s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:51:21 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e9a9d0b7-e356-47f1-a3db-dc11d9360241 tempest-VolumesServicesTestJSON-636214788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fa055f6-d78a-42af-9c02-40f05713374f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4cb73ec-7243-4352-932a-dd15617a59f0', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:51:21 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e9a9d0b7-e356-47f1-a3db-dc11d9360241 tempest-VolumesServicesTestJSON-636214788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6278a45b-7472-4fee-978b-836bb2592209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:51:21 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-e9a9d0b7-e356-47f1-a3db-dc11d9360241 tempest-VolumesServicesTestJSON-636214788 None] Volume volume-a4cb73ec-7243-4352-932a-dd15617a59f0 (a4cb73ec-7243-4352-932a-dd15617a59f0): created successfully
Jun 15 15:51:21 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e9a9d0b7-e356-47f1-a3db-dc11d9360241 tempest-VolumesServicesTestJSON-636214788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6278a45b-7472-4fee-978b-836bb2592209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:51:21 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e9a9d0b7-e356-47f1-a3db-dc11d9360241 tempest-VolumesServicesTestJSON-636214788 None] Flow 'volume_create_manager' (a92d81cd-db68-4447-819e-8acbcc064cb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:51:21 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-e9a9d0b7-e356-47f1-a3db-dc11d9360241 tempest-VolumesServicesTestJSON-636214788 None] Created volume successfully.
Jun 15 15:51:22 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-3cefbf36-977c-46ff-9b3e-7c1c45441fca tempest-VolumesServicesTestJSON-636214788 None] Acquiring lock "cinder-a4cb73ec-7243-4352-932a-dd15617a59f0-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:51:22 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-3cefbf36-977c-46ff-9b3e-7c1c45441fca tempest-VolumesServicesTestJSON-636214788 None] Lock "cinder-a4cb73ec-7243-4352-932a-dd15617a59f0-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:51:22 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-3cefbf36-977c-46ff-9b3e-7c1c45441fca tempest-VolumesServicesTestJSON-636214788 None] Acquiring lock "cinder-quobyte-a4cb73ec-7243-4352-932a-dd15617a59f0" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:51:22 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-3cefbf36-977c-46ff-9b3e-7c1c45441fca tempest-VolumesServicesTestJSON-636214788 None] Lock "cinder-quobyte-a4cb73ec-7243-4352-932a-dd15617a59f0" acquired by "delete_volume" :: waited 0.015s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:51:22 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[78182149-1355-481a-ab4c-aa982c26ad22]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:51:22 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3cefbf36-977c-46ff-9b3e-7c1c45441fca tempest-VolumesServicesTestJSON-636214788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a4cb73ec-7243-4352-932a-dd15617a59f0 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:51:22 devstack sudo[95720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a4cb73ec-7243-4352-932a-dd15617a59f0
Jun 15 15:51:22 devstack sudo[95720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:51:23 devstack sudo[95720]: pam_unix(sudo:session): session closed for user root
Jun 15 15:51:23 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3cefbf36-977c-46ff-9b3e-7c1c45441fca tempest-VolumesServicesTestJSON-636214788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a4cb73ec-7243-4352-932a-dd15617a59f0" returned: 0 in 0.710s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:51:23 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3cefbf36-977c-46ff-9b3e-7c1c45441fca tempest-VolumesServicesTestJSON-636214788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a4cb73ec-7243-4352-932a-dd15617a59f0 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:51:23 devstack sudo[95725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a4cb73ec-7243-4352-932a-dd15617a59f0
Jun 15 15:51:23 devstack sudo[95725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:51:23 devstack sudo[95725]: pam_unix(sudo:session): session closed for user root
Jun 15 15:51:23 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3cefbf36-977c-46ff-9b3e-7c1c45441fca tempest-VolumesServicesTestJSON-636214788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a4cb73ec-7243-4352-932a-dd15617a59f0" returned: 0 in 0.583s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:51:23 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-3cefbf36-977c-46ff-9b3e-7c1c45441fca tempest-VolumesServicesTestJSON-636214788 None] Lock "cinder-quobyte-a4cb73ec-7243-4352-932a-dd15617a59f0" released by "delete_volume" :: held 1.332s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:51:23 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-3cefbf36-977c-46ff-9b3e-7c1c45441fca tempest-VolumesServicesTestJSON-636214788 None] Created reservations ['3b5a41c2-eb26-4016-a61d-56dcf3196b0a', '430435cd-7bc9-4247-9970-724d13731c5d', 'ba1aae98-ed15-4d43-8a72-e256efb6f67b', 'e090d15e-bdc8-4ab4-9dbd-6a86d26b13ec'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:51:24 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-3cefbf36-977c-46ff-9b3e-7c1c45441fca tempest-VolumesServicesTestJSON-636214788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:51:24 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-3cefbf36-977c-46ff-9b3e-7c1c45441fca tempest-VolumesServicesTestJSON-636214788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:51:24 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-3cefbf36-977c-46ff-9b3e-7c1c45441fca tempest-VolumesServicesTestJSON-636214788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:51:24 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-3cefbf36-977c-46ff-9b3e-7c1c45441fca tempest-VolumesServicesTestJSON-636214788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:51:24 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-3cefbf36-977c-46ff-9b3e-7c1c45441fca tempest-VolumesServicesTestJSON-636214788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:51:24 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3cefbf36-977c-46ff-9b3e-7c1c45441fca tempest-VolumesServicesTestJSON-636214788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:51:24 devstack sudo[96069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:51:24 devstack sudo[96069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:51:25 devstack sudo[96069]: pam_unix(sudo:session): session closed for user root
Jun 15 15:51:25 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3cefbf36-977c-46ff-9b3e-7c1c45441fca tempest-VolumesServicesTestJSON-636214788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 1.172s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:51:25 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-3cefbf36-977c-46ff-9b3e-7c1c45441fca tempest-VolumesServicesTestJSON-636214788 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:51:25 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-3cefbf36-977c-46ff-9b3e-7c1c45441fca tempest-VolumesServicesTestJSON-636214788 None] Deleted volume successfully.
Jun 15 15:51:25 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-3cefbf36-977c-46ff-9b3e-7c1c45441fca tempest-VolumesServicesTestJSON-636214788 None] Lock "cinder-a4cb73ec-7243-4352-932a-dd15617a59f0-delete_volume" released by "delete_volume" :: held 2.856s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:51:29 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-205401b4-6296-4d9b-b105-a92643e7d34c tempest-AttachVolumeNegativeTest-1849283913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 15:51:29 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-205401b4-6296-4d9b-b105-a92643e7d34c tempest-AttachVolumeNegativeTest-1849283913 None] Flow 'volume_create_manager' (23d60ab0-89e4-48bd-9031-71ec7121594c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:51:29 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-205401b4-6296-4d9b-b105-a92643e7d34c tempest-AttachVolumeNegativeTest-1849283913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7875e894-c3c6-44c4-b06e-d1d3cee08451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:51:29 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-205401b4-6296-4d9b-b105-a92643e7d34c tempest-AttachVolumeNegativeTest-1849283913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7875e894-c3c6-44c4-b06e-d1d3cee08451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:51:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1352352488',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e035bf0-f3e8-49ce-879b-cb9e64577e3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3be7c3abe8246a2a9f68c6f49a031c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:51:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:51:29Z,use_quota=True,user_id='2ec357fde37a4761a6fc47aa552d9567',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:51:29 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-205401b4-6296-4d9b-b105-a92643e7d34c tempest-AttachVolumeNegativeTest-1849283913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5cbd392-12d1-49bd-a057-8e108c2388e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:51:29 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-205401b4-6296-4d9b-b105-a92643e7d34c tempest-AttachVolumeNegativeTest-1849283913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5cbd392-12d1-49bd-a057-8e108c2388e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:51:29 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-205401b4-6296-4d9b-b105-a92643e7d34c tempest-AttachVolumeNegativeTest-1849283913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbd13044-3ee9-40a5-bb51-3f894f618190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:51:29 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-205401b4-6296-4d9b-b105-a92643e7d34c tempest-AttachVolumeNegativeTest-1849283913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbd13044-3ee9-40a5-bb51-3f894f618190) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e035bf0-f3e8-49ce-879b-cb9e64577e3f', 'volume_name': 'volume-3e035bf0-f3e8-49ce-879b-cb9e64577e3f', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:51:29 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-205401b4-6296-4d9b-b105-a92643e7d34c tempest-AttachVolumeNegativeTest-1849283913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99dabf13-6708-42ce-ab65-dac1b81cc608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:51:29 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-205401b4-6296-4d9b-b105-a92643e7d34c tempest-AttachVolumeNegativeTest-1849283913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99dabf13-6708-42ce-ab65-dac1b81cc608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:51:29 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-205401b4-6296-4d9b-b105-a92643e7d34c tempest-AttachVolumeNegativeTest-1849283913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d48901e9-93ce-4dd7-8861-0206bbcff1b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:51:29 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-205401b4-6296-4d9b-b105-a92643e7d34c tempest-AttachVolumeNegativeTest-1849283913 None] Volume 3e035bf0-f3e8-49ce-879b-cb9e64577e3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e035bf0-f3e8-49ce-879b-cb9e64577e3f', 'volume_size': 1}
Jun 15 15:51:29 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-205401b4-6296-4d9b-b105-a92643e7d34c tempest-AttachVolumeNegativeTest-1849283913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:51:29 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-205401b4-6296-4d9b-b105-a92643e7d34c tempest-AttachVolumeNegativeTest-1849283913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:51:29 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-205401b4-6296-4d9b-b105-a92643e7d34c tempest-AttachVolumeNegativeTest-1849283913 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:51:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1352352488',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e035bf0-f3e8-49ce-879b-cb9e64577e3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3be7c3abe8246a2a9f68c6f49a031c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:51:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:51:29Z,use_quota=True,user_id='2ec357fde37a4761a6fc47aa552d9567',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 15:51:29 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-205401b4-6296-4d9b-b105-a92643e7d34c tempest-AttachVolumeNegativeTest-1849283913 None] Creating volume 3e035bf0-f3e8-49ce-879b-cb9e64577e3f {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 15:51:29 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-205401b4-6296-4d9b-b105-a92643e7d34c tempest-AttachVolumeNegativeTest-1849283913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:51:29 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-205401b4-6296-4d9b-b105-a92643e7d34c tempest-AttachVolumeNegativeTest-1849283913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:51:29 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-205401b4-6296-4d9b-b105-a92643e7d34c tempest-AttachVolumeNegativeTest-1849283913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:51:29 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-205401b4-6296-4d9b-b105-a92643e7d34c tempest-AttachVolumeNegativeTest-1849283913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:51:29 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-205401b4-6296-4d9b-b105-a92643e7d34c tempest-AttachVolumeNegativeTest-1849283913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:51:29 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-205401b4-6296-4d9b-b105-a92643e7d34c tempest-AttachVolumeNegativeTest-1849283913 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 15:51:29 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-205401b4-6296-4d9b-b105-a92643e7d34c tempest-AttachVolumeNegativeTest-1849283913 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 15:51:29 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-205401b4-6296-4d9b-b105-a92643e7d34c tempest-AttachVolumeNegativeTest-1849283913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3e035bf0-f3e8-49ce-879b-cb9e64577e3f 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:51:29 devstack sudo[96205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3e035bf0-f3e8-49ce-879b-cb9e64577e3f 1073741824
Jun 15 15:51:29 devstack sudo[96205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:51:30 devstack sudo[96205]: pam_unix(sudo:session): session closed for user root
Jun 15 15:51:30 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-205401b4-6296-4d9b-b105-a92643e7d34c tempest-AttachVolumeNegativeTest-1849283913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3e035bf0-f3e8-49ce-879b-cb9e64577e3f 1073741824" returned: 0 in 1.366s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:51:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-205401b4-6296-4d9b-b105-a92643e7d34c tempest-AttachVolumeNegativeTest-1849283913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3e035bf0-f3e8-49ce-879b-cb9e64577e3f {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:51:31 devstack sudo[96211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3e035bf0-f3e8-49ce-879b-cb9e64577e3f
Jun 15 15:51:31 devstack sudo[96211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:51:31 devstack cinder-volume[91863]: DEBUG oslo_service.periodic_task [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 15:51:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:51:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:51:31 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:51:31 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:51:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:51:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:51:31 devstack sudo[96213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:51:31 devstack sudo[96213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:51:32 devstack sudo[96211]: pam_unix(sudo:session): session closed for user root
Jun 15 15:51:32 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-205401b4-6296-4d9b-b105-a92643e7d34c tempest-AttachVolumeNegativeTest-1849283913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3e035bf0-f3e8-49ce-879b-cb9e64577e3f" returned: 0 in 1.049s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:51:32 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-205401b4-6296-4d9b-b105-a92643e7d34c tempest-AttachVolumeNegativeTest-1849283913 None] <== create_volume: return (2497ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 15:51:32 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-205401b4-6296-4d9b-b105-a92643e7d34c tempest-AttachVolumeNegativeTest-1849283913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.506s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:51:32 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-205401b4-6296-4d9b-b105-a92643e7d34c tempest-AttachVolumeNegativeTest-1849283913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d48901e9-93ce-4dd7-8861-0206bbcff1b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e035bf0-f3e8-49ce-879b-cb9e64577e3f', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:51:32 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-205401b4-6296-4d9b-b105-a92643e7d34c tempest-AttachVolumeNegativeTest-1849283913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2707fdad-bacf-40ec-a1a0-8b4b8c0501b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:51:32 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-205401b4-6296-4d9b-b105-a92643e7d34c tempest-AttachVolumeNegativeTest-1849283913 None] Volume volume-3e035bf0-f3e8-49ce-879b-cb9e64577e3f (3e035bf0-f3e8-49ce-879b-cb9e64577e3f): created successfully
Jun 15 15:51:32 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-205401b4-6296-4d9b-b105-a92643e7d34c tempest-AttachVolumeNegativeTest-1849283913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2707fdad-bacf-40ec-a1a0-8b4b8c0501b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:51:32 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-205401b4-6296-4d9b-b105-a92643e7d34c tempest-AttachVolumeNegativeTest-1849283913 None] Flow 'volume_create_manager' (23d60ab0-89e4-48bd-9031-71ec7121594c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:51:32 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-205401b4-6296-4d9b-b105-a92643e7d34c tempest-AttachVolumeNegativeTest-1849283913 None] Created volume successfully.
Jun 15 15:51:32 devstack sudo[96213]: pam_unix(sudo:session): session closed for user root
Jun 15 15:51:32 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 1.522s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:51:32 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:51:32 devstack cinder-volume[91863]: DEBUG oslo_service.periodic_task [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Running periodic task VolumeManager._thread_info {{(pid=91863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 15:51:32 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] thread count: 8 {{(pid=91863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 15 15:51:32 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] thread info: [<_MainThread(MainThread, started 131088232640640)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131088122704576)>, <Thread(Thread-3 (stat_writer), started daemon 131088123058112)>, <Thread(Rabbit-heartbeat, started daemon 131088121268864)>, <Thread(Thread-5 (_runner), started daemon 131088121904192)>, <Thread(Thread-7 (_runner), started daemon 131088122037248)>, <Thread(fd_logger, started daemon 131088119630784)>, <Thread(privsep_reader, started daemon 131088119781440)>] {{(pid=91863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 15 15:51:36 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [req-37294e42-2eb1-491a-955d-07881803694d req-5fc820e5-903b-43f3-aea2-b275c48136f0 tempest-AttachVolumeNegativeTest-1849283913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:51:36 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [req-37294e42-2eb1-491a-955d-07881803694d req-5fc820e5-903b-43f3-aea2-b275c48136f0 tempest-AttachVolumeNegativeTest-1849283913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:51:36 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a72b4a-9875-4a5f-85fe-72d7e264e5e7]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:51:36 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-37294e42-2eb1-491a-955d-07881803694d req-5fc820e5-903b-43f3-aea2-b275c48136f0 tempest-AttachVolumeNegativeTest-1849283913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3e035bf0-f3e8-49ce-879b-cb9e64577e3f {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:51:36 devstack sudo[96228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3e035bf0-f3e8-49ce-879b-cb9e64577e3f
Jun 15 15:51:36 devstack sudo[96228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:51:37 devstack sudo[96228]: pam_unix(sudo:session): session closed for user root
Jun 15 15:51:37 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-37294e42-2eb1-491a-955d-07881803694d req-5fc820e5-903b-43f3-aea2-b275c48136f0 tempest-AttachVolumeNegativeTest-1849283913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3e035bf0-f3e8-49ce-879b-cb9e64577e3f" returned: 0 in 0.941s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:51:37 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [req-37294e42-2eb1-491a-955d-07881803694d req-5fc820e5-903b-43f3-aea2-b275c48136f0 tempest-AttachVolumeNegativeTest-1849283913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.989s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:51:37 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [req-37294e42-2eb1-491a-955d-07881803694d req-5fc820e5-903b-43f3-aea2-b275c48136f0 tempest-AttachVolumeNegativeTest-1849283913 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc', 'name': 'volume-3e035bf0-f3e8-49ce-879b-cb9e64577e3f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3b6e1691-bd88-4cf0-a360-8a65427f03a6', 'enforce_multipath': True} {{(pid=91863) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 15 15:51:37 devstack cinder-volume[91863]: INFO cinder.volume.manager [req-37294e42-2eb1-491a-955d-07881803694d req-5fc820e5-903b-43f3-aea2-b275c48136f0 tempest-AttachVolumeNegativeTest-1849283913 None] attachment_update completed successfully.
Jun 15 15:51:47 devstack cinder-volume[91863]: DEBUG dbcounter [-] [91863] Writing DB stats cinder:SELECT=41,cinder:INSERT=11,cinder:UPDATE=34,cinder:DELETE=5 {{(pid=91863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 15:51:47 devstack cinder-volume[91863]: DEBUG dbcounter [-] [91863] Writing DB stats cinder:SELECT=33,cinder:UPDATE=51,cinder:INSERT=6,cinder:DELETE=3 {{(pid=91863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 15:51:51 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed4b8b2d-4a2c-435e-b33d-7bf74120b80a tempest-VolumesImageMetadata-1561311336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 15:51:51 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-ed4b8b2d-4a2c-435e-b33d-7bf74120b80a tempest-VolumesImageMetadata-1561311336 None] Flow 'volume_create_manager' (e68e9009-45fd-4fb3-af75-624f04a58391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:51:51 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-ed4b8b2d-4a2c-435e-b33d-7bf74120b80a tempest-VolumesImageMetadata-1561311336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f396c7db-c05d-4f91-a523-17ab613b07fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:51:51 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-ed4b8b2d-4a2c-435e-b33d-7bf74120b80a tempest-VolumesImageMetadata-1561311336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f396c7db-c05d-4f91-a523-17ab613b07fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:51:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1636537748',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e5606d0-54c9-47e1-a2a1-83ca17bf5fe2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c04c904b94464ad6bcc21b5250aba85c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:51:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:51:51Z,use_quota=True,user_id='c6416e067ab74c8bba54876f7afa460c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:51:51 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-ed4b8b2d-4a2c-435e-b33d-7bf74120b80a tempest-VolumesImageMetadata-1561311336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcfd9366-a84f-4bac-829a-c5ad012d2777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:51:51 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-ed4b8b2d-4a2c-435e-b33d-7bf74120b80a tempest-VolumesImageMetadata-1561311336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcfd9366-a84f-4bac-829a-c5ad012d2777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:51:51 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-ed4b8b2d-4a2c-435e-b33d-7bf74120b80a tempest-VolumesImageMetadata-1561311336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ddd7757-10a3-49f8-9f62-d12367840b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:51:51 devstack cinder-volume[91863]: DEBUG cinder.image.glance [None req-ed4b8b2d-4a2c-435e-b33d-7bf74120b80a tempest-VolumesImageMetadata-1561311336 None] Creating Keystone auth plugin from conf {{(pid=91863) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 15 15:51:51 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-ed4b8b2d-4a2c-435e-b33d-7bf74120b80a tempest-VolumesImageMetadata-1561311336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ddd7757-10a3-49f8-9f62-d12367840b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0e5606d0-54c9-47e1-a2a1-83ca17bf5fe2', 'volume_name': 'volume-0e5606d0-54c9-47e1-a2a1-83ca17bf5fe2', 'volume_size': 1, 'image_id': '43adaed4-5eec-483a-aa2b-0818266a94f1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/43adaed4-5eec-483a-aa2b-0818266a94f1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '601536f092c54cdc9ee754c7b1abc241', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '43adaed4-5eec-483a-aa2b-0818266a94f1', 'created_at': datetime.datetime(2026, 6, 15, 13, 42, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 13, 42, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/43adaed4-5eec-483a-aa2b-0818266a94f1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x773954806fc0>}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:51:51 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-ed4b8b2d-4a2c-435e-b33d-7bf74120b80a tempest-VolumesImageMetadata-1561311336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb824e81-3a56-46e6-869f-4ea0204938a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:51:51 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-ed4b8b2d-4a2c-435e-b33d-7bf74120b80a tempest-VolumesImageMetadata-1561311336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb824e81-3a56-46e6-869f-4ea0204938a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:51:51 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-ed4b8b2d-4a2c-435e-b33d-7bf74120b80a tempest-VolumesImageMetadata-1561311336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76452a94-33cf-4b6f-8600-58a6c6d5d8a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:51:51 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-ed4b8b2d-4a2c-435e-b33d-7bf74120b80a tempest-VolumesImageMetadata-1561311336 None] Volume 0e5606d0-54c9-47e1-a2a1-83ca17bf5fe2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0e5606d0-54c9-47e1-a2a1-83ca17bf5fe2', 'volume_size': 1, 'image_id': '43adaed4-5eec-483a-aa2b-0818266a94f1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/43adaed4-5eec-483a-aa2b-0818266a94f1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '601536f092c54cdc9ee754c7b1abc241', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '43adaed4-5eec-483a-aa2b-0818266a94f1', 'created_at': datetime.datetime(2026, 6, 15, 13, 42, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 13, 42, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/43adaed4-5eec-483a-aa2b-0818266a94f1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x773954806fc0>}
Jun 15 15:51:51 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed4b8b2d-4a2c-435e-b33d-7bf74120b80a tempest-VolumesImageMetadata-1561311336 None] Trying to clone 0e5606d0-54c9-47e1-a2a1-83ca17bf5fe2 from image 43adaed4-5eec-483a-aa2b-0818266a94f1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/43adaed4-5eec-483a-aa2b-0818266a94f1', 'metadata': {}}]). {{(pid=91863) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jun 15 15:51:51 devstack cinder-volume[91863]: DEBUG cinder.image.image_utils [None req-ed4b8b2d-4a2c-435e-b33d-7bf74120b80a tempest-VolumesImageMetadata-1561311336 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_43adaed4-5eec-483a-aa2b-0818266a94f1_ou8e8firdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=91863) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 15 15:51:51 devstack cinder-volume[91863]: INFO cinder.image.image_utils [None req-ed4b8b2d-4a2c-435e-b33d-7bf74120b80a tempest-VolumesImageMetadata-1561311336 None] Image download 20.69 MB at 20.69 MB/s
Jun 15 15:51:52 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[603f0eb9-3445-4366-ab25-44a4f8fe8ab4]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:51:52 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ed4b8b2d-4a2c-435e-b33d-7bf74120b80a tempest-VolumesImageMetadata-1561311336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_43adaed4-5eec-483a-aa2b-0818266a94f1_ou8e8firdevstack@QuobyteHD {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:51:52 devstack sudo[96317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_43adaed4-5eec-483a-aa2b-0818266a94f1_ou8e8firdevstack@QuobyteHD
Jun 15 15:51:52 devstack sudo[96317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:51:52 devstack sudo[96317]: pam_unix(sudo:session): session closed for user root
Jun 15 15:51:52 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ed4b8b2d-4a2c-435e-b33d-7bf74120b80a tempest-VolumesImageMetadata-1561311336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_43adaed4-5eec-483a-aa2b-0818266a94f1_ou8e8firdevstack@QuobyteHD" returned: 0 in 0.766s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:51:52 devstack cinder-volume[91863]: DEBUG cinder.image.image_utils [None req-ed4b8b2d-4a2c-435e-b33d-7bf74120b80a tempest-VolumesImageMetadata-1561311336 None] Temporary image 43adaed4-5eec-483a-aa2b-0818266a94f1 is fetched for user c6416e067ab74c8bba54876f7afa460c. {{(pid=91863) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 15 15:51:52 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe07d1c2-e0b0-4cfe-ae6e-d72e4aa3a1d8]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:51:52 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ed4b8b2d-4a2c-435e-b33d-7bf74120b80a tempest-VolumesImageMetadata-1561311336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_43adaed4-5eec-483a-aa2b-0818266a94f1_ou8e8firdevstack@QuobyteHD {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:51:52 devstack sudo[96345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_43adaed4-5eec-483a-aa2b-0818266a94f1_ou8e8firdevstack@QuobyteHD
Jun 15 15:51:52 devstack sudo[96345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:51:53 devstack sudo[96345]: pam_unix(sudo:session): session closed for user root
Jun 15 15:51:53 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ed4b8b2d-4a2c-435e-b33d-7bf74120b80a tempest-VolumesImageMetadata-1561311336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_43adaed4-5eec-483a-aa2b-0818266a94f1_ou8e8firdevstack@QuobyteHD" returned: 0 in 0.685s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:51:53 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-ed4b8b2d-4a2c-435e-b33d-7bf74120b80a tempest-VolumesImageMetadata-1561311336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:51:53 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-ed4b8b2d-4a2c-435e-b33d-7bf74120b80a tempest-VolumesImageMetadata-1561311336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:51:53 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-ed4b8b2d-4a2c-435e-b33d-7bf74120b80a tempest-VolumesImageMetadata-1561311336 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:51:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1636537748',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e5606d0-54c9-47e1-a2a1-83ca17bf5fe2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c04c904b94464ad6bcc21b5250aba85c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:51:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:51:51Z,use_quota=True,user_id='c6416e067ab74c8bba54876f7afa460c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 15:51:53 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-ed4b8b2d-4a2c-435e-b33d-7bf74120b80a tempest-VolumesImageMetadata-1561311336 None] Creating volume 0e5606d0-54c9-47e1-a2a1-83ca17bf5fe2 {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 15:51:53 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-ed4b8b2d-4a2c-435e-b33d-7bf74120b80a tempest-VolumesImageMetadata-1561311336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:51:53 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-ed4b8b2d-4a2c-435e-b33d-7bf74120b80a tempest-VolumesImageMetadata-1561311336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:51:53 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-ed4b8b2d-4a2c-435e-b33d-7bf74120b80a tempest-VolumesImageMetadata-1561311336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:51:53 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-ed4b8b2d-4a2c-435e-b33d-7bf74120b80a tempest-VolumesImageMetadata-1561311336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:51:53 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-ed4b8b2d-4a2c-435e-b33d-7bf74120b80a tempest-VolumesImageMetadata-1561311336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:51:53 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-ed4b8b2d-4a2c-435e-b33d-7bf74120b80a tempest-VolumesImageMetadata-1561311336 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 15:51:53 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-ed4b8b2d-4a2c-435e-b33d-7bf74120b80a tempest-VolumesImageMetadata-1561311336 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 15:51:53 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ed4b8b2d-4a2c-435e-b33d-7bf74120b80a tempest-VolumesImageMetadata-1561311336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-0e5606d0-54c9-47e1-a2a1-83ca17bf5fe2 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:51:53 devstack sudo[96350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-0e5606d0-54c9-47e1-a2a1-83ca17bf5fe2 1073741824
Jun 15 15:51:53 devstack sudo[96350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:51:54 devstack sudo[96350]: pam_unix(sudo:session): session closed for user root
Jun 15 15:51:54 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ed4b8b2d-4a2c-435e-b33d-7bf74120b80a tempest-VolumesImageMetadata-1561311336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-0e5606d0-54c9-47e1-a2a1-83ca17bf5fe2 1073741824" returned: 0 in 0.792s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:51:54 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ed4b8b2d-4a2c-435e-b33d-7bf74120b80a tempest-VolumesImageMetadata-1561311336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-0e5606d0-54c9-47e1-a2a1-83ca17bf5fe2 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:51:54 devstack sudo[96357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-0e5606d0-54c9-47e1-a2a1-83ca17bf5fe2
Jun 15 15:51:54 devstack sudo[96357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:51:54 devstack sudo[96357]: pam_unix(sudo:session): session closed for user root
Jun 15 15:51:54 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ed4b8b2d-4a2c-435e-b33d-7bf74120b80a tempest-VolumesImageMetadata-1561311336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-0e5606d0-54c9-47e1-a2a1-83ca17bf5fe2" returned: 0 in 0.581s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:51:54 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-ed4b8b2d-4a2c-435e-b33d-7bf74120b80a tempest-VolumesImageMetadata-1561311336 None] <== create_volume: return (1414ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 15:51:54 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-ed4b8b2d-4a2c-435e-b33d-7bf74120b80a tempest-VolumesImageMetadata-1561311336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.418s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:51:55 devstack cinder-volume[91863]: DEBUG cinder.volume.volume_utils [None req-ed4b8b2d-4a2c-435e-b33d-7bf74120b80a tempest-VolumesImageMetadata-1561311336 None] Attempting download of 43adaed4-5eec-483a-aa2b-0818266a94f1 ((None, [{'url': 'file:///opt/stack/data/glance/images/43adaed4-5eec-483a-aa2b-0818266a94f1', 'metadata': {}}])) to volume 0e5606d0-54c9-47e1-a2a1-83ca17bf5fe2. {{(pid=91863) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 15 15:51:55 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb320670-9219-48e7-8e27-b1e027a79c52]: (4, 'raw') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:51:55 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ed4b8b2d-4a2c-435e-b33d-7bf74120b80a tempest-VolumesImageMetadata-1561311336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_43adaed4-5eec-483a-aa2b-0818266a94f1_oabb67di {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:51:55 devstack sudo[96360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_43adaed4-5eec-483a-aa2b-0818266a94f1_oabb67di
Jun 15 15:51:55 devstack sudo[96360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:51:55 devstack sudo[96360]: pam_unix(sudo:session): session closed for user root
Jun 15 15:51:55 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ed4b8b2d-4a2c-435e-b33d-7bf74120b80a tempest-VolumesImageMetadata-1561311336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_43adaed4-5eec-483a-aa2b-0818266a94f1_oabb67di" returned: 0 in 0.716s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:51:55 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ed4b8b2d-4a2c-435e-b33d-7bf74120b80a tempest-VolumesImageMetadata-1561311336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_43adaed4-5eec-483a-aa2b-0818266a94f1_oabb67di {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:51:55 devstack sudo[96371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_43adaed4-5eec-483a-aa2b-0818266a94f1_oabb67di
Jun 15 15:51:55 devstack sudo[96371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:51:55 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [req-e6615f99-6862-45a2-8b8f-016d2c0110df req-61d0ba7a-243b-4806-b00c-7e40fcb43c6a tempest-ServerActionsTestOtherA-2064227610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:51:55 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [req-e6615f99-6862-45a2-8b8f-016d2c0110df req-61d0ba7a-243b-4806-b00c-7e40fcb43c6a tempest-ServerActionsTestOtherA-2064227610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:51:55 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eff6545-e679-4265-b4c2-d397d3b98e89]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:51:55 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-e6615f99-6862-45a2-8b8f-016d2c0110df req-61d0ba7a-243b-4806-b00c-7e40fcb43c6a tempest-ServerActionsTestOtherA-2064227610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fbe53393-aa09-4011-ac08-eaa2ec006039 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:51:56 devstack sudo[96378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fbe53393-aa09-4011-ac08-eaa2ec006039
Jun 15 15:51:56 devstack sudo[96378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:51:56 devstack sudo[96371]: pam_unix(sudo:session): session closed for user root
Jun 15 15:51:56 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ed4b8b2d-4a2c-435e-b33d-7bf74120b80a tempest-VolumesImageMetadata-1561311336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_43adaed4-5eec-483a-aa2b-0818266a94f1_oabb67di" returned: 1 in 0.737s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:51:56 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ed4b8b2d-4a2c-435e-b33d-7bf74120b80a tempest-VolumesImageMetadata-1561311336 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_43adaed4-5eec-483a-aa2b-0818266a94f1_oabb67di' failed. Not Retrying. {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 15 15:51:56 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce83381-e0ed-453c-811f-edcaeebe76c8]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:51:56 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ed4b8b2d-4a2c-435e-b33d-7bf74120b80a tempest-VolumesImageMetadata-1561311336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_43adaed4-5eec-483a-aa2b-0818266a94f1_ou8e8firdevstack@QuobyteHD {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:51:56 devstack sudo[96382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_43adaed4-5eec-483a-aa2b-0818266a94f1_ou8e8firdevstack@QuobyteHD
Jun 15 15:51:56 devstack sudo[96382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:51:56 devstack sudo[96378]: pam_unix(sudo:session): session closed for user root
Jun 15 15:51:56 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-e6615f99-6862-45a2-8b8f-016d2c0110df req-61d0ba7a-243b-4806-b00c-7e40fcb43c6a tempest-ServerActionsTestOtherA-2064227610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fbe53393-aa09-4011-ac08-eaa2ec006039" returned: 0 in 0.768s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:51:56 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [req-e6615f99-6862-45a2-8b8f-016d2c0110df req-61d0ba7a-243b-4806-b00c-7e40fcb43c6a tempest-ServerActionsTestOtherA-2064227610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.786s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:51:56 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [req-e6615f99-6862-45a2-8b8f-016d2c0110df req-61d0ba7a-243b-4806-b00c-7e40fcb43c6a tempest-ServerActionsTestOtherA-2064227610 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc', 'name': 'volume-fbe53393-aa09-4011-ac08-eaa2ec006039', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4a1f6362-5449-497c-8517-c0a2d5d07df4', 'enforce_multipath': True} {{(pid=91863) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 15 15:51:56 devstack cinder-volume[91863]: INFO cinder.volume.manager [req-e6615f99-6862-45a2-8b8f-016d2c0110df req-61d0ba7a-243b-4806-b00c-7e40fcb43c6a tempest-ServerActionsTestOtherA-2064227610 None] attachment_update completed successfully.
Jun 15 15:51:57 devstack sudo[96382]: pam_unix(sudo:session): session closed for user root
Jun 15 15:51:57 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ed4b8b2d-4a2c-435e-b33d-7bf74120b80a tempest-VolumesImageMetadata-1561311336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_43adaed4-5eec-483a-aa2b-0818266a94f1_ou8e8firdevstack@QuobyteHD" returned: 0 in 0.702s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:51:57 devstack cinder-volume[91863]: DEBUG cinder.image.image_utils [None req-ed4b8b2d-4a2c-435e-b33d-7bf74120b80a tempest-VolumesImageMetadata-1561311336 None] 43adaed4-5eec-483a-aa2b-0818266a94f1 was qcow2, converting to raw {{(pid=91863) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 15 15:51:57 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ed4b8b2d-4a2c-435e-b33d-7bf74120b80a tempest-VolumesImageMetadata-1561311336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_43adaed4-5eec-483a-aa2b-0818266a94f1_ou8e8firdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-0e5606d0-54c9-47e1-a2a1-83ca17bf5fe2 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:51:57 devstack sudo[96390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_43adaed4-5eec-483a-aa2b-0818266a94f1_ou8e8firdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-0e5606d0-54c9-47e1-a2a1-83ca17bf5fe2
Jun 15 15:51:57 devstack sudo[96390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:51:59 devstack sudo[96390]: pam_unix(sudo:session): session closed for user root
Jun 15 15:51:59 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ed4b8b2d-4a2c-435e-b33d-7bf74120b80a tempest-VolumesImageMetadata-1561311336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_43adaed4-5eec-483a-aa2b-0818266a94f1_ou8e8firdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-0e5606d0-54c9-47e1-a2a1-83ca17bf5fe2" returned: 0 in 2.552s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:51:59 devstack cinder-volume[91863]: DEBUG cinder.image.image_utils [None req-ed4b8b2d-4a2c-435e-b33d-7bf74120b80a tempest-VolumesImageMetadata-1561311336 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_43adaed4-5eec-483a-aa2b-0818266a94f1_ou8e8firdevstack@QuobyteHD, size 112.00 MB, duration 2.55 sec, destination /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-0e5606d0-54c9-47e1-a2a1-83ca17bf5fe2 {{(pid=91863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 15 15:51:59 devstack cinder-volume[91863]: INFO cinder.image.image_utils [None req-ed4b8b2d-4a2c-435e-b33d-7bf74120b80a tempest-VolumesImageMetadata-1561311336 None] Converted 112.00 MB image at 43.87 MB/s
Jun 15 15:51:59 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ed4b8b2d-4a2c-435e-b33d-7bf74120b80a tempest-VolumesImageMetadata-1561311336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-0e5606d0-54c9-47e1-a2a1-83ca17bf5fe2 1G {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:51:59 devstack sudo[96446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-0e5606d0-54c9-47e1-a2a1-83ca17bf5fe2 1G
Jun 15 15:51:59 devstack sudo[96446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:52:00 devstack sudo[96446]: pam_unix(sudo:session): session closed for user root
Jun 15 15:52:00 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ed4b8b2d-4a2c-435e-b33d-7bf74120b80a tempest-VolumesImageMetadata-1561311336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-0e5606d0-54c9-47e1-a2a1-83ca17bf5fe2 1G" returned: 0 in 0.805s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:52:00 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9455a27f-da32-47f5-9316-849190285e6e]: (4, 'raw') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:52:00 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ed4b8b2d-4a2c-435e-b33d-7bf74120b80a tempest-VolumesImageMetadata-1561311336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-0e5606d0-54c9-47e1-a2a1-83ca17bf5fe2 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:52:00 devstack sudo[96467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-0e5606d0-54c9-47e1-a2a1-83ca17bf5fe2
Jun 15 15:52:00 devstack sudo[96467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:52:01 devstack sudo[96467]: pam_unix(sudo:session): session closed for user root
Jun 15 15:52:01 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ed4b8b2d-4a2c-435e-b33d-7bf74120b80a tempest-VolumesImageMetadata-1561311336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-0e5606d0-54c9-47e1-a2a1-83ca17bf5fe2" returned: 0 in 0.951s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:52:01 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ed4b8b2d-4a2c-435e-b33d-7bf74120b80a tempest-VolumesImageMetadata-1561311336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-0e5606d0-54c9-47e1-a2a1-83ca17bf5fe2 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:52:01 devstack sudo[96480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-0e5606d0-54c9-47e1-a2a1-83ca17bf5fe2
Jun 15 15:52:01 devstack sudo[96480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:52:02 devstack sudo[96480]: pam_unix(sudo:session): session closed for user root
Jun 15 15:52:02 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ed4b8b2d-4a2c-435e-b33d-7bf74120b80a tempest-VolumesImageMetadata-1561311336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-0e5606d0-54c9-47e1-a2a1-83ca17bf5fe2" returned: 1 in 1.049s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:52:02 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ed4b8b2d-4a2c-435e-b33d-7bf74120b80a tempest-VolumesImageMetadata-1561311336 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-0e5606d0-54c9-47e1-a2a1-83ca17bf5fe2' failed. Not Retrying. {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 15 15:52:02 devstack cinder-volume[91863]: DEBUG cinder.volume.volume_utils [None req-ed4b8b2d-4a2c-435e-b33d-7bf74120b80a tempest-VolumesImageMetadata-1561311336 None] Downloaded image 43adaed4-5eec-483a-aa2b-0818266a94f1 ((None, [{'url': 'file:///opt/stack/data/glance/images/43adaed4-5eec-483a-aa2b-0818266a94f1', 'metadata': {}}])) to volume 0e5606d0-54c9-47e1-a2a1-83ca17bf5fe2 successfully. {{(pid=91863) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 15 15:52:02 devstack cinder-volume[91863]: DEBUG cinder.image.image_utils [None req-ed4b8b2d-4a2c-435e-b33d-7bf74120b80a tempest-VolumesImageMetadata-1561311336 None] Temporary image 43adaed4-5eec-483a-aa2b-0818266a94f1 for user c6416e067ab74c8bba54876f7afa460c is deleted. {{(pid=91863) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 15 15:52:02 devstack cinder-volume[91863]: DEBUG cinder.volume.volume_utils [None req-ed4b8b2d-4a2c-435e-b33d-7bf74120b80a tempest-VolumesImageMetadata-1561311336 None] Marking volume 0e5606d0-54c9-47e1-a2a1-83ca17bf5fe2 as bootable. {{(pid=91863) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 15 15:52:02 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed4b8b2d-4a2c-435e-b33d-7bf74120b80a tempest-VolumesImageMetadata-1561311336 None] Copying metadata from image 43adaed4-5eec-483a-aa2b-0818266a94f1 to 0e5606d0-54c9-47e1-a2a1-83ca17bf5fe2. {{(pid=91863) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 15 15:52:02 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed4b8b2d-4a2c-435e-b33d-7bf74120b80a tempest-VolumesImageMetadata-1561311336 None] Creating volume glance metadata for volume 0e5606d0-54c9-47e1-a2a1-83ca17bf5fe2 backed by image 43adaed4-5eec-483a-aa2b-0818266a94f1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '43adaed4-5eec-483a-aa2b-0818266a94f1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=91863) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 15 15:52:02 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-ed4b8b2d-4a2c-435e-b33d-7bf74120b80a tempest-VolumesImageMetadata-1561311336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76452a94-33cf-4b6f-8600-58a6c6d5d8a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e5606d0-54c9-47e1-a2a1-83ca17bf5fe2', 'volume_size': 1, 'image_id': '43adaed4-5eec-483a-aa2b-0818266a94f1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/43adaed4-5eec-483a-aa2b-0818266a94f1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '601536f092c54cdc9ee754c7b1abc241', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '43adaed4-5eec-483a-aa2b-0818266a94f1', 'created_at': datetime.datetime(2026, 6, 15, 13, 42, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 13, 42, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/43adaed4-5eec-483a-aa2b-0818266a94f1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x773954806fc0>}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:52:02 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-ed4b8b2d-4a2c-435e-b33d-7bf74120b80a tempest-VolumesImageMetadata-1561311336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42439dad-0607-4ad7-9598-fee15ea65f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:52:02 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-ed4b8b2d-4a2c-435e-b33d-7bf74120b80a tempest-VolumesImageMetadata-1561311336 None] Volume volume-0e5606d0-54c9-47e1-a2a1-83ca17bf5fe2 (0e5606d0-54c9-47e1-a2a1-83ca17bf5fe2): created successfully
Jun 15 15:52:02 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-ed4b8b2d-4a2c-435e-b33d-7bf74120b80a tempest-VolumesImageMetadata-1561311336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42439dad-0607-4ad7-9598-fee15ea65f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:52:02 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-ed4b8b2d-4a2c-435e-b33d-7bf74120b80a tempest-VolumesImageMetadata-1561311336 None] Flow 'volume_create_manager' (e68e9009-45fd-4fb3-af75-624f04a58391) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:52:02 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-ed4b8b2d-4a2c-435e-b33d-7bf74120b80a tempest-VolumesImageMetadata-1561311336 None] Created volume successfully.
Jun 15 15:52:04 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-8544ecb3-d5e4-478d-bfdf-8395a2f19c17 tempest-VolumesImageMetadata-1561311336 None] Acquiring lock "cinder-0e5606d0-54c9-47e1-a2a1-83ca17bf5fe2-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:52:04 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-8544ecb3-d5e4-478d-bfdf-8395a2f19c17 tempest-VolumesImageMetadata-1561311336 None] Lock "cinder-0e5606d0-54c9-47e1-a2a1-83ca17bf5fe2-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:52:04 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-8544ecb3-d5e4-478d-bfdf-8395a2f19c17 tempest-VolumesImageMetadata-1561311336 None] Acquiring lock "cinder-quobyte-0e5606d0-54c9-47e1-a2a1-83ca17bf5fe2" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:52:04 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-8544ecb3-d5e4-478d-bfdf-8395a2f19c17 tempest-VolumesImageMetadata-1561311336 None] Lock "cinder-quobyte-0e5606d0-54c9-47e1-a2a1-83ca17bf5fe2" acquired by "delete_volume" :: waited 0.028s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:52:04 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ac2cca-3011-4d54-866e-7a56c7b9058f]: (4, 'raw') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:52:04 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-8544ecb3-d5e4-478d-bfdf-8395a2f19c17 tempest-VolumesImageMetadata-1561311336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-0e5606d0-54c9-47e1-a2a1-83ca17bf5fe2 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:52:04 devstack sudo[96512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-0e5606d0-54c9-47e1-a2a1-83ca17bf5fe2
Jun 15 15:52:04 devstack sudo[96512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:52:05 devstack cinder-volume[91863]: INFO cinder.volume.manager [req-04f37f42-8af2-48b2-8e64-fa71b1797477 req-c8cef458-bdcc-4c13-ac2d-337041efbb59 tempest-ServerActionsTestOtherA-2064227610 None] Terminate volume connection completed successfully.
Jun 15 15:52:05 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [req-04f37f42-8af2-48b2-8e64-fa71b1797477 req-c8cef458-bdcc-4c13-ac2d-337041efbb59 tempest-ServerActionsTestOtherA-2064227610 None] Deleting attachment 4a1f6362-5449-497c-8517-c0a2d5d07df4. {{(pid=91863) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 15 15:52:05 devstack sudo[96512]: pam_unix(sudo:session): session closed for user root
Jun 15 15:52:05 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-8544ecb3-d5e4-478d-bfdf-8395a2f19c17 tempest-VolumesImageMetadata-1561311336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-0e5606d0-54c9-47e1-a2a1-83ca17bf5fe2" returned: 0 in 1.229s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:52:05 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-8544ecb3-d5e4-478d-bfdf-8395a2f19c17 tempest-VolumesImageMetadata-1561311336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-0e5606d0-54c9-47e1-a2a1-83ca17bf5fe2 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:52:05 devstack sudo[96545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-0e5606d0-54c9-47e1-a2a1-83ca17bf5fe2
Jun 15 15:52:05 devstack sudo[96545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:52:06 devstack sudo[96545]: pam_unix(sudo:session): session closed for user root
Jun 15 15:52:06 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-8544ecb3-d5e4-478d-bfdf-8395a2f19c17 tempest-VolumesImageMetadata-1561311336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-0e5606d0-54c9-47e1-a2a1-83ca17bf5fe2" returned: 1 in 0.690s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:52:06 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-8544ecb3-d5e4-478d-bfdf-8395a2f19c17 tempest-VolumesImageMetadata-1561311336 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-0e5606d0-54c9-47e1-a2a1-83ca17bf5fe2' failed. Not Retrying. {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 15 15:52:06 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-8544ecb3-d5e4-478d-bfdf-8395a2f19c17 tempest-VolumesImageMetadata-1561311336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-0e5606d0-54c9-47e1-a2a1-83ca17bf5fe2 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:52:06 devstack sudo[96553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-0e5606d0-54c9-47e1-a2a1-83ca17bf5fe2
Jun 15 15:52:06 devstack sudo[96553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:52:06 devstack cinder-volume[91863]: INFO cinder.volume.manager [req-8e08946c-d97f-47ab-8373-7a03fb0e848e req-0a9513a5-3cde-4249-bc86-c1c07b19a9e0 tempest-AttachVolumeShelveTestJSON-1587912764 None] Terminate volume connection completed successfully.
Jun 15 15:52:06 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [req-8e08946c-d97f-47ab-8373-7a03fb0e848e req-0a9513a5-3cde-4249-bc86-c1c07b19a9e0 tempest-AttachVolumeShelveTestJSON-1587912764 None] Deleting attachment a10449bb-eec8-4781-ac3d-790adfa0571a. {{(pid=91863) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 15 15:52:07 devstack sudo[96553]: pam_unix(sudo:session): session closed for user root
Jun 15 15:52:07 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-8544ecb3-d5e4-478d-bfdf-8395a2f19c17 tempest-VolumesImageMetadata-1561311336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-0e5606d0-54c9-47e1-a2a1-83ca17bf5fe2" returned: 0 in 0.669s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:52:07 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-8544ecb3-d5e4-478d-bfdf-8395a2f19c17 tempest-VolumesImageMetadata-1561311336 None] Lock "cinder-quobyte-0e5606d0-54c9-47e1-a2a1-83ca17bf5fe2" released by "delete_volume" :: held 2.704s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:52:07 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-8544ecb3-d5e4-478d-bfdf-8395a2f19c17 tempest-VolumesImageMetadata-1561311336 None] Created reservations ['8f1d1edb-1382-4df1-9b09-1476bd386981', '6396c1da-c7b2-4b54-998d-4229a7eaa844', '49558833-19ae-4f80-8076-62d89b3c26f6', '69517c02-66fc-4e60-b8ea-bfcd32414ccd'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:52:07 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-8544ecb3-d5e4-478d-bfdf-8395a2f19c17 tempest-VolumesImageMetadata-1561311336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:52:07 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-8544ecb3-d5e4-478d-bfdf-8395a2f19c17 tempest-VolumesImageMetadata-1561311336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:52:07 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-8544ecb3-d5e4-478d-bfdf-8395a2f19c17 tempest-VolumesImageMetadata-1561311336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:52:07 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-8544ecb3-d5e4-478d-bfdf-8395a2f19c17 tempest-VolumesImageMetadata-1561311336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:52:07 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-8544ecb3-d5e4-478d-bfdf-8395a2f19c17 tempest-VolumesImageMetadata-1561311336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:52:07 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-8544ecb3-d5e4-478d-bfdf-8395a2f19c17 tempest-VolumesImageMetadata-1561311336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:52:07 devstack sudo[96557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:52:07 devstack sudo[96557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:52:07 devstack sudo[96557]: pam_unix(sudo:session): session closed for user root
Jun 15 15:52:07 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-8544ecb3-d5e4-478d-bfdf-8395a2f19c17 tempest-VolumesImageMetadata-1561311336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.616s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:52:07 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-8544ecb3-d5e4-478d-bfdf-8395a2f19c17 tempest-VolumesImageMetadata-1561311336 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:52:07 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-8544ecb3-d5e4-478d-bfdf-8395a2f19c17 tempest-VolumesImageMetadata-1561311336 None] Deleted volume successfully.
Jun 15 15:52:08 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-8544ecb3-d5e4-478d-bfdf-8395a2f19c17 tempest-VolumesImageMetadata-1561311336 None] Lock "cinder-0e5606d0-54c9-47e1-a2a1-83ca17bf5fe2-delete_volume" released by "delete_volume" :: held 3.570s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:52:08 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [req-04f37f42-8af2-48b2-8e64-fa71b1797477 req-6ffc041c-189c-43cc-8b2f-6a2220627cb0 tempest-ServerActionsTestOtherA-2064227610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:52:08 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [req-04f37f42-8af2-48b2-8e64-fa71b1797477 req-6ffc041c-189c-43cc-8b2f-6a2220627cb0 tempest-ServerActionsTestOtherA-2064227610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:52:08 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb163c6e-ba18-4e4d-9860-877634ebb04c]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:52:08 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-04f37f42-8af2-48b2-8e64-fa71b1797477 req-6ffc041c-189c-43cc-8b2f-6a2220627cb0 tempest-ServerActionsTestOtherA-2064227610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fbe53393-aa09-4011-ac08-eaa2ec006039 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:52:08 devstack sudo[96568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fbe53393-aa09-4011-ac08-eaa2ec006039
Jun 15 15:52:08 devstack sudo[96568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:52:09 devstack sudo[96568]: pam_unix(sudo:session): session closed for user root
Jun 15 15:52:09 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-04f37f42-8af2-48b2-8e64-fa71b1797477 req-6ffc041c-189c-43cc-8b2f-6a2220627cb0 tempest-ServerActionsTestOtherA-2064227610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fbe53393-aa09-4011-ac08-eaa2ec006039" returned: 0 in 0.912s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:52:09 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [req-04f37f42-8af2-48b2-8e64-fa71b1797477 req-6ffc041c-189c-43cc-8b2f-6a2220627cb0 tempest-ServerActionsTestOtherA-2064227610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.945s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:52:09 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [req-04f37f42-8af2-48b2-8e64-fa71b1797477 req-6ffc041c-189c-43cc-8b2f-6a2220627cb0 tempest-ServerActionsTestOtherA-2064227610 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc', 'name': 'volume-fbe53393-aa09-4011-ac08-eaa2ec006039', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '65105838-11c4-4391-852f-99cfe7a89604', 'enforce_multipath': True} {{(pid=91863) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 15 15:52:09 devstack cinder-volume[91863]: INFO cinder.volume.manager [req-04f37f42-8af2-48b2-8e64-fa71b1797477 req-6ffc041c-189c-43cc-8b2f-6a2220627cb0 tempest-ServerActionsTestOtherA-2064227610 None] attachment_update completed successfully.
Jun 15 15:52:15 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ba68e04-93b2-4996-aa96-429525566727 tempest-VolumesTransfersTest-517869297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 15:52:15 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-0ba68e04-93b2-4996-aa96-429525566727 tempest-VolumesTransfersTest-517869297 None] Flow 'volume_create_manager' (2159f4cc-7158-4b53-8f46-03ef48bbf63b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:52:15 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-0ba68e04-93b2-4996-aa96-429525566727 tempest-VolumesTransfersTest-517869297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76c2d785-3fa7-481b-a82c-0b904688fc21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:52:15 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-0ba68e04-93b2-4996-aa96-429525566727 tempest-VolumesTransfersTest-517869297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76c2d785-3fa7-481b-a82c-0b904688fc21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:52:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-86776457',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b856957d-56aa-4d2c-8a19-9884b7a0b965,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63473dc61a464fda9260cd9b50c384b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:52:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:52:15Z,use_quota=True,user_id='3403ac82f70f44f29fe70131ce4f2b22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:52:15 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-0ba68e04-93b2-4996-aa96-429525566727 tempest-VolumesTransfersTest-517869297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a35655d6-dacd-4f1d-b88e-57317800fa40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:52:15 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-0ba68e04-93b2-4996-aa96-429525566727 tempest-VolumesTransfersTest-517869297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a35655d6-dacd-4f1d-b88e-57317800fa40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:52:15 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-0ba68e04-93b2-4996-aa96-429525566727 tempest-VolumesTransfersTest-517869297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cc4836e-7650-4e77-bd62-8fb17f60a91d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:52:15 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-0ba68e04-93b2-4996-aa96-429525566727 tempest-VolumesTransfersTest-517869297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cc4836e-7650-4e77-bd62-8fb17f60a91d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b856957d-56aa-4d2c-8a19-9884b7a0b965', 'volume_name': 'volume-b856957d-56aa-4d2c-8a19-9884b7a0b965', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:52:15 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-0ba68e04-93b2-4996-aa96-429525566727 tempest-VolumesTransfersTest-517869297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6ae0446-b595-4f0b-bf04-6a5eda320ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:52:15 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-0ba68e04-93b2-4996-aa96-429525566727 tempest-VolumesTransfersTest-517869297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6ae0446-b595-4f0b-bf04-6a5eda320ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:52:15 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-0ba68e04-93b2-4996-aa96-429525566727 tempest-VolumesTransfersTest-517869297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb1a1a27-61cb-4b00-9792-9b65f96eb70f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:52:15 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-0ba68e04-93b2-4996-aa96-429525566727 tempest-VolumesTransfersTest-517869297 None] Volume b856957d-56aa-4d2c-8a19-9884b7a0b965: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b856957d-56aa-4d2c-8a19-9884b7a0b965', 'volume_size': 1}
Jun 15 15:52:15 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-0ba68e04-93b2-4996-aa96-429525566727 tempest-VolumesTransfersTest-517869297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:52:15 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-0ba68e04-93b2-4996-aa96-429525566727 tempest-VolumesTransfersTest-517869297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:52:15 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-0ba68e04-93b2-4996-aa96-429525566727 tempest-VolumesTransfersTest-517869297 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:52:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-86776457',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b856957d-56aa-4d2c-8a19-9884b7a0b965,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63473dc61a464fda9260cd9b50c384b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:52:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:52:15Z,use_quota=True,user_id='3403ac82f70f44f29fe70131ce4f2b22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 15:52:15 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-0ba68e04-93b2-4996-aa96-429525566727 tempest-VolumesTransfersTest-517869297 None] Creating volume b856957d-56aa-4d2c-8a19-9884b7a0b965 {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 15:52:15 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-0ba68e04-93b2-4996-aa96-429525566727 tempest-VolumesTransfersTest-517869297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:52:15 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-0ba68e04-93b2-4996-aa96-429525566727 tempest-VolumesTransfersTest-517869297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:52:15 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-0ba68e04-93b2-4996-aa96-429525566727 tempest-VolumesTransfersTest-517869297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:52:15 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-0ba68e04-93b2-4996-aa96-429525566727 tempest-VolumesTransfersTest-517869297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:52:15 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-0ba68e04-93b2-4996-aa96-429525566727 tempest-VolumesTransfersTest-517869297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:52:15 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-0ba68e04-93b2-4996-aa96-429525566727 tempest-VolumesTransfersTest-517869297 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 15:52:15 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-0ba68e04-93b2-4996-aa96-429525566727 tempest-VolumesTransfersTest-517869297 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 15:52:15 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-0ba68e04-93b2-4996-aa96-429525566727 tempest-VolumesTransfersTest-517869297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b856957d-56aa-4d2c-8a19-9884b7a0b965 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:52:15 devstack sudo[96692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b856957d-56aa-4d2c-8a19-9884b7a0b965 1073741824
Jun 15 15:52:15 devstack sudo[96692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:52:16 devstack sudo[96692]: pam_unix(sudo:session): session closed for user root
Jun 15 15:52:16 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-0ba68e04-93b2-4996-aa96-429525566727 tempest-VolumesTransfersTest-517869297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b856957d-56aa-4d2c-8a19-9884b7a0b965 1073741824" returned: 0 in 0.986s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:52:16 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-0ba68e04-93b2-4996-aa96-429525566727 tempest-VolumesTransfersTest-517869297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b856957d-56aa-4d2c-8a19-9884b7a0b965 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:52:16 devstack sudo[96700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b856957d-56aa-4d2c-8a19-9884b7a0b965
Jun 15 15:52:16 devstack sudo[96700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:52:17 devstack sudo[96700]: pam_unix(sudo:session): session closed for user root
Jun 15 15:52:17 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-0ba68e04-93b2-4996-aa96-429525566727 tempest-VolumesTransfersTest-517869297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b856957d-56aa-4d2c-8a19-9884b7a0b965" returned: 0 in 0.679s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:52:17 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-0ba68e04-93b2-4996-aa96-429525566727 tempest-VolumesTransfersTest-517869297 None] <== create_volume: return (1707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 15:52:17 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-0ba68e04-93b2-4996-aa96-429525566727 tempest-VolumesTransfersTest-517869297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.710s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:52:17 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-0ba68e04-93b2-4996-aa96-429525566727 tempest-VolumesTransfersTest-517869297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb1a1a27-61cb-4b00-9792-9b65f96eb70f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b856957d-56aa-4d2c-8a19-9884b7a0b965', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:52:17 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-0ba68e04-93b2-4996-aa96-429525566727 tempest-VolumesTransfersTest-517869297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c17e683f-4f96-49dd-85ad-5ebd14a6246d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:52:17 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-0ba68e04-93b2-4996-aa96-429525566727 tempest-VolumesTransfersTest-517869297 None] Volume volume-b856957d-56aa-4d2c-8a19-9884b7a0b965 (b856957d-56aa-4d2c-8a19-9884b7a0b965): created successfully
Jun 15 15:52:17 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-0ba68e04-93b2-4996-aa96-429525566727 tempest-VolumesTransfersTest-517869297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c17e683f-4f96-49dd-85ad-5ebd14a6246d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:52:17 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-0ba68e04-93b2-4996-aa96-429525566727 tempest-VolumesTransfersTest-517869297 None] Flow 'volume_create_manager' (2159f4cc-7158-4b53-8f46-03ef48bbf63b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:52:17 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-0ba68e04-93b2-4996-aa96-429525566727 tempest-VolumesTransfersTest-517869297 None] Created volume successfully.
Jun 15 15:52:18 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-dcbbf5ee-ad71-45a9-96e5-e84d9fbc74b2 tempest-VolumesTransfersTest-1537798102 None] Transfer volume completed successfully.
Jun 15 15:52:19 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-4842fdb3-5393-45c4-a31f-e563f614d9d0 tempest-VolumesTransfersTest-792298454 None] Acquiring lock "cinder-b856957d-56aa-4d2c-8a19-9884b7a0b965-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:52:19 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-4842fdb3-5393-45c4-a31f-e563f614d9d0 tempest-VolumesTransfersTest-792298454 None] Lock "cinder-b856957d-56aa-4d2c-8a19-9884b7a0b965-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:52:19 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-4842fdb3-5393-45c4-a31f-e563f614d9d0 tempest-VolumesTransfersTest-792298454 None] Acquiring lock "cinder-quobyte-b856957d-56aa-4d2c-8a19-9884b7a0b965" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:52:19 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-4842fdb3-5393-45c4-a31f-e563f614d9d0 tempest-VolumesTransfersTest-792298454 None] Lock "cinder-quobyte-b856957d-56aa-4d2c-8a19-9884b7a0b965" acquired by "delete_volume" :: waited 0.036s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:52:19 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a4e3bdb-cda8-4e45-85a7-4180c29d5088]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:52:19 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-4842fdb3-5393-45c4-a31f-e563f614d9d0 tempest-VolumesTransfersTest-792298454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b856957d-56aa-4d2c-8a19-9884b7a0b965 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:52:19 devstack sudo[96703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b856957d-56aa-4d2c-8a19-9884b7a0b965
Jun 15 15:52:19 devstack sudo[96703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:52:20 devstack sudo[96703]: pam_unix(sudo:session): session closed for user root
Jun 15 15:52:20 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-4842fdb3-5393-45c4-a31f-e563f614d9d0 tempest-VolumesTransfersTest-792298454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b856957d-56aa-4d2c-8a19-9884b7a0b965" returned: 0 in 0.927s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:52:20 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-4842fdb3-5393-45c4-a31f-e563f614d9d0 tempest-VolumesTransfersTest-792298454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b856957d-56aa-4d2c-8a19-9884b7a0b965 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:52:20 devstack sudo[96711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b856957d-56aa-4d2c-8a19-9884b7a0b965
Jun 15 15:52:20 devstack sudo[96711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:52:21 devstack sudo[96711]: pam_unix(sudo:session): session closed for user root
Jun 15 15:52:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-4842fdb3-5393-45c4-a31f-e563f614d9d0 tempest-VolumesTransfersTest-792298454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b856957d-56aa-4d2c-8a19-9884b7a0b965" returned: 0 in 0.618s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:52:21 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-4842fdb3-5393-45c4-a31f-e563f614d9d0 tempest-VolumesTransfersTest-792298454 None] Lock "cinder-quobyte-b856957d-56aa-4d2c-8a19-9884b7a0b965" released by "delete_volume" :: held 1.598s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:52:21 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-4842fdb3-5393-45c4-a31f-e563f614d9d0 tempest-VolumesTransfersTest-792298454 None] Created reservations ['73d9ea80-6567-4ad2-b6e9-c94b0c48218d', '76bbb4e3-1085-460a-8987-88e9498195f0', '5bef11b1-b5ff-4cd9-86d1-b0754642e2ab', 'ad1f430b-ba31-4199-83ea-613fc1366563'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:52:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-4842fdb3-5393-45c4-a31f-e563f614d9d0 tempest-VolumesTransfersTest-792298454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:52:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-4842fdb3-5393-45c4-a31f-e563f614d9d0 tempest-VolumesTransfersTest-792298454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:52:21 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-4842fdb3-5393-45c4-a31f-e563f614d9d0 tempest-VolumesTransfersTest-792298454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:52:21 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-4842fdb3-5393-45c4-a31f-e563f614d9d0 tempest-VolumesTransfersTest-792298454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:52:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-4842fdb3-5393-45c4-a31f-e563f614d9d0 tempest-VolumesTransfersTest-792298454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:52:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-4842fdb3-5393-45c4-a31f-e563f614d9d0 tempest-VolumesTransfersTest-792298454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:52:21 devstack sudo[96714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:52:21 devstack sudo[96714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:52:22 devstack sudo[96714]: pam_unix(sudo:session): session closed for user root
Jun 15 15:52:22 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-4842fdb3-5393-45c4-a31f-e563f614d9d0 tempest-VolumesTransfersTest-792298454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.639s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:52:22 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-4842fdb3-5393-45c4-a31f-e563f614d9d0 tempest-VolumesTransfersTest-792298454 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:52:22 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-4842fdb3-5393-45c4-a31f-e563f614d9d0 tempest-VolumesTransfersTest-792298454 None] Deleted volume successfully.
Jun 15 15:52:22 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-4842fdb3-5393-45c4-a31f-e563f614d9d0 tempest-VolumesTransfersTest-792298454 None] Lock "cinder-b856957d-56aa-4d2c-8a19-9884b7a0b965-delete_volume" released by "delete_volume" :: held 2.502s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:52:22 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-21f5bf6c-e71c-4663-9d41-88b5950193ff tempest-VolumesTransfersTest-517869297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 15:52:22 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-21f5bf6c-e71c-4663-9d41-88b5950193ff tempest-VolumesTransfersTest-517869297 None] Flow 'volume_create_manager' (d33725ca-51f1-4e2e-ad9a-d71371290aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:52:22 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-21f5bf6c-e71c-4663-9d41-88b5950193ff tempest-VolumesTransfersTest-517869297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b657bfb4-8247-4a81-a298-8d28afeceadf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:52:22 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-21f5bf6c-e71c-4663-9d41-88b5950193ff tempest-VolumesTransfersTest-517869297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b657bfb4-8247-4a81-a298-8d28afeceadf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:52:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-466628230',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51ad348f-2ea9-4e97-b656-f93c2efa1029,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63473dc61a464fda9260cd9b50c384b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:52:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:52:22Z,use_quota=True,user_id='3403ac82f70f44f29fe70131ce4f2b22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:52:22 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-21f5bf6c-e71c-4663-9d41-88b5950193ff tempest-VolumesTransfersTest-517869297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00f76af9-f2ca-4351-8850-1ba023738eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:52:22 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-21f5bf6c-e71c-4663-9d41-88b5950193ff tempest-VolumesTransfersTest-517869297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00f76af9-f2ca-4351-8850-1ba023738eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:52:22 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-21f5bf6c-e71c-4663-9d41-88b5950193ff tempest-VolumesTransfersTest-517869297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2aa97854-84ae-480d-941d-a4e89259370d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:52:22 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-21f5bf6c-e71c-4663-9d41-88b5950193ff tempest-VolumesTransfersTest-517869297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2aa97854-84ae-480d-941d-a4e89259370d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51ad348f-2ea9-4e97-b656-f93c2efa1029', 'volume_name': 'volume-51ad348f-2ea9-4e97-b656-f93c2efa1029', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:52:22 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-21f5bf6c-e71c-4663-9d41-88b5950193ff tempest-VolumesTransfersTest-517869297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43c68005-dfe3-429e-aef3-25a3c84e5e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:52:22 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-21f5bf6c-e71c-4663-9d41-88b5950193ff tempest-VolumesTransfersTest-517869297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43c68005-dfe3-429e-aef3-25a3c84e5e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:52:22 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-21f5bf6c-e71c-4663-9d41-88b5950193ff tempest-VolumesTransfersTest-517869297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caac44b5-2882-4f9a-97b7-e660113b411e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:52:22 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-21f5bf6c-e71c-4663-9d41-88b5950193ff tempest-VolumesTransfersTest-517869297 None] Volume 51ad348f-2ea9-4e97-b656-f93c2efa1029: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51ad348f-2ea9-4e97-b656-f93c2efa1029', 'volume_size': 1}
Jun 15 15:52:22 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-21f5bf6c-e71c-4663-9d41-88b5950193ff tempest-VolumesTransfersTest-517869297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:52:22 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-21f5bf6c-e71c-4663-9d41-88b5950193ff tempest-VolumesTransfersTest-517869297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:52:22 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-21f5bf6c-e71c-4663-9d41-88b5950193ff tempest-VolumesTransfersTest-517869297 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:52:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-466628230',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51ad348f-2ea9-4e97-b656-f93c2efa1029,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63473dc61a464fda9260cd9b50c384b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:52:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:52:22Z,use_quota=True,user_id='3403ac82f70f44f29fe70131ce4f2b22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 15:52:22 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-21f5bf6c-e71c-4663-9d41-88b5950193ff tempest-VolumesTransfersTest-517869297 None] Creating volume 51ad348f-2ea9-4e97-b656-f93c2efa1029 {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 15:52:22 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-21f5bf6c-e71c-4663-9d41-88b5950193ff tempest-VolumesTransfersTest-517869297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:52:22 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-21f5bf6c-e71c-4663-9d41-88b5950193ff tempest-VolumesTransfersTest-517869297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:52:22 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-21f5bf6c-e71c-4663-9d41-88b5950193ff tempest-VolumesTransfersTest-517869297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:52:22 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-21f5bf6c-e71c-4663-9d41-88b5950193ff tempest-VolumesTransfersTest-517869297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:52:22 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-21f5bf6c-e71c-4663-9d41-88b5950193ff tempest-VolumesTransfersTest-517869297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:52:22 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-21f5bf6c-e71c-4663-9d41-88b5950193ff tempest-VolumesTransfersTest-517869297 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 15:52:22 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-21f5bf6c-e71c-4663-9d41-88b5950193ff tempest-VolumesTransfersTest-517869297 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 15:52:22 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-21f5bf6c-e71c-4663-9d41-88b5950193ff tempest-VolumesTransfersTest-517869297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-51ad348f-2ea9-4e97-b656-f93c2efa1029 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:52:22 devstack sudo[96725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-51ad348f-2ea9-4e97-b656-f93c2efa1029 1073741824
Jun 15 15:52:22 devstack sudo[96725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:52:23 devstack sudo[96725]: pam_unix(sudo:session): session closed for user root
Jun 15 15:52:23 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-21f5bf6c-e71c-4663-9d41-88b5950193ff tempest-VolumesTransfersTest-517869297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-51ad348f-2ea9-4e97-b656-f93c2efa1029 1073741824" returned: 0 in 0.884s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:52:23 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-21f5bf6c-e71c-4663-9d41-88b5950193ff tempest-VolumesTransfersTest-517869297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-51ad348f-2ea9-4e97-b656-f93c2efa1029 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:52:23 devstack sudo[96730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-51ad348f-2ea9-4e97-b656-f93c2efa1029
Jun 15 15:52:23 devstack sudo[96730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:52:24 devstack sudo[96730]: pam_unix(sudo:session): session closed for user root
Jun 15 15:52:24 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-21f5bf6c-e71c-4663-9d41-88b5950193ff tempest-VolumesTransfersTest-517869297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-51ad348f-2ea9-4e97-b656-f93c2efa1029" returned: 0 in 0.691s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:52:24 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-21f5bf6c-e71c-4663-9d41-88b5950193ff tempest-VolumesTransfersTest-517869297 None] <== create_volume: return (1614ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 15:52:24 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-21f5bf6c-e71c-4663-9d41-88b5950193ff tempest-VolumesTransfersTest-517869297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.616s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:52:24 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-21f5bf6c-e71c-4663-9d41-88b5950193ff tempest-VolumesTransfersTest-517869297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caac44b5-2882-4f9a-97b7-e660113b411e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51ad348f-2ea9-4e97-b656-f93c2efa1029', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:52:24 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-21f5bf6c-e71c-4663-9d41-88b5950193ff tempest-VolumesTransfersTest-517869297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0905e96-4fa2-404a-8771-28c2084f4e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:52:24 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-21f5bf6c-e71c-4663-9d41-88b5950193ff tempest-VolumesTransfersTest-517869297 None] Volume volume-51ad348f-2ea9-4e97-b656-f93c2efa1029 (51ad348f-2ea9-4e97-b656-f93c2efa1029): created successfully
Jun 15 15:52:24 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-21f5bf6c-e71c-4663-9d41-88b5950193ff tempest-VolumesTransfersTest-517869297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0905e96-4fa2-404a-8771-28c2084f4e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:52:24 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-21f5bf6c-e71c-4663-9d41-88b5950193ff tempest-VolumesTransfersTest-517869297 None] Flow 'volume_create_manager' (d33725ca-51f1-4e2e-ad9a-d71371290aba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:52:24 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-21f5bf6c-e71c-4663-9d41-88b5950193ff tempest-VolumesTransfersTest-517869297 None] Created volume successfully.
Jun 15 15:52:24 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-610370a4-fba4-4eaa-a7e6-3b6d0a03c575 tempest-VolumesTransfersTest-792298454 None] Acquiring lock "cinder-51ad348f-2ea9-4e97-b656-f93c2efa1029-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:52:24 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-610370a4-fba4-4eaa-a7e6-3b6d0a03c575 tempest-VolumesTransfersTest-792298454 None] Lock "cinder-51ad348f-2ea9-4e97-b656-f93c2efa1029-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:52:25 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-610370a4-fba4-4eaa-a7e6-3b6d0a03c575 tempest-VolumesTransfersTest-792298454 None] Acquiring lock "cinder-quobyte-51ad348f-2ea9-4e97-b656-f93c2efa1029" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:52:25 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-610370a4-fba4-4eaa-a7e6-3b6d0a03c575 tempest-VolumesTransfersTest-792298454 None] Lock "cinder-quobyte-51ad348f-2ea9-4e97-b656-f93c2efa1029" acquired by "delete_volume" :: waited 0.018s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:52:25 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb3d0b2-05eb-4fd6-8efe-b0d7d3206190]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:52:25 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-610370a4-fba4-4eaa-a7e6-3b6d0a03c575 tempest-VolumesTransfersTest-792298454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-51ad348f-2ea9-4e97-b656-f93c2efa1029 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:52:25 devstack sudo[96768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-51ad348f-2ea9-4e97-b656-f93c2efa1029
Jun 15 15:52:25 devstack sudo[96768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:52:26 devstack sudo[96768]: pam_unix(sudo:session): session closed for user root
Jun 15 15:52:26 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-610370a4-fba4-4eaa-a7e6-3b6d0a03c575 tempest-VolumesTransfersTest-792298454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-51ad348f-2ea9-4e97-b656-f93c2efa1029" returned: 0 in 1.149s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:52:26 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-610370a4-fba4-4eaa-a7e6-3b6d0a03c575 tempest-VolumesTransfersTest-792298454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-51ad348f-2ea9-4e97-b656-f93c2efa1029 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:52:26 devstack sudo[96774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-51ad348f-2ea9-4e97-b656-f93c2efa1029
Jun 15 15:52:26 devstack sudo[96774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:52:27 devstack sudo[96774]: pam_unix(sudo:session): session closed for user root
Jun 15 15:52:27 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-610370a4-fba4-4eaa-a7e6-3b6d0a03c575 tempest-VolumesTransfersTest-792298454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-51ad348f-2ea9-4e97-b656-f93c2efa1029" returned: 0 in 1.114s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:52:27 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-610370a4-fba4-4eaa-a7e6-3b6d0a03c575 tempest-VolumesTransfersTest-792298454 None] Lock "cinder-quobyte-51ad348f-2ea9-4e97-b656-f93c2efa1029" released by "delete_volume" :: held 2.323s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:52:27 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-610370a4-fba4-4eaa-a7e6-3b6d0a03c575 tempest-VolumesTransfersTest-792298454 None] Created reservations ['6745b6fc-6b29-4944-9de3-89ef25e8d557', 'cb07cb90-0b95-45b2-8685-2fc0e9ed09b4', 'e9fb27c4-4c48-48a7-ac41-ccae4f061f2a', 'c0940e53-279b-42ee-816b-b2d469aac320'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:52:27 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-610370a4-fba4-4eaa-a7e6-3b6d0a03c575 tempest-VolumesTransfersTest-792298454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:52:27 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-610370a4-fba4-4eaa-a7e6-3b6d0a03c575 tempest-VolumesTransfersTest-792298454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:52:27 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-610370a4-fba4-4eaa-a7e6-3b6d0a03c575 tempest-VolumesTransfersTest-792298454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:52:27 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-610370a4-fba4-4eaa-a7e6-3b6d0a03c575 tempest-VolumesTransfersTest-792298454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:52:27 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-610370a4-fba4-4eaa-a7e6-3b6d0a03c575 tempest-VolumesTransfersTest-792298454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:52:27 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-610370a4-fba4-4eaa-a7e6-3b6d0a03c575 tempest-VolumesTransfersTest-792298454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:52:27 devstack sudo[96806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:52:27 devstack sudo[96806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:52:28 devstack sudo[96806]: pam_unix(sudo:session): session closed for user root
Jun 15 15:52:28 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-610370a4-fba4-4eaa-a7e6-3b6d0a03c575 tempest-VolumesTransfersTest-792298454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.856s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:52:28 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-610370a4-fba4-4eaa-a7e6-3b6d0a03c575 tempest-VolumesTransfersTest-792298454 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:52:28 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-610370a4-fba4-4eaa-a7e6-3b6d0a03c575 tempest-VolumesTransfersTest-792298454 None] Deleted volume successfully.
Jun 15 15:52:28 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-610370a4-fba4-4eaa-a7e6-3b6d0a03c575 tempest-VolumesTransfersTest-792298454 None] Lock "cinder-51ad348f-2ea9-4e97-b656-f93c2efa1029-delete_volume" released by "delete_volume" :: held 3.605s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:52:31 devstack cinder-volume[91863]: DEBUG oslo_service.periodic_task [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 15:52:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:52:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:52:31 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:52:31 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:52:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:52:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:52:31 devstack sudo[96869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:52:31 devstack sudo[96869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:52:31 devstack sudo[96869]: pam_unix(sudo:session): session closed for user root
Jun 15 15:52:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.700s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:52:31 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:52:34 devstack cinder-volume[91863]: INFO cinder.volume.manager [req-2657e2f4-c726-4a79-8d98-15b3efd5c18f req-82688dbb-9e57-4675-95e4-4f2d647bc65e tempest-AttachVolumeNegativeTest-1849283913 None] Terminate volume connection completed successfully.
Jun 15 15:52:34 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [req-2657e2f4-c726-4a79-8d98-15b3efd5c18f req-82688dbb-9e57-4675-95e4-4f2d647bc65e tempest-AttachVolumeNegativeTest-1849283913 None] Deleting attachment 3b6e1691-bd88-4cf0-a360-8a65427f03a6. {{(pid=91863) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 15 15:52:36 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4d5ff11-c88e-45e5-b360-2ccd2a0f4ec6 tempest-VolumesTransfersV355Test-1543644574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 15:52:36 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-d4d5ff11-c88e-45e5-b360-2ccd2a0f4ec6 tempest-VolumesTransfersV355Test-1543644574 None] Flow 'volume_create_manager' (d64efb51-4124-4060-9c35-ae0c5a836d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:52:36 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-d4d5ff11-c88e-45e5-b360-2ccd2a0f4ec6 tempest-VolumesTransfersV355Test-1543644574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49309657-e046-4e26-8639-c6328ff6c5b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:52:36 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-d4d5ff11-c88e-45e5-b360-2ccd2a0f4ec6 tempest-VolumesTransfersV355Test-1543644574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49309657-e046-4e26-8639-c6328ff6c5b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:52:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1981535971',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42cfffad-252a-4823-8936-99b2254bb6df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b57cc7056a0a419b97a1d7737d70b350',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:52:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:52:37Z,use_quota=True,user_id='c30658ff96f748abb727bcced66f5449',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:52:36 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-d4d5ff11-c88e-45e5-b360-2ccd2a0f4ec6 tempest-VolumesTransfersV355Test-1543644574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74d0965c-198e-464e-a929-4b29abaae252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:52:36 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-d4d5ff11-c88e-45e5-b360-2ccd2a0f4ec6 tempest-VolumesTransfersV355Test-1543644574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74d0965c-198e-464e-a929-4b29abaae252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:52:36 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-d4d5ff11-c88e-45e5-b360-2ccd2a0f4ec6 tempest-VolumesTransfersV355Test-1543644574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d0f7b28-c217-4f26-870c-3b33ad858d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:52:36 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-d4d5ff11-c88e-45e5-b360-2ccd2a0f4ec6 tempest-VolumesTransfersV355Test-1543644574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d0f7b28-c217-4f26-870c-3b33ad858d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42cfffad-252a-4823-8936-99b2254bb6df', 'volume_name': 'volume-42cfffad-252a-4823-8936-99b2254bb6df', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:52:36 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-d4d5ff11-c88e-45e5-b360-2ccd2a0f4ec6 tempest-VolumesTransfersV355Test-1543644574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ec9c348-ed79-4c91-9b2d-56d1a0144533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:52:36 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-d4d5ff11-c88e-45e5-b360-2ccd2a0f4ec6 tempest-VolumesTransfersV355Test-1543644574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ec9c348-ed79-4c91-9b2d-56d1a0144533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:52:36 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-d4d5ff11-c88e-45e5-b360-2ccd2a0f4ec6 tempest-VolumesTransfersV355Test-1543644574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c94386bc-093e-49df-8387-a3a6af150126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:52:36 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-d4d5ff11-c88e-45e5-b360-2ccd2a0f4ec6 tempest-VolumesTransfersV355Test-1543644574 None] Volume 42cfffad-252a-4823-8936-99b2254bb6df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42cfffad-252a-4823-8936-99b2254bb6df', 'volume_size': 1}
Jun 15 15:52:36 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-d4d5ff11-c88e-45e5-b360-2ccd2a0f4ec6 tempest-VolumesTransfersV355Test-1543644574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:52:36 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-d4d5ff11-c88e-45e5-b360-2ccd2a0f4ec6 tempest-VolumesTransfersV355Test-1543644574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:52:36 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-d4d5ff11-c88e-45e5-b360-2ccd2a0f4ec6 tempest-VolumesTransfersV355Test-1543644574 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:52:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1981535971',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42cfffad-252a-4823-8936-99b2254bb6df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b57cc7056a0a419b97a1d7737d70b350',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:52:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:52:37Z,use_quota=True,user_id='c30658ff96f748abb727bcced66f5449',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 15:52:36 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-d4d5ff11-c88e-45e5-b360-2ccd2a0f4ec6 tempest-VolumesTransfersV355Test-1543644574 None] Creating volume 42cfffad-252a-4823-8936-99b2254bb6df {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 15:52:36 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-d4d5ff11-c88e-45e5-b360-2ccd2a0f4ec6 tempest-VolumesTransfersV355Test-1543644574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:52:36 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-d4d5ff11-c88e-45e5-b360-2ccd2a0f4ec6 tempest-VolumesTransfersV355Test-1543644574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:52:36 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-d4d5ff11-c88e-45e5-b360-2ccd2a0f4ec6 tempest-VolumesTransfersV355Test-1543644574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:52:36 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-d4d5ff11-c88e-45e5-b360-2ccd2a0f4ec6 tempest-VolumesTransfersV355Test-1543644574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:52:36 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-d4d5ff11-c88e-45e5-b360-2ccd2a0f4ec6 tempest-VolumesTransfersV355Test-1543644574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:52:36 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-d4d5ff11-c88e-45e5-b360-2ccd2a0f4ec6 tempest-VolumesTransfersV355Test-1543644574 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 15:52:36 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-d4d5ff11-c88e-45e5-b360-2ccd2a0f4ec6 tempest-VolumesTransfersV355Test-1543644574 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 15:52:36 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-d4d5ff11-c88e-45e5-b360-2ccd2a0f4ec6 tempest-VolumesTransfersV355Test-1543644574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-42cfffad-252a-4823-8936-99b2254bb6df 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:52:36 devstack sudo[96943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-42cfffad-252a-4823-8936-99b2254bb6df 1073741824
Jun 15 15:52:36 devstack sudo[96943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:52:37 devstack sudo[96943]: pam_unix(sudo:session): session closed for user root
Jun 15 15:52:37 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-d4d5ff11-c88e-45e5-b360-2ccd2a0f4ec6 tempest-VolumesTransfersV355Test-1543644574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-42cfffad-252a-4823-8936-99b2254bb6df 1073741824" returned: 0 in 1.199s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:52:38 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-d4d5ff11-c88e-45e5-b360-2ccd2a0f4ec6 tempest-VolumesTransfersV355Test-1543644574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-42cfffad-252a-4823-8936-99b2254bb6df {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:52:38 devstack sudo[96984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-42cfffad-252a-4823-8936-99b2254bb6df
Jun 15 15:52:38 devstack sudo[96984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:52:39 devstack sudo[96984]: pam_unix(sudo:session): session closed for user root
Jun 15 15:52:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-d4d5ff11-c88e-45e5-b360-2ccd2a0f4ec6 tempest-VolumesTransfersV355Test-1543644574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-42cfffad-252a-4823-8936-99b2254bb6df" returned: 0 in 1.009s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:52:39 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-d4d5ff11-c88e-45e5-b360-2ccd2a0f4ec6 tempest-VolumesTransfersV355Test-1543644574 None] <== create_volume: return (2273ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 15:52:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-d4d5ff11-c88e-45e5-b360-2ccd2a0f4ec6 tempest-VolumesTransfersV355Test-1543644574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.278s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:52:39 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-d4d5ff11-c88e-45e5-b360-2ccd2a0f4ec6 tempest-VolumesTransfersV355Test-1543644574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c94386bc-093e-49df-8387-a3a6af150126) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42cfffad-252a-4823-8936-99b2254bb6df', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:52:39 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-d4d5ff11-c88e-45e5-b360-2ccd2a0f4ec6 tempest-VolumesTransfersV355Test-1543644574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e7ce6a2-2a30-4d4a-a191-f5097a0b42f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:52:39 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-d4d5ff11-c88e-45e5-b360-2ccd2a0f4ec6 tempest-VolumesTransfersV355Test-1543644574 None] Volume volume-42cfffad-252a-4823-8936-99b2254bb6df (42cfffad-252a-4823-8936-99b2254bb6df): created successfully
Jun 15 15:52:39 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-d4d5ff11-c88e-45e5-b360-2ccd2a0f4ec6 tempest-VolumesTransfersV355Test-1543644574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e7ce6a2-2a30-4d4a-a191-f5097a0b42f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:52:39 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-d4d5ff11-c88e-45e5-b360-2ccd2a0f4ec6 tempest-VolumesTransfersV355Test-1543644574 None] Flow 'volume_create_manager' (d64efb51-4124-4060-9c35-ae0c5a836d98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:52:39 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-d4d5ff11-c88e-45e5-b360-2ccd2a0f4ec6 tempest-VolumesTransfersV355Test-1543644574 None] Created volume successfully.
Jun 15 15:52:40 devstack cinder-volume[91863]: INFO cinder.volume.manager [req-f01c50d7-22e9-4001-b87a-b01c16440475 req-0112f83d-fcb5-4371-85f8-90178452b6c2 tempest-ServerActionsTestOtherA-2064227610 None] Terminate volume connection completed successfully.
Jun 15 15:52:40 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [req-f01c50d7-22e9-4001-b87a-b01c16440475 req-0112f83d-fcb5-4371-85f8-90178452b6c2 tempest-ServerActionsTestOtherA-2064227610 None] Deleting attachment 65105838-11c4-4391-852f-99cfe7a89604. {{(pid=91863) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 15 15:52:40 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-56924721-2fe9-43b5-863c-44c82510cd0c tempest-VolumesTransfersV355Test-520249924 None] Transfer volume completed successfully.
Jun 15 15:52:41 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-bb03b1c7-6068-4065-9dcf-06ca38c8e781 tempest-VolumesTransfersV355Test-2121697500 None] Acquiring lock "cinder-42cfffad-252a-4823-8936-99b2254bb6df-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:52:41 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-bb03b1c7-6068-4065-9dcf-06ca38c8e781 tempest-VolumesTransfersV355Test-2121697500 None] Lock "cinder-42cfffad-252a-4823-8936-99b2254bb6df-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:52:41 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-bb03b1c7-6068-4065-9dcf-06ca38c8e781 tempest-VolumesTransfersV355Test-2121697500 None] Acquiring lock "cinder-quobyte-42cfffad-252a-4823-8936-99b2254bb6df" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:52:41 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-bb03b1c7-6068-4065-9dcf-06ca38c8e781 tempest-VolumesTransfersV355Test-2121697500 None] Lock "cinder-quobyte-42cfffad-252a-4823-8936-99b2254bb6df" acquired by "delete_volume" :: waited 0.015s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:52:41 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1af95058-fc0e-4c38-9c02-c61200602c26]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:52:41 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-bb03b1c7-6068-4065-9dcf-06ca38c8e781 tempest-VolumesTransfersV355Test-2121697500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-42cfffad-252a-4823-8936-99b2254bb6df {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:52:42 devstack sudo[96995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-42cfffad-252a-4823-8936-99b2254bb6df
Jun 15 15:52:42 devstack sudo[96995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:52:42 devstack sudo[96995]: pam_unix(sudo:session): session closed for user root
Jun 15 15:52:42 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-bb03b1c7-6068-4065-9dcf-06ca38c8e781 tempest-VolumesTransfersV355Test-2121697500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-42cfffad-252a-4823-8936-99b2254bb6df" returned: 0 in 0.783s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:52:42 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-bb03b1c7-6068-4065-9dcf-06ca38c8e781 tempest-VolumesTransfersV355Test-2121697500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-42cfffad-252a-4823-8936-99b2254bb6df {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:52:42 devstack sudo[97000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-42cfffad-252a-4823-8936-99b2254bb6df
Jun 15 15:52:42 devstack sudo[97000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:52:43 devstack sudo[97000]: pam_unix(sudo:session): session closed for user root
Jun 15 15:52:43 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-bb03b1c7-6068-4065-9dcf-06ca38c8e781 tempest-VolumesTransfersV355Test-2121697500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-42cfffad-252a-4823-8936-99b2254bb6df" returned: 0 in 0.669s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:52:43 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-bb03b1c7-6068-4065-9dcf-06ca38c8e781 tempest-VolumesTransfersV355Test-2121697500 None] Lock "cinder-quobyte-42cfffad-252a-4823-8936-99b2254bb6df" released by "delete_volume" :: held 1.491s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:52:43 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-bb03b1c7-6068-4065-9dcf-06ca38c8e781 tempest-VolumesTransfersV355Test-2121697500 None] Created reservations ['b50ccf44-a9fe-4ed6-b481-6b87d2b867ae', 'dbb2c5ae-15e8-4ee4-a92e-eb37328a5c4a', 'da7fd97f-e3f4-4d29-8b20-091151a926f0', '3f60e8b0-88f9-41ce-adcd-a885b063223f'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:52:43 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-bb03b1c7-6068-4065-9dcf-06ca38c8e781 tempest-VolumesTransfersV355Test-2121697500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:52:43 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-bb03b1c7-6068-4065-9dcf-06ca38c8e781 tempest-VolumesTransfersV355Test-2121697500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:52:43 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-bb03b1c7-6068-4065-9dcf-06ca38c8e781 tempest-VolumesTransfersV355Test-2121697500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:52:43 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-bb03b1c7-6068-4065-9dcf-06ca38c8e781 tempest-VolumesTransfersV355Test-2121697500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:52:43 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-bb03b1c7-6068-4065-9dcf-06ca38c8e781 tempest-VolumesTransfersV355Test-2121697500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:52:43 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-bb03b1c7-6068-4065-9dcf-06ca38c8e781 tempest-VolumesTransfersV355Test-2121697500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:52:43 devstack sudo[97003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:52:43 devstack sudo[97003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:52:45 devstack sudo[97003]: pam_unix(sudo:session): session closed for user root
Jun 15 15:52:45 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-bb03b1c7-6068-4065-9dcf-06ca38c8e781 tempest-VolumesTransfersV355Test-2121697500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 1.580s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:52:45 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-bb03b1c7-6068-4065-9dcf-06ca38c8e781 tempest-VolumesTransfersV355Test-2121697500 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:52:45 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-bb03b1c7-6068-4065-9dcf-06ca38c8e781 tempest-VolumesTransfersV355Test-2121697500 None] Deleted volume successfully.
Jun 15 15:52:45 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e79fa16-e4fa-4975-a9c8-abd1eeb45c4a tempest-VolumesTransfersV355Test-1543644574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 15:52:45 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5e79fa16-e4fa-4975-a9c8-abd1eeb45c4a tempest-VolumesTransfersV355Test-1543644574 None] Flow 'volume_create_manager' (62dde57c-bcce-4ba7-9904-d06d58caa969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:52:45 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5e79fa16-e4fa-4975-a9c8-abd1eeb45c4a tempest-VolumesTransfersV355Test-1543644574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9aada7a6-a422-43b6-beb4-5e65a9a0a725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:52:45 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-bb03b1c7-6068-4065-9dcf-06ca38c8e781 tempest-VolumesTransfersV355Test-2121697500 None] Lock "cinder-42cfffad-252a-4823-8936-99b2254bb6df-delete_volume" released by "delete_volume" :: held 3.406s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:52:45 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5e79fa16-e4fa-4975-a9c8-abd1eeb45c4a tempest-VolumesTransfersV355Test-1543644574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9aada7a6-a422-43b6-beb4-5e65a9a0a725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:52:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1330580648',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ac3c012-cf75-4a15-8c03-61e4f27855eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b57cc7056a0a419b97a1d7737d70b350',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:52:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:52:45Z,use_quota=True,user_id='c30658ff96f748abb727bcced66f5449',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:52:45 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5e79fa16-e4fa-4975-a9c8-abd1eeb45c4a tempest-VolumesTransfersV355Test-1543644574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f580cc6-10fd-4247-9436-5f6a20a52285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:52:45 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5e79fa16-e4fa-4975-a9c8-abd1eeb45c4a tempest-VolumesTransfersV355Test-1543644574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f580cc6-10fd-4247-9436-5f6a20a52285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:52:45 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5e79fa16-e4fa-4975-a9c8-abd1eeb45c4a tempest-VolumesTransfersV355Test-1543644574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7d91c5c-1945-4f6d-959c-b0095ea10acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:52:45 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5e79fa16-e4fa-4975-a9c8-abd1eeb45c4a tempest-VolumesTransfersV355Test-1543644574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7d91c5c-1945-4f6d-959c-b0095ea10acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ac3c012-cf75-4a15-8c03-61e4f27855eb', 'volume_name': 'volume-4ac3c012-cf75-4a15-8c03-61e4f27855eb', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:52:45 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5e79fa16-e4fa-4975-a9c8-abd1eeb45c4a tempest-VolumesTransfersV355Test-1543644574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a6e415d-0671-4bb5-bdd2-6d5d400f9ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:52:45 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5e79fa16-e4fa-4975-a9c8-abd1eeb45c4a tempest-VolumesTransfersV355Test-1543644574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a6e415d-0671-4bb5-bdd2-6d5d400f9ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:52:45 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5e79fa16-e4fa-4975-a9c8-abd1eeb45c4a tempest-VolumesTransfersV355Test-1543644574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62ed4226-d52b-47ed-823f-9831e0fe41ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:52:45 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-5e79fa16-e4fa-4975-a9c8-abd1eeb45c4a tempest-VolumesTransfersV355Test-1543644574 None] Volume 4ac3c012-cf75-4a15-8c03-61e4f27855eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ac3c012-cf75-4a15-8c03-61e4f27855eb', 'volume_size': 1}
Jun 15 15:52:45 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-5e79fa16-e4fa-4975-a9c8-abd1eeb45c4a tempest-VolumesTransfersV355Test-1543644574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:52:45 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-5e79fa16-e4fa-4975-a9c8-abd1eeb45c4a tempest-VolumesTransfersV355Test-1543644574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:52:45 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-5e79fa16-e4fa-4975-a9c8-abd1eeb45c4a tempest-VolumesTransfersV355Test-1543644574 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:52:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1330580648',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ac3c012-cf75-4a15-8c03-61e4f27855eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b57cc7056a0a419b97a1d7737d70b350',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:52:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:52:45Z,use_quota=True,user_id='c30658ff96f748abb727bcced66f5449',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 15:52:45 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-5e79fa16-e4fa-4975-a9c8-abd1eeb45c4a tempest-VolumesTransfersV355Test-1543644574 None] Creating volume 4ac3c012-cf75-4a15-8c03-61e4f27855eb {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 15:52:45 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-5e79fa16-e4fa-4975-a9c8-abd1eeb45c4a tempest-VolumesTransfersV355Test-1543644574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:52:45 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-5e79fa16-e4fa-4975-a9c8-abd1eeb45c4a tempest-VolumesTransfersV355Test-1543644574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:52:45 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-5e79fa16-e4fa-4975-a9c8-abd1eeb45c4a tempest-VolumesTransfersV355Test-1543644574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:52:45 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-5e79fa16-e4fa-4975-a9c8-abd1eeb45c4a tempest-VolumesTransfersV355Test-1543644574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:52:45 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-5e79fa16-e4fa-4975-a9c8-abd1eeb45c4a tempest-VolumesTransfersV355Test-1543644574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:52:45 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-5e79fa16-e4fa-4975-a9c8-abd1eeb45c4a tempest-VolumesTransfersV355Test-1543644574 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 15:52:45 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-5e79fa16-e4fa-4975-a9c8-abd1eeb45c4a tempest-VolumesTransfersV355Test-1543644574 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 15:52:45 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5e79fa16-e4fa-4975-a9c8-abd1eeb45c4a tempest-VolumesTransfersV355Test-1543644574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4ac3c012-cf75-4a15-8c03-61e4f27855eb 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:52:45 devstack sudo[97040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4ac3c012-cf75-4a15-8c03-61e4f27855eb 1073741824
Jun 15 15:52:45 devstack sudo[97040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:52:46 devstack sudo[97040]: pam_unix(sudo:session): session closed for user root
Jun 15 15:52:46 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5e79fa16-e4fa-4975-a9c8-abd1eeb45c4a tempest-VolumesTransfersV355Test-1543644574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4ac3c012-cf75-4a15-8c03-61e4f27855eb 1073741824" returned: 0 in 1.207s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:52:46 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5e79fa16-e4fa-4975-a9c8-abd1eeb45c4a tempest-VolumesTransfersV355Test-1543644574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4ac3c012-cf75-4a15-8c03-61e4f27855eb {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:52:46 devstack sudo[97048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4ac3c012-cf75-4a15-8c03-61e4f27855eb
Jun 15 15:52:46 devstack sudo[97048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:52:47 devstack sudo[97048]: pam_unix(sudo:session): session closed for user root
Jun 15 15:52:47 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5e79fa16-e4fa-4975-a9c8-abd1eeb45c4a tempest-VolumesTransfersV355Test-1543644574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4ac3c012-cf75-4a15-8c03-61e4f27855eb" returned: 0 in 0.730s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:52:47 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-5e79fa16-e4fa-4975-a9c8-abd1eeb45c4a tempest-VolumesTransfersV355Test-1543644574 None] <== create_volume: return (2011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 15:52:47 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-5e79fa16-e4fa-4975-a9c8-abd1eeb45c4a tempest-VolumesTransfersV355Test-1543644574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.013s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:52:47 devstack cinder-volume[91863]: DEBUG dbcounter [-] [91863] Writing DB stats cinder:SELECT=51,cinder:INSERT=14,cinder:UPDATE=49,cinder:DELETE=4 {{(pid=91863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 15:52:47 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5e79fa16-e4fa-4975-a9c8-abd1eeb45c4a tempest-VolumesTransfersV355Test-1543644574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62ed4226-d52b-47ed-823f-9831e0fe41ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ac3c012-cf75-4a15-8c03-61e4f27855eb', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:52:47 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5e79fa16-e4fa-4975-a9c8-abd1eeb45c4a tempest-VolumesTransfersV355Test-1543644574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d17e067-9634-4b99-a270-a8aa16f0ebbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:52:47 devstack cinder-volume[91863]: DEBUG dbcounter [-] [91863] Writing DB stats cinder:SELECT=56,cinder:UPDATE=53,cinder:INSERT=20,cinder:DELETE=4 {{(pid=91863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 15:52:47 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-5e79fa16-e4fa-4975-a9c8-abd1eeb45c4a tempest-VolumesTransfersV355Test-1543644574 None] Volume volume-4ac3c012-cf75-4a15-8c03-61e4f27855eb (4ac3c012-cf75-4a15-8c03-61e4f27855eb): created successfully
Jun 15 15:52:47 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5e79fa16-e4fa-4975-a9c8-abd1eeb45c4a tempest-VolumesTransfersV355Test-1543644574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d17e067-9634-4b99-a270-a8aa16f0ebbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:52:47 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5e79fa16-e4fa-4975-a9c8-abd1eeb45c4a tempest-VolumesTransfersV355Test-1543644574 None] Flow 'volume_create_manager' (62dde57c-bcce-4ba7-9904-d06d58caa969) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:52:47 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-5e79fa16-e4fa-4975-a9c8-abd1eeb45c4a tempest-VolumesTransfersV355Test-1543644574 None] Created volume successfully.
Jun 15 15:52:48 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-45656b8a-c95c-41af-b01b-1641917e8014 tempest-VolumesTransfersV355Test-2121697500 None] Acquiring lock "cinder-4ac3c012-cf75-4a15-8c03-61e4f27855eb-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:52:48 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-45656b8a-c95c-41af-b01b-1641917e8014 tempest-VolumesTransfersV355Test-2121697500 None] Lock "cinder-4ac3c012-cf75-4a15-8c03-61e4f27855eb-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:52:48 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-45656b8a-c95c-41af-b01b-1641917e8014 tempest-VolumesTransfersV355Test-2121697500 None] Acquiring lock "cinder-quobyte-4ac3c012-cf75-4a15-8c03-61e4f27855eb" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:52:48 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-45656b8a-c95c-41af-b01b-1641917e8014 tempest-VolumesTransfersV355Test-2121697500 None] Lock "cinder-quobyte-4ac3c012-cf75-4a15-8c03-61e4f27855eb" acquired by "delete_volume" :: waited 0.014s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:52:48 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c10823f-009a-45b6-8750-f33802472638]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:52:48 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-45656b8a-c95c-41af-b01b-1641917e8014 tempest-VolumesTransfersV355Test-2121697500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4ac3c012-cf75-4a15-8c03-61e4f27855eb {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:52:48 devstack sudo[97090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4ac3c012-cf75-4a15-8c03-61e4f27855eb
Jun 15 15:52:48 devstack sudo[97090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:52:49 devstack sudo[97090]: pam_unix(sudo:session): session closed for user root
Jun 15 15:52:49 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-45656b8a-c95c-41af-b01b-1641917e8014 tempest-VolumesTransfersV355Test-2121697500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4ac3c012-cf75-4a15-8c03-61e4f27855eb" returned: 0 in 0.739s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:52:49 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-45656b8a-c95c-41af-b01b-1641917e8014 tempest-VolumesTransfersV355Test-2121697500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4ac3c012-cf75-4a15-8c03-61e4f27855eb {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:52:49 devstack sudo[97097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4ac3c012-cf75-4a15-8c03-61e4f27855eb
Jun 15 15:52:49 devstack sudo[97097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:52:50 devstack sudo[97097]: pam_unix(sudo:session): session closed for user root
Jun 15 15:52:50 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-45656b8a-c95c-41af-b01b-1641917e8014 tempest-VolumesTransfersV355Test-2121697500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4ac3c012-cf75-4a15-8c03-61e4f27855eb" returned: 0 in 0.695s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:52:50 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-45656b8a-c95c-41af-b01b-1641917e8014 tempest-VolumesTransfersV355Test-2121697500 None] Lock "cinder-quobyte-4ac3c012-cf75-4a15-8c03-61e4f27855eb" released by "delete_volume" :: held 1.470s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:52:50 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-45656b8a-c95c-41af-b01b-1641917e8014 tempest-VolumesTransfersV355Test-2121697500 None] Created reservations ['eec7dc14-115c-4b2b-b730-83462edad6ec', 'd4d60cec-0445-4540-a3b7-4b8d83761e45', '8c876726-de5e-4e49-bb7b-eaa313a5b071', '32e62a0a-65ac-40a0-937a-49f5108530f3'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:52:50 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-45656b8a-c95c-41af-b01b-1641917e8014 tempest-VolumesTransfersV355Test-2121697500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:52:50 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-45656b8a-c95c-41af-b01b-1641917e8014 tempest-VolumesTransfersV355Test-2121697500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:52:50 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-45656b8a-c95c-41af-b01b-1641917e8014 tempest-VolumesTransfersV355Test-2121697500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:52:50 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-45656b8a-c95c-41af-b01b-1641917e8014 tempest-VolumesTransfersV355Test-2121697500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:52:50 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-45656b8a-c95c-41af-b01b-1641917e8014 tempest-VolumesTransfersV355Test-2121697500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:52:50 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-45656b8a-c95c-41af-b01b-1641917e8014 tempest-VolumesTransfersV355Test-2121697500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:52:50 devstack sudo[97100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:52:50 devstack sudo[97100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:52:50 devstack sudo[97100]: pam_unix(sudo:session): session closed for user root
Jun 15 15:52:50 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-45656b8a-c95c-41af-b01b-1641917e8014 tempest-VolumesTransfersV355Test-2121697500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.583s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:52:50 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-45656b8a-c95c-41af-b01b-1641917e8014 tempest-VolumesTransfersV355Test-2121697500 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:52:50 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-45656b8a-c95c-41af-b01b-1641917e8014 tempest-VolumesTransfersV355Test-2121697500 None] Deleted volume successfully.
Jun 15 15:52:51 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-45656b8a-c95c-41af-b01b-1641917e8014 tempest-VolumesTransfersV355Test-2121697500 None] Lock "cinder-4ac3c012-cf75-4a15-8c03-61e4f27855eb-delete_volume" released by "delete_volume" :: held 2.247s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:52:52 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-59bc4b52-a917-46a6-823f-5703e7e56e85 tempest-ServerActionsTestOtherA-2064227610 None] Acquiring lock "cinder-fbe53393-aa09-4011-ac08-eaa2ec006039-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:52:52 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-59bc4b52-a917-46a6-823f-5703e7e56e85 tempest-ServerActionsTestOtherA-2064227610 None] Lock "cinder-fbe53393-aa09-4011-ac08-eaa2ec006039-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:52:52 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-59bc4b52-a917-46a6-823f-5703e7e56e85 tempest-ServerActionsTestOtherA-2064227610 None] Acquiring lock "cinder-quobyte-fbe53393-aa09-4011-ac08-eaa2ec006039" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:52:52 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-59bc4b52-a917-46a6-823f-5703e7e56e85 tempest-ServerActionsTestOtherA-2064227610 None] Lock "cinder-quobyte-fbe53393-aa09-4011-ac08-eaa2ec006039" acquired by "delete_volume" :: waited 0.015s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:52:52 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3384d44d-f87f-4433-a22d-3208735de6fd]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:52:52 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-59bc4b52-a917-46a6-823f-5703e7e56e85 tempest-ServerActionsTestOtherA-2064227610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fbe53393-aa09-4011-ac08-eaa2ec006039 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:52:52 devstack sudo[97105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fbe53393-aa09-4011-ac08-eaa2ec006039
Jun 15 15:52:52 devstack sudo[97105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:52:52 devstack sudo[97105]: pam_unix(sudo:session): session closed for user root
Jun 15 15:52:52 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-59bc4b52-a917-46a6-823f-5703e7e56e85 tempest-ServerActionsTestOtherA-2064227610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fbe53393-aa09-4011-ac08-eaa2ec006039" returned: 0 in 0.770s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:52:52 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-59bc4b52-a917-46a6-823f-5703e7e56e85 tempest-ServerActionsTestOtherA-2064227610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fbe53393-aa09-4011-ac08-eaa2ec006039 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:52:52 devstack sudo[97110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fbe53393-aa09-4011-ac08-eaa2ec006039
Jun 15 15:52:52 devstack sudo[97110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:52:53 devstack sudo[97110]: pam_unix(sudo:session): session closed for user root
Jun 15 15:52:53 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-59bc4b52-a917-46a6-823f-5703e7e56e85 tempest-ServerActionsTestOtherA-2064227610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fbe53393-aa09-4011-ac08-eaa2ec006039" returned: 0 in 0.672s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:52:53 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-59bc4b52-a917-46a6-823f-5703e7e56e85 tempest-ServerActionsTestOtherA-2064227610 None] Lock "cinder-quobyte-fbe53393-aa09-4011-ac08-eaa2ec006039" released by "delete_volume" :: held 1.481s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:52:53 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-59bc4b52-a917-46a6-823f-5703e7e56e85 tempest-ServerActionsTestOtherA-2064227610 None] Created reservations ['98a15745-78f9-4830-b5c2-c0e59d527dc5', 'edcd9fc8-7d91-45e3-a582-b5adbdc99dc0', '96d217ef-9873-458e-b99d-4a35f014c003', '115bfa54-069b-4243-9f40-c3631ee00c03'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:52:53 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-59bc4b52-a917-46a6-823f-5703e7e56e85 tempest-ServerActionsTestOtherA-2064227610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:52:53 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-59bc4b52-a917-46a6-823f-5703e7e56e85 tempest-ServerActionsTestOtherA-2064227610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:52:53 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-59bc4b52-a917-46a6-823f-5703e7e56e85 tempest-ServerActionsTestOtherA-2064227610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:52:53 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-59bc4b52-a917-46a6-823f-5703e7e56e85 tempest-ServerActionsTestOtherA-2064227610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:52:53 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-59bc4b52-a917-46a6-823f-5703e7e56e85 tempest-ServerActionsTestOtherA-2064227610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:52:53 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-59bc4b52-a917-46a6-823f-5703e7e56e85 tempest-ServerActionsTestOtherA-2064227610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:52:53 devstack sudo[97113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:52:53 devstack sudo[97113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:52:54 devstack sudo[97113]: pam_unix(sudo:session): session closed for user root
Jun 15 15:52:54 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-59bc4b52-a917-46a6-823f-5703e7e56e85 tempest-ServerActionsTestOtherA-2064227610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.840s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:52:54 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-59bc4b52-a917-46a6-823f-5703e7e56e85 tempest-ServerActionsTestOtherA-2064227610 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:52:54 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-59bc4b52-a917-46a6-823f-5703e7e56e85 tempest-ServerActionsTestOtherA-2064227610 None] Deleted volume successfully.
Jun 15 15:52:54 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-59bc4b52-a917-46a6-823f-5703e7e56e85 tempest-ServerActionsTestOtherA-2064227610 None] Lock "cinder-fbe53393-aa09-4011-ac08-eaa2ec006039-delete_volume" released by "delete_volume" :: held 2.565s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:52:58 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-692ac6c7-b814-4a74-b6f5-07c29619b7cd tempest-VolumesExtendTest-25562998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 15:52:58 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-692ac6c7-b814-4a74-b6f5-07c29619b7cd tempest-VolumesExtendTest-25562998 None] Flow 'volume_create_manager' (2fd2cdf8-120c-4476-a4f3-fae7ad926a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:52:58 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-692ac6c7-b814-4a74-b6f5-07c29619b7cd tempest-VolumesExtendTest-25562998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c93beaab-69a4-42eb-a581-65a9e6a6dcf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:52:58 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-692ac6c7-b814-4a74-b6f5-07c29619b7cd tempest-VolumesExtendTest-25562998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c93beaab-69a4-42eb-a581-65a9e6a6dcf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:52:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-737017576',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e665f87-f19c-4e62-8bb6-f6c7786e3f82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c23cf4e65af84962a2baebc2cf953177',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:52:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:52:58Z,use_quota=True,user_id='9123bef351bf488a915163e50fc69a49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:52:58 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-692ac6c7-b814-4a74-b6f5-07c29619b7cd tempest-VolumesExtendTest-25562998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cca08ed-ad2f-47bc-8ef1-84abe5585f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:52:58 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-692ac6c7-b814-4a74-b6f5-07c29619b7cd tempest-VolumesExtendTest-25562998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cca08ed-ad2f-47bc-8ef1-84abe5585f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:52:58 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-692ac6c7-b814-4a74-b6f5-07c29619b7cd tempest-VolumesExtendTest-25562998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df628d96-5cba-487a-bc95-6cc0f89f0d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:52:58 devstack cinder-volume[91863]: DEBUG cinder.image.glance [None req-692ac6c7-b814-4a74-b6f5-07c29619b7cd tempest-VolumesExtendTest-25562998 None] Creating Keystone auth plugin from conf {{(pid=91863) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 15 15:52:58 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-692ac6c7-b814-4a74-b6f5-07c29619b7cd tempest-VolumesExtendTest-25562998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df628d96-5cba-487a-bc95-6cc0f89f0d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4e665f87-f19c-4e62-8bb6-f6c7786e3f82', 'volume_name': 'volume-4e665f87-f19c-4e62-8bb6-f6c7786e3f82', 'volume_size': 1, 'image_id': '43adaed4-5eec-483a-aa2b-0818266a94f1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/43adaed4-5eec-483a-aa2b-0818266a94f1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '601536f092c54cdc9ee754c7b1abc241', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '43adaed4-5eec-483a-aa2b-0818266a94f1', 'created_at': datetime.datetime(2026, 6, 15, 13, 42, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 13, 42, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/43adaed4-5eec-483a-aa2b-0818266a94f1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7739546dd520>}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:52:58 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-692ac6c7-b814-4a74-b6f5-07c29619b7cd tempest-VolumesExtendTest-25562998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a976319e-8fca-41af-b03c-9ad076b926f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:52:58 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-692ac6c7-b814-4a74-b6f5-07c29619b7cd tempest-VolumesExtendTest-25562998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a976319e-8fca-41af-b03c-9ad076b926f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:52:58 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-692ac6c7-b814-4a74-b6f5-07c29619b7cd tempest-VolumesExtendTest-25562998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (237b3e93-2c32-4024-b063-5d6a36ce8895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:52:58 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-692ac6c7-b814-4a74-b6f5-07c29619b7cd tempest-VolumesExtendTest-25562998 None] Volume 4e665f87-f19c-4e62-8bb6-f6c7786e3f82: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4e665f87-f19c-4e62-8bb6-f6c7786e3f82', 'volume_size': 1, 'image_id': '43adaed4-5eec-483a-aa2b-0818266a94f1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/43adaed4-5eec-483a-aa2b-0818266a94f1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '601536f092c54cdc9ee754c7b1abc241', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '43adaed4-5eec-483a-aa2b-0818266a94f1', 'created_at': datetime.datetime(2026, 6, 15, 13, 42, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 13, 42, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/43adaed4-5eec-483a-aa2b-0818266a94f1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7739546dd520>}
Jun 15 15:52:58 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-692ac6c7-b814-4a74-b6f5-07c29619b7cd tempest-VolumesExtendTest-25562998 None] Trying to clone 4e665f87-f19c-4e62-8bb6-f6c7786e3f82 from image 43adaed4-5eec-483a-aa2b-0818266a94f1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/43adaed4-5eec-483a-aa2b-0818266a94f1', 'metadata': {}}]). {{(pid=91863) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jun 15 15:52:58 devstack cinder-volume[91863]: DEBUG cinder.image.image_utils [None req-692ac6c7-b814-4a74-b6f5-07c29619b7cd tempest-VolumesExtendTest-25562998 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_43adaed4-5eec-483a-aa2b-0818266a94f1_1ky6new4devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=91863) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 15 15:52:58 devstack cinder-volume[91863]: INFO cinder.image.image_utils [None req-692ac6c7-b814-4a74-b6f5-07c29619b7cd tempest-VolumesExtendTest-25562998 None] Image download 20.69 MB at 20.69 MB/s
Jun 15 15:52:58 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd3da53-e366-4104-aa85-518a36039c0e]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:52:58 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-692ac6c7-b814-4a74-b6f5-07c29619b7cd tempest-VolumesExtendTest-25562998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_43adaed4-5eec-483a-aa2b-0818266a94f1_1ky6new4devstack@QuobyteHD {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:52:58 devstack sudo[97178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_43adaed4-5eec-483a-aa2b-0818266a94f1_1ky6new4devstack@QuobyteHD
Jun 15 15:52:58 devstack sudo[97178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:52:59 devstack sudo[97178]: pam_unix(sudo:session): session closed for user root
Jun 15 15:52:59 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-692ac6c7-b814-4a74-b6f5-07c29619b7cd tempest-VolumesExtendTest-25562998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_43adaed4-5eec-483a-aa2b-0818266a94f1_1ky6new4devstack@QuobyteHD" returned: 0 in 0.696s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:52:59 devstack cinder-volume[91863]: DEBUG cinder.image.image_utils [None req-692ac6c7-b814-4a74-b6f5-07c29619b7cd tempest-VolumesExtendTest-25562998 None] Temporary image 43adaed4-5eec-483a-aa2b-0818266a94f1 is fetched for user 9123bef351bf488a915163e50fc69a49. {{(pid=91863) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 15 15:52:59 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[24af897b-99e4-415e-a232-e3d1ec6436ec]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:52:59 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-692ac6c7-b814-4a74-b6f5-07c29619b7cd tempest-VolumesExtendTest-25562998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_43adaed4-5eec-483a-aa2b-0818266a94f1_1ky6new4devstack@QuobyteHD {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:52:59 devstack sudo[97189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_43adaed4-5eec-483a-aa2b-0818266a94f1_1ky6new4devstack@QuobyteHD
Jun 15 15:52:59 devstack sudo[97189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:53:00 devstack sudo[97189]: pam_unix(sudo:session): session closed for user root
Jun 15 15:53:00 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-692ac6c7-b814-4a74-b6f5-07c29619b7cd tempest-VolumesExtendTest-25562998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_43adaed4-5eec-483a-aa2b-0818266a94f1_1ky6new4devstack@QuobyteHD" returned: 0 in 0.765s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:53:00 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-692ac6c7-b814-4a74-b6f5-07c29619b7cd tempest-VolumesExtendTest-25562998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:53:00 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-692ac6c7-b814-4a74-b6f5-07c29619b7cd tempest-VolumesExtendTest-25562998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:53:00 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-692ac6c7-b814-4a74-b6f5-07c29619b7cd tempest-VolumesExtendTest-25562998 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:52:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-737017576',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e665f87-f19c-4e62-8bb6-f6c7786e3f82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c23cf4e65af84962a2baebc2cf953177',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:52:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:52:58Z,use_quota=True,user_id='9123bef351bf488a915163e50fc69a49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 15:53:00 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-692ac6c7-b814-4a74-b6f5-07c29619b7cd tempest-VolumesExtendTest-25562998 None] Creating volume 4e665f87-f19c-4e62-8bb6-f6c7786e3f82 {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 15:53:00 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-692ac6c7-b814-4a74-b6f5-07c29619b7cd tempest-VolumesExtendTest-25562998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:53:00 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-692ac6c7-b814-4a74-b6f5-07c29619b7cd tempest-VolumesExtendTest-25562998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:53:00 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-692ac6c7-b814-4a74-b6f5-07c29619b7cd tempest-VolumesExtendTest-25562998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:53:00 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-692ac6c7-b814-4a74-b6f5-07c29619b7cd tempest-VolumesExtendTest-25562998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:53:00 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-692ac6c7-b814-4a74-b6f5-07c29619b7cd tempest-VolumesExtendTest-25562998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:53:00 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-692ac6c7-b814-4a74-b6f5-07c29619b7cd tempest-VolumesExtendTest-25562998 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 15:53:00 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-692ac6c7-b814-4a74-b6f5-07c29619b7cd tempest-VolumesExtendTest-25562998 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 15:53:00 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-692ac6c7-b814-4a74-b6f5-07c29619b7cd tempest-VolumesExtendTest-25562998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4e665f87-f19c-4e62-8bb6-f6c7786e3f82 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:53:00 devstack sudo[97197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4e665f87-f19c-4e62-8bb6-f6c7786e3f82 1073741824
Jun 15 15:53:00 devstack sudo[97197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:53:00 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-71411d9f-d87b-4f00-bcee-ae7752e39f47 tempest-AttachVolumeShelveTestJSON-1587912764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 15:53:00 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-71411d9f-d87b-4f00-bcee-ae7752e39f47 tempest-AttachVolumeShelveTestJSON-1587912764 None] Flow 'volume_create_manager' (ab82f8d2-25e4-451a-a24e-ad4056a9967b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:53:00 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-71411d9f-d87b-4f00-bcee-ae7752e39f47 tempest-AttachVolumeShelveTestJSON-1587912764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fe19b51-36ff-45b6-bacb-ff18e92bdc27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:53:00 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-71411d9f-d87b-4f00-bcee-ae7752e39f47 tempest-AttachVolumeShelveTestJSON-1587912764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fe19b51-36ff-45b6-bacb-ff18e92bdc27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:53:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-41636546',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d1ddc76-52a6-4f15-ab8d-e0cffbaf014e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7db3a91d7d47491299631a4fbac721ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:53:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:53:01Z,use_quota=True,user_id='b89a6c345dfa4dfc8058bc5fa471785d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:53:00 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-71411d9f-d87b-4f00-bcee-ae7752e39f47 tempest-AttachVolumeShelveTestJSON-1587912764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4533979-6d38-42bd-b920-da4bedd9862d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:53:00 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-71411d9f-d87b-4f00-bcee-ae7752e39f47 tempest-AttachVolumeShelveTestJSON-1587912764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4533979-6d38-42bd-b920-da4bedd9862d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:53:00 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-71411d9f-d87b-4f00-bcee-ae7752e39f47 tempest-AttachVolumeShelveTestJSON-1587912764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a265681-2a7e-4a2d-ba59-d89ae178069f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:53:00 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-71411d9f-d87b-4f00-bcee-ae7752e39f47 tempest-AttachVolumeShelveTestJSON-1587912764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a265681-2a7e-4a2d-ba59-d89ae178069f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d1ddc76-52a6-4f15-ab8d-e0cffbaf014e', 'volume_name': 'volume-0d1ddc76-52a6-4f15-ab8d-e0cffbaf014e', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:53:00 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-71411d9f-d87b-4f00-bcee-ae7752e39f47 tempest-AttachVolumeShelveTestJSON-1587912764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96d07f61-023f-4e2f-ba16-247d343add99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:53:00 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-71411d9f-d87b-4f00-bcee-ae7752e39f47 tempest-AttachVolumeShelveTestJSON-1587912764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96d07f61-023f-4e2f-ba16-247d343add99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:53:00 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-71411d9f-d87b-4f00-bcee-ae7752e39f47 tempest-AttachVolumeShelveTestJSON-1587912764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5c14ac0-45e0-4d2c-9467-b3c775e9094d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:53:00 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-71411d9f-d87b-4f00-bcee-ae7752e39f47 tempest-AttachVolumeShelveTestJSON-1587912764 None] Volume 0d1ddc76-52a6-4f15-ab8d-e0cffbaf014e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d1ddc76-52a6-4f15-ab8d-e0cffbaf014e', 'volume_size': 1}
Jun 15 15:53:00 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-71411d9f-d87b-4f00-bcee-ae7752e39f47 tempest-AttachVolumeShelveTestJSON-1587912764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:53:01 devstack sudo[97197]: pam_unix(sudo:session): session closed for user root
Jun 15 15:53:01 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-692ac6c7-b814-4a74-b6f5-07c29619b7cd tempest-VolumesExtendTest-25562998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4e665f87-f19c-4e62-8bb6-f6c7786e3f82 1073741824" returned: 0 in 0.770s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:53:01 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-692ac6c7-b814-4a74-b6f5-07c29619b7cd tempest-VolumesExtendTest-25562998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4e665f87-f19c-4e62-8bb6-f6c7786e3f82 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:53:01 devstack sudo[97206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4e665f87-f19c-4e62-8bb6-f6c7786e3f82
Jun 15 15:53:01 devstack sudo[97206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:53:01 devstack sudo[97206]: pam_unix(sudo:session): session closed for user root
Jun 15 15:53:01 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-692ac6c7-b814-4a74-b6f5-07c29619b7cd tempest-VolumesExtendTest-25562998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4e665f87-f19c-4e62-8bb6-f6c7786e3f82" returned: 0 in 0.624s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:53:01 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-692ac6c7-b814-4a74-b6f5-07c29619b7cd tempest-VolumesExtendTest-25562998 None] <== create_volume: return (1450ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 15:53:01 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-692ac6c7-b814-4a74-b6f5-07c29619b7cd tempest-VolumesExtendTest-25562998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.454s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:53:01 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-71411d9f-d87b-4f00-bcee-ae7752e39f47 tempest-AttachVolumeShelveTestJSON-1587912764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.851s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:53:01 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-71411d9f-d87b-4f00-bcee-ae7752e39f47 tempest-AttachVolumeShelveTestJSON-1587912764 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:53:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-41636546',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d1ddc76-52a6-4f15-ab8d-e0cffbaf014e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7db3a91d7d47491299631a4fbac721ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:53:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:53:01Z,use_quota=True,user_id='b89a6c345dfa4dfc8058bc5fa471785d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 15:53:01 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-71411d9f-d87b-4f00-bcee-ae7752e39f47 tempest-AttachVolumeShelveTestJSON-1587912764 None] Creating volume 0d1ddc76-52a6-4f15-ab8d-e0cffbaf014e {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 15:53:01 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-71411d9f-d87b-4f00-bcee-ae7752e39f47 tempest-AttachVolumeShelveTestJSON-1587912764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:53:01 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-71411d9f-d87b-4f00-bcee-ae7752e39f47 tempest-AttachVolumeShelveTestJSON-1587912764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:53:01 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-71411d9f-d87b-4f00-bcee-ae7752e39f47 tempest-AttachVolumeShelveTestJSON-1587912764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:53:01 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-71411d9f-d87b-4f00-bcee-ae7752e39f47 tempest-AttachVolumeShelveTestJSON-1587912764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:53:01 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-71411d9f-d87b-4f00-bcee-ae7752e39f47 tempest-AttachVolumeShelveTestJSON-1587912764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:53:01 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-71411d9f-d87b-4f00-bcee-ae7752e39f47 tempest-AttachVolumeShelveTestJSON-1587912764 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 15:53:01 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-71411d9f-d87b-4f00-bcee-ae7752e39f47 tempest-AttachVolumeShelveTestJSON-1587912764 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 15:53:01 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-71411d9f-d87b-4f00-bcee-ae7752e39f47 tempest-AttachVolumeShelveTestJSON-1587912764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-0d1ddc76-52a6-4f15-ab8d-e0cffbaf014e 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:53:01 devstack sudo[97209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-0d1ddc76-52a6-4f15-ab8d-e0cffbaf014e 1073741824
Jun 15 15:53:01 devstack sudo[97209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:53:01 devstack cinder-volume[91863]: DEBUG cinder.volume.volume_utils [None req-692ac6c7-b814-4a74-b6f5-07c29619b7cd tempest-VolumesExtendTest-25562998 None] Attempting download of 43adaed4-5eec-483a-aa2b-0818266a94f1 ((None, [{'url': 'file:///opt/stack/data/glance/images/43adaed4-5eec-483a-aa2b-0818266a94f1', 'metadata': {}}])) to volume 4e665f87-f19c-4e62-8bb6-f6c7786e3f82. {{(pid=91863) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 15 15:53:01 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3192c868-4967-4701-b4f6-a9b4ec033404]: (4, 'raw') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:53:01 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-692ac6c7-b814-4a74-b6f5-07c29619b7cd tempest-VolumesExtendTest-25562998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_43adaed4-5eec-483a-aa2b-0818266a94f1_64gdecnb {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:53:01 devstack sudo[97211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_43adaed4-5eec-483a-aa2b-0818266a94f1_64gdecnb
Jun 15 15:53:01 devstack sudo[97211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:53:02 devstack sudo[97211]: pam_unix(sudo:session): session closed for user root
Jun 15 15:53:02 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-692ac6c7-b814-4a74-b6f5-07c29619b7cd tempest-VolumesExtendTest-25562998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_43adaed4-5eec-483a-aa2b-0818266a94f1_64gdecnb" returned: 0 in 0.848s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:53:02 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-692ac6c7-b814-4a74-b6f5-07c29619b7cd tempest-VolumesExtendTest-25562998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_43adaed4-5eec-483a-aa2b-0818266a94f1_64gdecnb {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:53:03 devstack sudo[97209]: pam_unix(sudo:session): session closed for user root
Jun 15 15:53:03 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-71411d9f-d87b-4f00-bcee-ae7752e39f47 tempest-AttachVolumeShelveTestJSON-1587912764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-0d1ddc76-52a6-4f15-ab8d-e0cffbaf014e 1073741824" returned: 0 in 1.278s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:53:03 devstack sudo[97226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_43adaed4-5eec-483a-aa2b-0818266a94f1_64gdecnb
Jun 15 15:53:03 devstack sudo[97226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:53:03 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-71411d9f-d87b-4f00-bcee-ae7752e39f47 tempest-AttachVolumeShelveTestJSON-1587912764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-0d1ddc76-52a6-4f15-ab8d-e0cffbaf014e {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:53:03 devstack sudo[97267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-0d1ddc76-52a6-4f15-ab8d-e0cffbaf014e
Jun 15 15:53:03 devstack sudo[97267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:53:03 devstack sudo[97226]: pam_unix(sudo:session): session closed for user root
Jun 15 15:53:03 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-692ac6c7-b814-4a74-b6f5-07c29619b7cd tempest-VolumesExtendTest-25562998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_43adaed4-5eec-483a-aa2b-0818266a94f1_64gdecnb" returned: 1 in 1.277s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:53:03 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-692ac6c7-b814-4a74-b6f5-07c29619b7cd tempest-VolumesExtendTest-25562998 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_43adaed4-5eec-483a-aa2b-0818266a94f1_64gdecnb' failed. Not Retrying. {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 15 15:53:03 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd2e494-a700-4b7c-bca0-74636a5a29ea]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:53:03 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-692ac6c7-b814-4a74-b6f5-07c29619b7cd tempest-VolumesExtendTest-25562998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_43adaed4-5eec-483a-aa2b-0818266a94f1_1ky6new4devstack@QuobyteHD {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:53:04 devstack sudo[97286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_43adaed4-5eec-483a-aa2b-0818266a94f1_1ky6new4devstack@QuobyteHD
Jun 15 15:53:04 devstack sudo[97286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:53:04 devstack sudo[97267]: pam_unix(sudo:session): session closed for user root
Jun 15 15:53:04 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-71411d9f-d87b-4f00-bcee-ae7752e39f47 tempest-AttachVolumeShelveTestJSON-1587912764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-0d1ddc76-52a6-4f15-ab8d-e0cffbaf014e" returned: 0 in 1.157s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:53:04 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-71411d9f-d87b-4f00-bcee-ae7752e39f47 tempest-AttachVolumeShelveTestJSON-1587912764 None] <== create_volume: return (2566ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 15:53:04 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-71411d9f-d87b-4f00-bcee-ae7752e39f47 tempest-AttachVolumeShelveTestJSON-1587912764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.569s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:53:04 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-71411d9f-d87b-4f00-bcee-ae7752e39f47 tempest-AttachVolumeShelveTestJSON-1587912764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5c14ac0-45e0-4d2c-9467-b3c775e9094d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d1ddc76-52a6-4f15-ab8d-e0cffbaf014e', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:53:04 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-71411d9f-d87b-4f00-bcee-ae7752e39f47 tempest-AttachVolumeShelveTestJSON-1587912764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5447520e-70a3-415a-8809-12fbb178ecb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:53:04 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-71411d9f-d87b-4f00-bcee-ae7752e39f47 tempest-AttachVolumeShelveTestJSON-1587912764 None] Volume volume-0d1ddc76-52a6-4f15-ab8d-e0cffbaf014e (0d1ddc76-52a6-4f15-ab8d-e0cffbaf014e): created successfully
Jun 15 15:53:04 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-71411d9f-d87b-4f00-bcee-ae7752e39f47 tempest-AttachVolumeShelveTestJSON-1587912764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5447520e-70a3-415a-8809-12fbb178ecb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:53:04 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-71411d9f-d87b-4f00-bcee-ae7752e39f47 tempest-AttachVolumeShelveTestJSON-1587912764 None] Flow 'volume_create_manager' (ab82f8d2-25e4-451a-a24e-ad4056a9967b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:53:04 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-71411d9f-d87b-4f00-bcee-ae7752e39f47 tempest-AttachVolumeShelveTestJSON-1587912764 None] Created volume successfully.
Jun 15 15:53:04 devstack sudo[97286]: pam_unix(sudo:session): session closed for user root
Jun 15 15:53:04 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-692ac6c7-b814-4a74-b6f5-07c29619b7cd tempest-VolumesExtendTest-25562998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_43adaed4-5eec-483a-aa2b-0818266a94f1_1ky6new4devstack@QuobyteHD" returned: 0 in 1.006s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:53:04 devstack cinder-volume[91863]: DEBUG cinder.image.image_utils [None req-692ac6c7-b814-4a74-b6f5-07c29619b7cd tempest-VolumesExtendTest-25562998 None] 43adaed4-5eec-483a-aa2b-0818266a94f1 was qcow2, converting to raw {{(pid=91863) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 15 15:53:04 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-692ac6c7-b814-4a74-b6f5-07c29619b7cd tempest-VolumesExtendTest-25562998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_43adaed4-5eec-483a-aa2b-0818266a94f1_1ky6new4devstack@QuobyteHD /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4e665f87-f19c-4e62-8bb6-f6c7786e3f82 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:53:05 devstack sudo[97298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_43adaed4-5eec-483a-aa2b-0818266a94f1_1ky6new4devstack@QuobyteHD /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4e665f87-f19c-4e62-8bb6-f6c7786e3f82
Jun 15 15:53:05 devstack sudo[97298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:53:08 devstack sudo[97298]: pam_unix(sudo:session): session closed for user root
Jun 15 15:53:08 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-692ac6c7-b814-4a74-b6f5-07c29619b7cd tempest-VolumesExtendTest-25562998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_43adaed4-5eec-483a-aa2b-0818266a94f1_1ky6new4devstack@QuobyteHD /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4e665f87-f19c-4e62-8bb6-f6c7786e3f82" returned: 0 in 3.277s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:53:08 devstack cinder-volume[91863]: DEBUG cinder.image.image_utils [None req-692ac6c7-b814-4a74-b6f5-07c29619b7cd tempest-VolumesExtendTest-25562998 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_43adaed4-5eec-483a-aa2b-0818266a94f1_1ky6new4devstack@QuobyteHD, size 112.00 MB, duration 3.28 sec, destination /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4e665f87-f19c-4e62-8bb6-f6c7786e3f82 {{(pid=91863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 15 15:53:08 devstack cinder-volume[91863]: INFO cinder.image.image_utils [None req-692ac6c7-b814-4a74-b6f5-07c29619b7cd tempest-VolumesExtendTest-25562998 None] Converted 112.00 MB image at 34.17 MB/s
Jun 15 15:53:08 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-692ac6c7-b814-4a74-b6f5-07c29619b7cd tempest-VolumesExtendTest-25562998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4e665f87-f19c-4e62-8bb6-f6c7786e3f82 1G {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:53:08 devstack sudo[97315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4e665f87-f19c-4e62-8bb6-f6c7786e3f82 1G
Jun 15 15:53:08 devstack sudo[97315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:53:09 devstack sudo[97315]: pam_unix(sudo:session): session closed for user root
Jun 15 15:53:09 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-692ac6c7-b814-4a74-b6f5-07c29619b7cd tempest-VolumesExtendTest-25562998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4e665f87-f19c-4e62-8bb6-f6c7786e3f82 1G" returned: 0 in 1.566s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:53:09 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecbaced1-a0d5-4882-bab6-138123531543]: (4, 'raw') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:53:09 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-692ac6c7-b814-4a74-b6f5-07c29619b7cd tempest-VolumesExtendTest-25562998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4e665f87-f19c-4e62-8bb6-f6c7786e3f82 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:53:10 devstack sudo[97389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4e665f87-f19c-4e62-8bb6-f6c7786e3f82
Jun 15 15:53:10 devstack sudo[97389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:53:11 devstack sudo[97389]: pam_unix(sudo:session): session closed for user root
Jun 15 15:53:11 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-692ac6c7-b814-4a74-b6f5-07c29619b7cd tempest-VolumesExtendTest-25562998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4e665f87-f19c-4e62-8bb6-f6c7786e3f82" returned: 0 in 1.507s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:53:11 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-692ac6c7-b814-4a74-b6f5-07c29619b7cd tempest-VolumesExtendTest-25562998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4e665f87-f19c-4e62-8bb6-f6c7786e3f82 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:53:11 devstack sudo[97423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4e665f87-f19c-4e62-8bb6-f6c7786e3f82
Jun 15 15:53:11 devstack sudo[97423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:53:12 devstack sudo[97423]: pam_unix(sudo:session): session closed for user root
Jun 15 15:53:12 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-692ac6c7-b814-4a74-b6f5-07c29619b7cd tempest-VolumesExtendTest-25562998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4e665f87-f19c-4e62-8bb6-f6c7786e3f82" returned: 1 in 1.348s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:53:12 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-692ac6c7-b814-4a74-b6f5-07c29619b7cd tempest-VolumesExtendTest-25562998 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4e665f87-f19c-4e62-8bb6-f6c7786e3f82' failed. Not Retrying. {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 15 15:53:12 devstack cinder-volume[91863]: DEBUG cinder.volume.volume_utils [None req-692ac6c7-b814-4a74-b6f5-07c29619b7cd tempest-VolumesExtendTest-25562998 None] Downloaded image 43adaed4-5eec-483a-aa2b-0818266a94f1 ((None, [{'url': 'file:///opt/stack/data/glance/images/43adaed4-5eec-483a-aa2b-0818266a94f1', 'metadata': {}}])) to volume 4e665f87-f19c-4e62-8bb6-f6c7786e3f82 successfully. {{(pid=91863) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 15 15:53:12 devstack cinder-volume[91863]: DEBUG cinder.image.image_utils [None req-692ac6c7-b814-4a74-b6f5-07c29619b7cd tempest-VolumesExtendTest-25562998 None] Temporary image 43adaed4-5eec-483a-aa2b-0818266a94f1 for user 9123bef351bf488a915163e50fc69a49 is deleted. {{(pid=91863) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 15 15:53:12 devstack cinder-volume[91863]: DEBUG cinder.volume.volume_utils [None req-692ac6c7-b814-4a74-b6f5-07c29619b7cd tempest-VolumesExtendTest-25562998 None] Marking volume 4e665f87-f19c-4e62-8bb6-f6c7786e3f82 as bootable. {{(pid=91863) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 15 15:53:12 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-692ac6c7-b814-4a74-b6f5-07c29619b7cd tempest-VolumesExtendTest-25562998 None] Copying metadata from image 43adaed4-5eec-483a-aa2b-0818266a94f1 to 4e665f87-f19c-4e62-8bb6-f6c7786e3f82. {{(pid=91863) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 15 15:53:12 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-692ac6c7-b814-4a74-b6f5-07c29619b7cd tempest-VolumesExtendTest-25562998 None] Creating volume glance metadata for volume 4e665f87-f19c-4e62-8bb6-f6c7786e3f82 backed by image 43adaed4-5eec-483a-aa2b-0818266a94f1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '43adaed4-5eec-483a-aa2b-0818266a94f1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=91863) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 15 15:53:12 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-692ac6c7-b814-4a74-b6f5-07c29619b7cd tempest-VolumesExtendTest-25562998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (237b3e93-2c32-4024-b063-5d6a36ce8895) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e665f87-f19c-4e62-8bb6-f6c7786e3f82', 'volume_size': 1, 'image_id': '43adaed4-5eec-483a-aa2b-0818266a94f1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/43adaed4-5eec-483a-aa2b-0818266a94f1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '601536f092c54cdc9ee754c7b1abc241', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '43adaed4-5eec-483a-aa2b-0818266a94f1', 'created_at': datetime.datetime(2026, 6, 15, 13, 42, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 13, 42, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/43adaed4-5eec-483a-aa2b-0818266a94f1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7739546dd520>}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:53:12 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-692ac6c7-b814-4a74-b6f5-07c29619b7cd tempest-VolumesExtendTest-25562998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edef9053-df35-4fe1-bdf2-5b970f263651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:53:12 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-692ac6c7-b814-4a74-b6f5-07c29619b7cd tempest-VolumesExtendTest-25562998 None] Volume volume-4e665f87-f19c-4e62-8bb6-f6c7786e3f82 (4e665f87-f19c-4e62-8bb6-f6c7786e3f82): created successfully
Jun 15 15:53:12 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-692ac6c7-b814-4a74-b6f5-07c29619b7cd tempest-VolumesExtendTest-25562998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edef9053-df35-4fe1-bdf2-5b970f263651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:53:12 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-692ac6c7-b814-4a74-b6f5-07c29619b7cd tempest-VolumesExtendTest-25562998 None] Flow 'volume_create_manager' (2fd2cdf8-120c-4476-a4f3-fae7ad926a2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:53:13 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-692ac6c7-b814-4a74-b6f5-07c29619b7cd tempest-VolumesExtendTest-25562998 None] Created volume successfully.
Jun 15 15:53:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-96428550-3c45-4fd0-bda8-7e9db1343c23 tempest-VolumesExtendTest-25562998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:53:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-96428550-3c45-4fd0-bda8-7e9db1343c23 tempest-VolumesExtendTest-25562998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:53:14 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc8474e-d480-4a40-a98e-11eb4c6d83dc]: (4, 'raw') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:53:14 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-96428550-3c45-4fd0-bda8-7e9db1343c23 tempest-VolumesExtendTest-25562998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4e665f87-f19c-4e62-8bb6-f6c7786e3f82 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:53:14 devstack sudo[97442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4e665f87-f19c-4e62-8bb6-f6c7786e3f82
Jun 15 15:53:14 devstack sudo[97442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:53:15 devstack sudo[97442]: pam_unix(sudo:session): session closed for user root
Jun 15 15:53:15 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-96428550-3c45-4fd0-bda8-7e9db1343c23 tempest-VolumesExtendTest-25562998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4e665f87-f19c-4e62-8bb6-f6c7786e3f82" returned: 0 in 1.047s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:53:15 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-96428550-3c45-4fd0-bda8-7e9db1343c23 tempest-VolumesExtendTest-25562998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4e665f87-f19c-4e62-8bb6-f6c7786e3f82 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:53:15 devstack sudo[97447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4e665f87-f19c-4e62-8bb6-f6c7786e3f82
Jun 15 15:53:15 devstack sudo[97447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:53:16 devstack sudo[97447]: pam_unix(sudo:session): session closed for user root
Jun 15 15:53:16 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-96428550-3c45-4fd0-bda8-7e9db1343c23 tempest-VolumesExtendTest-25562998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4e665f87-f19c-4e62-8bb6-f6c7786e3f82" returned: 1 in 1.254s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:53:16 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-96428550-3c45-4fd0-bda8-7e9db1343c23 tempest-VolumesExtendTest-25562998 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4e665f87-f19c-4e62-8bb6-f6c7786e3f82' failed. Not Retrying. {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 15 15:53:16 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-96428550-3c45-4fd0-bda8-7e9db1343c23 tempest-VolumesExtendTest-25562998 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4e665f87-f19c-4e62-8bb6-f6c7786e3f82 2G {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:53:16 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-96428550-3c45-4fd0-bda8-7e9db1343c23 tempest-VolumesExtendTest-25562998 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4e665f87-f19c-4e62-8bb6-f6c7786e3f82 2G" returned: 0 in 0.128s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:53:16 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-96428550-3c45-4fd0-bda8-7e9db1343c23 tempest-VolumesExtendTest-25562998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 2.522s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:53:16 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-96428550-3c45-4fd0-bda8-7e9db1343c23 tempest-VolumesExtendTest-25562998 None] Extend volume completed successfully.
Jun 15 15:53:17 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-bcc58712-5f9e-4816-a388-ae527ba67d8e tempest-VolumesExtendTest-25562998 None] Acquiring lock "cinder-4e665f87-f19c-4e62-8bb6-f6c7786e3f82-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:53:17 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-bcc58712-5f9e-4816-a388-ae527ba67d8e tempest-VolumesExtendTest-25562998 None] Lock "cinder-4e665f87-f19c-4e62-8bb6-f6c7786e3f82-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:53:17 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-bcc58712-5f9e-4816-a388-ae527ba67d8e tempest-VolumesExtendTest-25562998 None] Acquiring lock "cinder-quobyte-4e665f87-f19c-4e62-8bb6-f6c7786e3f82" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:53:17 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-bcc58712-5f9e-4816-a388-ae527ba67d8e tempest-VolumesExtendTest-25562998 None] Lock "cinder-quobyte-4e665f87-f19c-4e62-8bb6-f6c7786e3f82" acquired by "delete_volume" :: waited 0.018s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:53:17 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[17931598-ef65-49f9-95d7-9dc2ccd0ed25]: (4, 'raw') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:53:17 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-bcc58712-5f9e-4816-a388-ae527ba67d8e tempest-VolumesExtendTest-25562998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4e665f87-f19c-4e62-8bb6-f6c7786e3f82 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:53:17 devstack sudo[97500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4e665f87-f19c-4e62-8bb6-f6c7786e3f82
Jun 15 15:53:17 devstack sudo[97500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:53:18 devstack sudo[97500]: pam_unix(sudo:session): session closed for user root
Jun 15 15:53:18 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-bcc58712-5f9e-4816-a388-ae527ba67d8e tempest-VolumesExtendTest-25562998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4e665f87-f19c-4e62-8bb6-f6c7786e3f82" returned: 0 in 0.725s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:53:18 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-bcc58712-5f9e-4816-a388-ae527ba67d8e tempest-VolumesExtendTest-25562998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4e665f87-f19c-4e62-8bb6-f6c7786e3f82 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:53:18 devstack sudo[97504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4e665f87-f19c-4e62-8bb6-f6c7786e3f82
Jun 15 15:53:18 devstack sudo[97504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:53:19 devstack sudo[97504]: pam_unix(sudo:session): session closed for user root
Jun 15 15:53:19 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-bcc58712-5f9e-4816-a388-ae527ba67d8e tempest-VolumesExtendTest-25562998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4e665f87-f19c-4e62-8bb6-f6c7786e3f82" returned: 1 in 0.760s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:53:19 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-bcc58712-5f9e-4816-a388-ae527ba67d8e tempest-VolumesExtendTest-25562998 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4e665f87-f19c-4e62-8bb6-f6c7786e3f82' failed. Not Retrying. {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 15 15:53:19 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-bcc58712-5f9e-4816-a388-ae527ba67d8e tempest-VolumesExtendTest-25562998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4e665f87-f19c-4e62-8bb6-f6c7786e3f82 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:53:19 devstack sudo[97509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4e665f87-f19c-4e62-8bb6-f6c7786e3f82
Jun 15 15:53:19 devstack sudo[97509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:53:19 devstack sudo[97509]: pam_unix(sudo:session): session closed for user root
Jun 15 15:53:19 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-bcc58712-5f9e-4816-a388-ae527ba67d8e tempest-VolumesExtendTest-25562998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4e665f87-f19c-4e62-8bb6-f6c7786e3f82" returned: 0 in 0.623s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:53:19 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-bcc58712-5f9e-4816-a388-ae527ba67d8e tempest-VolumesExtendTest-25562998 None] Lock "cinder-quobyte-4e665f87-f19c-4e62-8bb6-f6c7786e3f82" released by "delete_volume" :: held 2.182s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:53:20 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-bcc58712-5f9e-4816-a388-ae527ba67d8e tempest-VolumesExtendTest-25562998 None] Created reservations ['82402025-d75b-49b8-838d-17d6873a3c7a', 'd963d27f-88e6-401c-a86f-60a4f216ddfa', '6a664c41-3566-426f-92e5-02cd18cccdd0', '95242fb8-33af-4e24-8d3b-0f9b0a92d70e'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:53:20 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-bcc58712-5f9e-4816-a388-ae527ba67d8e tempest-VolumesExtendTest-25562998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:53:20 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-bcc58712-5f9e-4816-a388-ae527ba67d8e tempest-VolumesExtendTest-25562998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:53:20 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-bcc58712-5f9e-4816-a388-ae527ba67d8e tempest-VolumesExtendTest-25562998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:53:20 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-bcc58712-5f9e-4816-a388-ae527ba67d8e tempest-VolumesExtendTest-25562998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:53:20 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-bcc58712-5f9e-4816-a388-ae527ba67d8e tempest-VolumesExtendTest-25562998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:53:20 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-bcc58712-5f9e-4816-a388-ae527ba67d8e tempest-VolumesExtendTest-25562998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:53:20 devstack sudo[97512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:53:20 devstack sudo[97512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:53:20 devstack sudo[97512]: pam_unix(sudo:session): session closed for user root
Jun 15 15:53:20 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-bcc58712-5f9e-4816-a388-ae527ba67d8e tempest-VolumesExtendTest-25562998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.705s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:53:20 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-bcc58712-5f9e-4816-a388-ae527ba67d8e tempest-VolumesExtendTest-25562998 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:53:20 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-bcc58712-5f9e-4816-a388-ae527ba67d8e tempest-VolumesExtendTest-25562998 None] Deleted volume successfully.
Jun 15 15:53:20 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-bcc58712-5f9e-4816-a388-ae527ba67d8e tempest-VolumesExtendTest-25562998 None] Lock "cinder-4e665f87-f19c-4e62-8bb6-f6c7786e3f82-delete_volume" released by "delete_volume" :: held 3.134s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:53:21 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-77f523ea-65e7-44e8-b13b-c94735922a91 tempest-VolumesExtendTest-25562998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 15:53:21 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-77f523ea-65e7-44e8-b13b-c94735922a91 tempest-VolumesExtendTest-25562998 None] Flow 'volume_create_manager' (14ec1b7a-140d-414b-a2d3-233ef8e845db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:53:21 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-77f523ea-65e7-44e8-b13b-c94735922a91 tempest-VolumesExtendTest-25562998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90d17772-1ea9-4cef-b7a4-4e998da83547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:53:21 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-77f523ea-65e7-44e8-b13b-c94735922a91 tempest-VolumesExtendTest-25562998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90d17772-1ea9-4cef-b7a4-4e998da83547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:53:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-588945405',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de9edb8c-a2ac-4cfe-959a-c4ff15e13107,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c23cf4e65af84962a2baebc2cf953177',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:53:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:53:22Z,use_quota=True,user_id='9123bef351bf488a915163e50fc69a49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:53:21 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-77f523ea-65e7-44e8-b13b-c94735922a91 tempest-VolumesExtendTest-25562998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b33cb717-1db9-47a6-800a-fb24d88f9a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:53:21 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-77f523ea-65e7-44e8-b13b-c94735922a91 tempest-VolumesExtendTest-25562998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b33cb717-1db9-47a6-800a-fb24d88f9a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:53:21 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-77f523ea-65e7-44e8-b13b-c94735922a91 tempest-VolumesExtendTest-25562998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05888f1f-e2a6-4519-8d9d-64804aee4b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:53:21 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-77f523ea-65e7-44e8-b13b-c94735922a91 tempest-VolumesExtendTest-25562998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05888f1f-e2a6-4519-8d9d-64804aee4b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de9edb8c-a2ac-4cfe-959a-c4ff15e13107', 'volume_name': 'volume-de9edb8c-a2ac-4cfe-959a-c4ff15e13107', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:53:21 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-77f523ea-65e7-44e8-b13b-c94735922a91 tempest-VolumesExtendTest-25562998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6fa9176-dd2d-4e72-9152-3fac5a013c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:53:21 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-77f523ea-65e7-44e8-b13b-c94735922a91 tempest-VolumesExtendTest-25562998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6fa9176-dd2d-4e72-9152-3fac5a013c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:53:21 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-77f523ea-65e7-44e8-b13b-c94735922a91 tempest-VolumesExtendTest-25562998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71feac3d-1b7c-4898-b6ff-245e1f24f554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:53:21 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-77f523ea-65e7-44e8-b13b-c94735922a91 tempest-VolumesExtendTest-25562998 None] Volume de9edb8c-a2ac-4cfe-959a-c4ff15e13107: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de9edb8c-a2ac-4cfe-959a-c4ff15e13107', 'volume_size': 1}
Jun 15 15:53:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-77f523ea-65e7-44e8-b13b-c94735922a91 tempest-VolumesExtendTest-25562998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:53:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-77f523ea-65e7-44e8-b13b-c94735922a91 tempest-VolumesExtendTest-25562998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:53:21 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-77f523ea-65e7-44e8-b13b-c94735922a91 tempest-VolumesExtendTest-25562998 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:53:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-588945405',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de9edb8c-a2ac-4cfe-959a-c4ff15e13107,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c23cf4e65af84962a2baebc2cf953177',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:53:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:53:22Z,use_quota=True,user_id='9123bef351bf488a915163e50fc69a49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 15:53:21 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-77f523ea-65e7-44e8-b13b-c94735922a91 tempest-VolumesExtendTest-25562998 None] Creating volume de9edb8c-a2ac-4cfe-959a-c4ff15e13107 {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 15:53:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-77f523ea-65e7-44e8-b13b-c94735922a91 tempest-VolumesExtendTest-25562998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:53:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-77f523ea-65e7-44e8-b13b-c94735922a91 tempest-VolumesExtendTest-25562998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:53:21 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-77f523ea-65e7-44e8-b13b-c94735922a91 tempest-VolumesExtendTest-25562998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:53:21 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-77f523ea-65e7-44e8-b13b-c94735922a91 tempest-VolumesExtendTest-25562998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:53:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-77f523ea-65e7-44e8-b13b-c94735922a91 tempest-VolumesExtendTest-25562998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:53:21 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-77f523ea-65e7-44e8-b13b-c94735922a91 tempest-VolumesExtendTest-25562998 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 15:53:21 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-77f523ea-65e7-44e8-b13b-c94735922a91 tempest-VolumesExtendTest-25562998 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 15:53:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-77f523ea-65e7-44e8-b13b-c94735922a91 tempest-VolumesExtendTest-25562998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-de9edb8c-a2ac-4cfe-959a-c4ff15e13107 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:53:21 devstack sudo[97517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-de9edb8c-a2ac-4cfe-959a-c4ff15e13107 1073741824
Jun 15 15:53:21 devstack sudo[97517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:53:22 devstack sudo[97517]: pam_unix(sudo:session): session closed for user root
Jun 15 15:53:22 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-77f523ea-65e7-44e8-b13b-c94735922a91 tempest-VolumesExtendTest-25562998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-de9edb8c-a2ac-4cfe-959a-c4ff15e13107 1073741824" returned: 0 in 0.996s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:53:22 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-77f523ea-65e7-44e8-b13b-c94735922a91 tempest-VolumesExtendTest-25562998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-de9edb8c-a2ac-4cfe-959a-c4ff15e13107 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:53:22 devstack sudo[97530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-de9edb8c-a2ac-4cfe-959a-c4ff15e13107
Jun 15 15:53:22 devstack sudo[97530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:53:23 devstack sudo[97530]: pam_unix(sudo:session): session closed for user root
Jun 15 15:53:23 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-77f523ea-65e7-44e8-b13b-c94735922a91 tempest-VolumesExtendTest-25562998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-de9edb8c-a2ac-4cfe-959a-c4ff15e13107" returned: 0 in 0.954s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:53:23 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-77f523ea-65e7-44e8-b13b-c94735922a91 tempest-VolumesExtendTest-25562998 None] <== create_volume: return (2015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 15:53:23 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-77f523ea-65e7-44e8-b13b-c94735922a91 tempest-VolumesExtendTest-25562998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.017s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:53:23 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-77f523ea-65e7-44e8-b13b-c94735922a91 tempest-VolumesExtendTest-25562998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71feac3d-1b7c-4898-b6ff-245e1f24f554) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de9edb8c-a2ac-4cfe-959a-c4ff15e13107', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:53:23 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-77f523ea-65e7-44e8-b13b-c94735922a91 tempest-VolumesExtendTest-25562998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4ade2c7-d102-429a-9b88-bae79414232e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:53:23 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-77f523ea-65e7-44e8-b13b-c94735922a91 tempest-VolumesExtendTest-25562998 None] Volume volume-de9edb8c-a2ac-4cfe-959a-c4ff15e13107 (de9edb8c-a2ac-4cfe-959a-c4ff15e13107): created successfully
Jun 15 15:53:23 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-77f523ea-65e7-44e8-b13b-c94735922a91 tempest-VolumesExtendTest-25562998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4ade2c7-d102-429a-9b88-bae79414232e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:53:23 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-77f523ea-65e7-44e8-b13b-c94735922a91 tempest-VolumesExtendTest-25562998 None] Flow 'volume_create_manager' (14ec1b7a-140d-414b-a2d3-233ef8e845db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:53:23 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-77f523ea-65e7-44e8-b13b-c94735922a91 tempest-VolumesExtendTest-25562998 None] Created volume successfully.
Jun 15 15:53:24 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [req-37770714-e52a-4b12-95d8-3c853c1ec946 req-79582295-295f-4b75-b724-bdbb5d359e41 tempest-AttachVolumeShelveTestJSON-1587912764 None] No connector for attachment 32f87a9b-b398-40d9-b63b-ec81406099e0; skipping storage backend terminate_connection call. {{(pid=91863) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}}
Jun 15 15:53:24 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [req-37770714-e52a-4b12-95d8-3c853c1ec946 req-79582295-295f-4b75-b724-bdbb5d359e41 tempest-AttachVolumeShelveTestJSON-1587912764 None] Deleting attachment 32f87a9b-b398-40d9-b63b-ec81406099e0. {{(pid=91863) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 15 15:53:25 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-8388cc78-c24e-4290-a286-73e940772845 tempest-VolumesExtendTest-25562998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:53:25 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-8388cc78-c24e-4290-a286-73e940772845 tempest-VolumesExtendTest-25562998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:53:25 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-8388cc78-c24e-4290-a286-73e940772845 tempest-VolumesExtendTest-25562998 None] Creating offline snapshot f5ee4a8f-186f-4024-a260-9c76a236a125 of volume de9edb8c-a2ac-4cfe-959a-c4ff15e13107 {{(pid=91863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 15 15:53:25 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd544c1-50b9-4fb9-9a46-e20508461ec0]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:53:25 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-8388cc78-c24e-4290-a286-73e940772845 tempest-VolumesExtendTest-25562998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-de9edb8c-a2ac-4cfe-959a-c4ff15e13107 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:53:25 devstack sudo[97534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-de9edb8c-a2ac-4cfe-959a-c4ff15e13107
Jun 15 15:53:25 devstack sudo[97534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:53:26 devstack sudo[97534]: pam_unix(sudo:session): session closed for user root
Jun 15 15:53:26 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-8388cc78-c24e-4290-a286-73e940772845 tempest-VolumesExtendTest-25562998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-de9edb8c-a2ac-4cfe-959a-c4ff15e13107" returned: 0 in 0.823s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:53:26 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-8388cc78-c24e-4290-a286-73e940772845 tempest-VolumesExtendTest-25562998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-de9edb8c-a2ac-4cfe-959a-c4ff15e13107,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-de9edb8c-a2ac-4cfe-959a-c4ff15e13107.f5ee4a8f-186f-4024-a260-9c76a236a125 1G {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:53:26 devstack sudo[97541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-de9edb8c-a2ac-4cfe-959a-c4ff15e13107,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-de9edb8c-a2ac-4cfe-959a-c4ff15e13107.f5ee4a8f-186f-4024-a260-9c76a236a125 1G
Jun 15 15:53:26 devstack sudo[97541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:53:27 devstack sudo[97541]: pam_unix(sudo:session): session closed for user root
Jun 15 15:53:27 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-8388cc78-c24e-4290-a286-73e940772845 tempest-VolumesExtendTest-25562998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-de9edb8c-a2ac-4cfe-959a-c4ff15e13107,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-de9edb8c-a2ac-4cfe-959a-c4ff15e13107.f5ee4a8f-186f-4024-a260-9c76a236a125 1G" returned: 0 in 0.994s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:53:27 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-8388cc78-c24e-4290-a286-73e940772845 tempest-VolumesExtendTest-25562998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de9edb8c-a2ac-4cfe-959a-c4ff15e13107 -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-de9edb8c-a2ac-4cfe-959a-c4ff15e13107.f5ee4a8f-186f-4024-a260-9c76a236a125 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:53:27 devstack sudo[97547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de9edb8c-a2ac-4cfe-959a-c4ff15e13107 -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-de9edb8c-a2ac-4cfe-959a-c4ff15e13107.f5ee4a8f-186f-4024-a260-9c76a236a125
Jun 15 15:53:27 devstack sudo[97547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:53:27 devstack sudo[97547]: pam_unix(sudo:session): session closed for user root
Jun 15 15:53:27 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-8388cc78-c24e-4290-a286-73e940772845 tempest-VolumesExtendTest-25562998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de9edb8c-a2ac-4cfe-959a-c4ff15e13107 -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-de9edb8c-a2ac-4cfe-959a-c4ff15e13107.f5ee4a8f-186f-4024-a260-9c76a236a125" returned: 0 in 0.755s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:53:27 devstack cinder-volume[91863]: WARNING cinder.volume.drivers.remotefs [None req-8388cc78-c24e-4290-a286-73e940772845 tempest-VolumesExtendTest-25562998 None] /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-de9edb8c-a2ac-4cfe-959a-c4ff15e13107.f5ee4a8f-186f-4024-a260-9c76a236a125 is being set with open permissions: ugo+rw
Jun 15 15:53:27 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-8388cc78-c24e-4290-a286-73e940772845 tempest-VolumesExtendTest-25562998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-de9edb8c-a2ac-4cfe-959a-c4ff15e13107.f5ee4a8f-186f-4024-a260-9c76a236a125 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:53:27 devstack sudo[97554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-de9edb8c-a2ac-4cfe-959a-c4ff15e13107.f5ee4a8f-186f-4024-a260-9c76a236a125
Jun 15 15:53:27 devstack sudo[97554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:53:28 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7832f12-61dc-4843-83d0-51cb8096eba9 tempest-AttachVolumeNegativeTest-1849283913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 15:53:28 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-c7832f12-61dc-4843-83d0-51cb8096eba9 tempest-AttachVolumeNegativeTest-1849283913 None] Flow 'volume_create_manager' (32554dea-ada1-4fcd-9350-09ec02fe89eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:53:28 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-c7832f12-61dc-4843-83d0-51cb8096eba9 tempest-AttachVolumeNegativeTest-1849283913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24cfe847-e70a-432a-afa0-f11c4752544a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:53:28 devstack sudo[97554]: pam_unix(sudo:session): session closed for user root
Jun 15 15:53:28 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-8388cc78-c24e-4290-a286-73e940772845 tempest-VolumesExtendTest-25562998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-de9edb8c-a2ac-4cfe-959a-c4ff15e13107.f5ee4a8f-186f-4024-a260-9c76a236a125" returned: 0 in 0.714s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:53:28 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-c7832f12-61dc-4843-83d0-51cb8096eba9 tempest-AttachVolumeNegativeTest-1849283913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24cfe847-e70a-432a-afa0-f11c4752544a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:53:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-911747363',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a9c0a20-63c6-46eb-9e6f-acab6da750fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3be7c3abe8246a2a9f68c6f49a031c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:53:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:53:28Z,use_quota=True,user_id='2ec357fde37a4761a6fc47aa552d9567',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:53:28 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-c7832f12-61dc-4843-83d0-51cb8096eba9 tempest-AttachVolumeNegativeTest-1849283913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c167f9a-f0a2-4fb9-a04a-151392abcc7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:53:28 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-c7832f12-61dc-4843-83d0-51cb8096eba9 tempest-AttachVolumeNegativeTest-1849283913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c167f9a-f0a2-4fb9-a04a-151392abcc7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:53:28 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-c7832f12-61dc-4843-83d0-51cb8096eba9 tempest-AttachVolumeNegativeTest-1849283913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e20e196d-c22d-42e2-81ed-fa5cdf47b666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:53:28 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-c7832f12-61dc-4843-83d0-51cb8096eba9 tempest-AttachVolumeNegativeTest-1849283913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e20e196d-c22d-42e2-81ed-fa5cdf47b666) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a9c0a20-63c6-46eb-9e6f-acab6da750fa', 'volume_name': 'volume-8a9c0a20-63c6-46eb-9e6f-acab6da750fa', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:53:28 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-c7832f12-61dc-4843-83d0-51cb8096eba9 tempest-AttachVolumeNegativeTest-1849283913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8dc40b1-9d84-4f82-8226-2354af648df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:53:28 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-c7832f12-61dc-4843-83d0-51cb8096eba9 tempest-AttachVolumeNegativeTest-1849283913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8dc40b1-9d84-4f82-8226-2354af648df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:53:28 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-c7832f12-61dc-4843-83d0-51cb8096eba9 tempest-AttachVolumeNegativeTest-1849283913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad01bac6-c550-4348-8251-a9d4af923fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:53:28 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-c7832f12-61dc-4843-83d0-51cb8096eba9 tempest-AttachVolumeNegativeTest-1849283913 None] Volume 8a9c0a20-63c6-46eb-9e6f-acab6da750fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a9c0a20-63c6-46eb-9e6f-acab6da750fa', 'volume_size': 1}
Jun 15 15:53:28 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-c7832f12-61dc-4843-83d0-51cb8096eba9 tempest-AttachVolumeNegativeTest-1849283913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:53:28 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-8388cc78-c24e-4290-a286-73e940772845 tempest-VolumesExtendTest-25562998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-de9edb8c-a2ac-4cfe-959a-c4ff15e13107.info {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:53:28 devstack sudo[97559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-de9edb8c-a2ac-4cfe-959a-c4ff15e13107.info
Jun 15 15:53:28 devstack sudo[97559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:53:29 devstack sudo[97559]: pam_unix(sudo:session): session closed for user root
Jun 15 15:53:29 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-8388cc78-c24e-4290-a286-73e940772845 tempest-VolumesExtendTest-25562998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-de9edb8c-a2ac-4cfe-959a-c4ff15e13107.info" returned: 0 in 0.709s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:53:29 devstack cinder-volume[91863]: WARNING cinder.volume.drivers.remotefs [None req-8388cc78-c24e-4290-a286-73e940772845 tempest-VolumesExtendTest-25562998 None] /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-de9edb8c-a2ac-4cfe-959a-c4ff15e13107.info is being set with open permissions: ugo+rw
Jun 15 15:53:29 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-8388cc78-c24e-4290-a286-73e940772845 tempest-VolumesExtendTest-25562998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-de9edb8c-a2ac-4cfe-959a-c4ff15e13107.info {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:53:29 devstack sudo[97598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-de9edb8c-a2ac-4cfe-959a-c4ff15e13107.info
Jun 15 15:53:29 devstack sudo[97598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:53:29 devstack sudo[97598]: pam_unix(sudo:session): session closed for user root
Jun 15 15:53:29 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-8388cc78-c24e-4290-a286-73e940772845 tempest-VolumesExtendTest-25562998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-de9edb8c-a2ac-4cfe-959a-c4ff15e13107.info" returned: 0 in 0.582s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:53:29 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-8388cc78-c24e-4290-a286-73e940772845 tempest-VolumesExtendTest-25562998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.764s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:53:29 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-c7832f12-61dc-4843-83d0-51cb8096eba9 tempest-AttachVolumeNegativeTest-1849283913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.365s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:53:29 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-c7832f12-61dc-4843-83d0-51cb8096eba9 tempest-AttachVolumeNegativeTest-1849283913 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:53:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-911747363',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a9c0a20-63c6-46eb-9e6f-acab6da750fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3be7c3abe8246a2a9f68c6f49a031c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:53:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:53:28Z,use_quota=True,user_id='2ec357fde37a4761a6fc47aa552d9567',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 15:53:29 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-c7832f12-61dc-4843-83d0-51cb8096eba9 tempest-AttachVolumeNegativeTest-1849283913 None] Creating volume 8a9c0a20-63c6-46eb-9e6f-acab6da750fa {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 15:53:29 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-c7832f12-61dc-4843-83d0-51cb8096eba9 tempest-AttachVolumeNegativeTest-1849283913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:53:29 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-c7832f12-61dc-4843-83d0-51cb8096eba9 tempest-AttachVolumeNegativeTest-1849283913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:53:29 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-c7832f12-61dc-4843-83d0-51cb8096eba9 tempest-AttachVolumeNegativeTest-1849283913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:53:29 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-c7832f12-61dc-4843-83d0-51cb8096eba9 tempest-AttachVolumeNegativeTest-1849283913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:53:29 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-c7832f12-61dc-4843-83d0-51cb8096eba9 tempest-AttachVolumeNegativeTest-1849283913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:53:29 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-c7832f12-61dc-4843-83d0-51cb8096eba9 tempest-AttachVolumeNegativeTest-1849283913 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 15:53:29 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-c7832f12-61dc-4843-83d0-51cb8096eba9 tempest-AttachVolumeNegativeTest-1849283913 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 15:53:29 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c7832f12-61dc-4843-83d0-51cb8096eba9 tempest-AttachVolumeNegativeTest-1849283913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8a9c0a20-63c6-46eb-9e6f-acab6da750fa 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:53:29 devstack sudo[97601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8a9c0a20-63c6-46eb-9e6f-acab6da750fa 1073741824
Jun 15 15:53:29 devstack sudo[97601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:53:29 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-8388cc78-c24e-4290-a286-73e940772845 tempest-VolumesExtendTest-25562998 None] Create snapshot completed successfully
Jun 15 15:53:30 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-a45894c0-bfc6-4c7c-8772-d0862aa835bf tempest-VolumesExtendTest-25562998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:53:30 devstack sudo[97601]: pam_unix(sudo:session): session closed for user root
Jun 15 15:53:30 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c7832f12-61dc-4843-83d0-51cb8096eba9 tempest-AttachVolumeNegativeTest-1849283913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8a9c0a20-63c6-46eb-9e6f-acab6da750fa 1073741824" returned: 0 in 0.821s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:53:30 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c7832f12-61dc-4843-83d0-51cb8096eba9 tempest-AttachVolumeNegativeTest-1849283913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8a9c0a20-63c6-46eb-9e6f-acab6da750fa {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:53:30 devstack sudo[97607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8a9c0a20-63c6-46eb-9e6f-acab6da750fa
Jun 15 15:53:30 devstack sudo[97607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:53:31 devstack cinder-volume[91863]: DEBUG oslo_service.periodic_task [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 15:53:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:53:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:53:31 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:53:31 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:53:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:53:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:53:31 devstack sudo[97609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:53:31 devstack sudo[97609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:53:31 devstack sudo[97607]: pam_unix(sudo:session): session closed for user root
Jun 15 15:53:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c7832f12-61dc-4843-83d0-51cb8096eba9 tempest-AttachVolumeNegativeTest-1849283913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8a9c0a20-63c6-46eb-9e6f-acab6da750fa" returned: 0 in 0.626s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:53:31 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-c7832f12-61dc-4843-83d0-51cb8096eba9 tempest-AttachVolumeNegativeTest-1849283913 None] <== create_volume: return (1496ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 15:53:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-c7832f12-61dc-4843-83d0-51cb8096eba9 tempest-AttachVolumeNegativeTest-1849283913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.502s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:53:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-a45894c0-bfc6-4c7c-8772-d0862aa835bf tempest-VolumesExtendTest-25562998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.923s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:53:31 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[63092f83-a8b6-4e9f-8b23-e3ffede8f8db]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:53:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-a45894c0-bfc6-4c7c-8772-d0862aa835bf tempest-VolumesExtendTest-25562998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-de9edb8c-a2ac-4cfe-959a-c4ff15e13107 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:53:31 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-c7832f12-61dc-4843-83d0-51cb8096eba9 tempest-AttachVolumeNegativeTest-1849283913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad01bac6-c550-4348-8251-a9d4af923fa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a9c0a20-63c6-46eb-9e6f-acab6da750fa', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:53:31 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-c7832f12-61dc-4843-83d0-51cb8096eba9 tempest-AttachVolumeNegativeTest-1849283913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a14b3eb-4f8f-4338-8d27-ab8006e1cc8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:53:31 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-c7832f12-61dc-4843-83d0-51cb8096eba9 tempest-AttachVolumeNegativeTest-1849283913 None] Volume volume-8a9c0a20-63c6-46eb-9e6f-acab6da750fa (8a9c0a20-63c6-46eb-9e6f-acab6da750fa): created successfully
Jun 15 15:53:31 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-c7832f12-61dc-4843-83d0-51cb8096eba9 tempest-AttachVolumeNegativeTest-1849283913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a14b3eb-4f8f-4338-8d27-ab8006e1cc8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:53:31 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-c7832f12-61dc-4843-83d0-51cb8096eba9 tempest-AttachVolumeNegativeTest-1849283913 None] Flow 'volume_create_manager' (32554dea-ada1-4fcd-9350-09ec02fe89eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:53:31 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-c7832f12-61dc-4843-83d0-51cb8096eba9 tempest-AttachVolumeNegativeTest-1849283913 None] Created volume successfully.
Jun 15 15:53:31 devstack sudo[97612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-de9edb8c-a2ac-4cfe-959a-c4ff15e13107
Jun 15 15:53:31 devstack sudo[97612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:53:31 devstack sudo[97609]: pam_unix(sudo:session): session closed for user root
Jun 15 15:53:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.670s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:53:31 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:53:31 devstack cinder-volume[91863]: DEBUG oslo_service.periodic_task [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Running periodic task VolumeManager._thread_info {{(pid=91863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 15:53:31 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] thread count: 28 {{(pid=91863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 15 15:53:31 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] thread info: [<_MainThread(MainThread, started 131088232640640)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131088122704576)>, <Thread(Thread-3 (stat_writer), started daemon 131088123058112)>, <Thread(Rabbit-heartbeat, started daemon 131088121268864)>, <Thread(Thread-5 (_runner), started daemon 131088121904192)>, <Thread(Thread-7 (_runner), started daemon 131088122037248)>, <Thread(fd_logger, started daemon 131088119630784)>, <Thread(privsep_reader, started daemon 131088119781440)>, <Thread(tpool_thread_0, started daemon 131088111617728)>, <Thread(tpool_thread_1, started daemon 131088103225024)>, <Thread(tpool_thread_2, started daemon 131088094832320)>, <Thread(tpool_thread_3, started daemon 131088086439616)>, <Thread(tpool_thread_4, started daemon 131088078046912)>, <Thread(tpool_thread_5, started daemon 131088069654208)>, <Thread(tpool_thread_6, started daemon 131088061261504)>, <Thread(tpool_thread_7, started daemon 131088052868800)>, <Thread(tpool_thread_8, started daemon 131088044476096)>, <Thread(tpool_thread_9, started daemon 131088036083392)>, <Thread(tpool_thread_10, started daemon 131088027690688)>, <Thread(tpool_thread_11, started daemon 131088019297984)>, <Thread(tpool_thread_12, started daemon 131088010905280)>, <Thread(tpool_thread_13, started daemon 131088002512576)>, <Thread(tpool_thread_14, started daemon 131087994119872)>, <Thread(tpool_thread_15, started daemon 131087985727168)>, <Thread(tpool_thread_16, started daemon 131087977334464)>, <Thread(tpool_thread_17, started daemon 131087968941760)>, <Thread(tpool_thread_18, started daemon 131087960549056)>, <Thread(tpool_thread_19, started daemon 131087952156352)>] {{(pid=91863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 15 15:53:32 devstack sudo[97612]: pam_unix(sudo:session): session closed for user root
Jun 15 15:53:32 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-a45894c0-bfc6-4c7c-8772-d0862aa835bf tempest-VolumesExtendTest-25562998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-de9edb8c-a2ac-4cfe-959a-c4ff15e13107" returned: 0 in 0.854s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:53:32 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-a45894c0-bfc6-4c7c-8772-d0862aa835bf tempest-VolumesExtendTest-25562998 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-de9edb8c-a2ac-4cfe-959a-c4ff15e13107.f5ee4a8f-186f-4024-a260-9c76a236a125 2G {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:53:32 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-a45894c0-bfc6-4c7c-8772-d0862aa835bf tempest-VolumesExtendTest-25562998 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-de9edb8c-a2ac-4cfe-959a-c4ff15e13107.f5ee4a8f-186f-4024-a260-9c76a236a125 2G" returned: 0 in 0.161s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:53:32 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-a45894c0-bfc6-4c7c-8772-d0862aa835bf tempest-VolumesExtendTest-25562998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.051s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:53:32 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-a45894c0-bfc6-4c7c-8772-d0862aa835bf tempest-VolumesExtendTest-25562998 None] Extend volume completed successfully.
Jun 15 15:53:32 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-fe797563-ee3e-499c-90cc-4a6e017daed6 tempest-VolumesExtendTest-25562998 None] Acquiring lock "cinder-f5ee4a8f-186f-4024-a260-9c76a236a125-delete_snapshot" by "delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:53:32 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-fe797563-ee3e-499c-90cc-4a6e017daed6 tempest-VolumesExtendTest-25562998 None] Lock "cinder-f5ee4a8f-186f-4024-a260-9c76a236a125-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:53:32 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-fe797563-ee3e-499c-90cc-4a6e017daed6 tempest-VolumesExtendTest-25562998 None] Acquiring lock "cinder-quobyte-de9edb8c-a2ac-4cfe-959a-c4ff15e13107" by "delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:53:32 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-fe797563-ee3e-499c-90cc-4a6e017daed6 tempest-VolumesExtendTest-25562998 None] Lock "cinder-quobyte-de9edb8c-a2ac-4cfe-959a-c4ff15e13107" acquired by "delete_snapshot" :: waited 0.019s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:53:32 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-fe797563-ee3e-499c-90cc-4a6e017daed6 tempest-VolumesExtendTest-25562998 None] Acquiring lock "cinder-quobyte-f5ee4a8f-186f-4024-a260-9c76a236a125" by "_delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:53:32 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-fe797563-ee3e-499c-90cc-4a6e017daed6 tempest-VolumesExtendTest-25562998 None] Lock "cinder-quobyte-f5ee4a8f-186f-4024-a260-9c76a236a125" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:53:32 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-fe797563-ee3e-499c-90cc-4a6e017daed6 tempest-VolumesExtendTest-25562998 None] Deleting offline snapshot f5ee4a8f-186f-4024-a260-9c76a236a125 of volume de9edb8c-a2ac-4cfe-959a-c4ff15e13107 {{(pid=91863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 15 15:53:32 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-fe797563-ee3e-499c-90cc-4a6e017daed6 tempest-VolumesExtendTest-25562998 None] snapshot_file for this snap is: volume-de9edb8c-a2ac-4cfe-959a-c4ff15e13107.f5ee4a8f-186f-4024-a260-9c76a236a125 {{(pid=91863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 15 15:53:32 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb88176-920c-48af-9fe6-403a3ccea5c7]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:53:32 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-fe797563-ee3e-499c-90cc-4a6e017daed6 tempest-VolumesExtendTest-25562998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-de9edb8c-a2ac-4cfe-959a-c4ff15e13107.f5ee4a8f-186f-4024-a260-9c76a236a125 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:53:33 devstack sudo[97623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-de9edb8c-a2ac-4cfe-959a-c4ff15e13107.f5ee4a8f-186f-4024-a260-9c76a236a125
Jun 15 15:53:33 devstack sudo[97623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:53:33 devstack sudo[97623]: pam_unix(sudo:session): session closed for user root
Jun 15 15:53:33 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-fe797563-ee3e-499c-90cc-4a6e017daed6 tempest-VolumesExtendTest-25562998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-de9edb8c-a2ac-4cfe-959a-c4ff15e13107.f5ee4a8f-186f-4024-a260-9c76a236a125" returned: 0 in 0.749s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:53:33 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-fe797563-ee3e-499c-90cc-4a6e017daed6 tempest-VolumesExtendTest-25562998 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de9edb8c-a2ac-4cfe-959a-c4ff15e13107(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 15:53:33 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[95017c0e-bf89-4fd1-bd1b-72bcef5862d8]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:53:33 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-fe797563-ee3e-499c-90cc-4a6e017daed6 tempest-VolumesExtendTest-25562998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-de9edb8c-a2ac-4cfe-959a-c4ff15e13107 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:53:33 devstack sudo[97629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-de9edb8c-a2ac-4cfe-959a-c4ff15e13107
Jun 15 15:53:33 devstack sudo[97629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:53:34 devstack sudo[97629]: pam_unix(sudo:session): session closed for user root
Jun 15 15:53:34 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-fe797563-ee3e-499c-90cc-4a6e017daed6 tempest-VolumesExtendTest-25562998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-de9edb8c-a2ac-4cfe-959a-c4ff15e13107" returned: 0 in 0.762s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:53:34 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-fe797563-ee3e-499c-90cc-4a6e017daed6 tempest-VolumesExtendTest-25562998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-de9edb8c-a2ac-4cfe-959a-c4ff15e13107.f5ee4a8f-186f-4024-a260-9c76a236a125 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:53:34 devstack sudo[97635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-de9edb8c-a2ac-4cfe-959a-c4ff15e13107.f5ee4a8f-186f-4024-a260-9c76a236a125
Jun 15 15:53:34 devstack sudo[97635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:53:34 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [req-52b7107a-215a-4d32-9244-37ff850b2598 req-589dae75-1ad2-4cce-a293-1201d7644efa tempest-AttachVolumeNegativeTest-1849283913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:53:34 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [req-52b7107a-215a-4d32-9244-37ff850b2598 req-589dae75-1ad2-4cce-a293-1201d7644efa tempest-AttachVolumeNegativeTest-1849283913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:53:34 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa1cd760-fff7-4be7-8cd4-aaf6cdc10e03]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:53:34 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-52b7107a-215a-4d32-9244-37ff850b2598 req-589dae75-1ad2-4cce-a293-1201d7644efa tempest-AttachVolumeNegativeTest-1849283913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8a9c0a20-63c6-46eb-9e6f-acab6da750fa {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:53:34 devstack sudo[97645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8a9c0a20-63c6-46eb-9e6f-acab6da750fa
Jun 15 15:53:34 devstack sudo[97645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:53:35 devstack sudo[97635]: pam_unix(sudo:session): session closed for user root
Jun 15 15:53:35 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-fe797563-ee3e-499c-90cc-4a6e017daed6 tempest-VolumesExtendTest-25562998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-de9edb8c-a2ac-4cfe-959a-c4ff15e13107.f5ee4a8f-186f-4024-a260-9c76a236a125" returned: 0 in 1.032s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:53:35 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-fe797563-ee3e-499c-90cc-4a6e017daed6 tempest-VolumesExtendTest-25562998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-de9edb8c-a2ac-4cfe-959a-c4ff15e13107.f5ee4a8f-186f-4024-a260-9c76a236a125 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:53:35 devstack sudo[97651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-de9edb8c-a2ac-4cfe-959a-c4ff15e13107.f5ee4a8f-186f-4024-a260-9c76a236a125
Jun 15 15:53:35 devstack sudo[97651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:53:35 devstack sudo[97645]: pam_unix(sudo:session): session closed for user root
Jun 15 15:53:35 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-52b7107a-215a-4d32-9244-37ff850b2598 req-589dae75-1ad2-4cce-a293-1201d7644efa tempest-AttachVolumeNegativeTest-1849283913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8a9c0a20-63c6-46eb-9e6f-acab6da750fa" returned: 0 in 1.190s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:53:35 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [req-52b7107a-215a-4d32-9244-37ff850b2598 req-589dae75-1ad2-4cce-a293-1201d7644efa tempest-AttachVolumeNegativeTest-1849283913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.213s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:53:35 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [req-52b7107a-215a-4d32-9244-37ff850b2598 req-589dae75-1ad2-4cce-a293-1201d7644efa tempest-AttachVolumeNegativeTest-1849283913 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc', 'name': 'volume-8a9c0a20-63c6-46eb-9e6f-acab6da750fa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ce7f8778-5cd1-4c3d-9b76-9f96d1825eaf', 'enforce_multipath': True} {{(pid=91863) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 15 15:53:36 devstack cinder-volume[91863]: INFO cinder.volume.manager [req-52b7107a-215a-4d32-9244-37ff850b2598 req-589dae75-1ad2-4cce-a293-1201d7644efa tempest-AttachVolumeNegativeTest-1849283913 None] attachment_update completed successfully.
Jun 15 15:53:36 devstack sudo[97651]: pam_unix(sudo:session): session closed for user root
Jun 15 15:53:36 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-fe797563-ee3e-499c-90cc-4a6e017daed6 tempest-VolumesExtendTest-25562998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-de9edb8c-a2ac-4cfe-959a-c4ff15e13107.f5ee4a8f-186f-4024-a260-9c76a236a125" returned: 0 in 0.909s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:53:36 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-fe797563-ee3e-499c-90cc-4a6e017daed6 tempest-VolumesExtendTest-25562998 None] Lock "cinder-quobyte-f5ee4a8f-186f-4024-a260-9c76a236a125" released by "_delete_snapshot" :: held 3.610s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:53:36 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-fe797563-ee3e-499c-90cc-4a6e017daed6 tempest-VolumesExtendTest-25562998 None] Lock "cinder-quobyte-de9edb8c-a2ac-4cfe-959a-c4ff15e13107" released by "delete_snapshot" :: held 3.641s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:53:36 devstack cinder-volume[91863]: WARNING cinder.quota [None req-fe797563-ee3e-499c-90cc-4a6e017daed6 tempest-VolumesExtendTest-25562998 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jun 15 15:53:36 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-fe797563-ee3e-499c-90cc-4a6e017daed6 tempest-VolumesExtendTest-25562998 None] Created reservations ['4063f478-c15d-43d7-b78c-7cfe205177ef', '2dc876cc-3e8c-4f4e-aa16-ffa46079a8c4', 'f9e82d8f-b235-4b07-bff7-560e1fd54c0b', 'cfbd6d9c-75dd-474a-98bf-779f38ad7c02'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:53:36 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-fe797563-ee3e-499c-90cc-4a6e017daed6 tempest-VolumesExtendTest-25562998 None] Delete snapshot completed successfully.
Jun 15 15:53:36 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-fe797563-ee3e-499c-90cc-4a6e017daed6 tempest-VolumesExtendTest-25562998 None] Lock "cinder-f5ee4a8f-186f-4024-a260-9c76a236a125-delete_snapshot" released by "delete_snapshot" :: held 3.835s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:53:37 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-7bcfe902-c0c7-4bbf-8c0a-937a7a661b34 tempest-VolumesExtendTest-25562998 None] Acquiring lock "cinder-de9edb8c-a2ac-4cfe-959a-c4ff15e13107-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:53:37 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-7bcfe902-c0c7-4bbf-8c0a-937a7a661b34 tempest-VolumesExtendTest-25562998 None] Lock "cinder-de9edb8c-a2ac-4cfe-959a-c4ff15e13107-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:53:37 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-7bcfe902-c0c7-4bbf-8c0a-937a7a661b34 tempest-VolumesExtendTest-25562998 None] Acquiring lock "cinder-quobyte-de9edb8c-a2ac-4cfe-959a-c4ff15e13107" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:53:37 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-7bcfe902-c0c7-4bbf-8c0a-937a7a661b34 tempest-VolumesExtendTest-25562998 None] Lock "cinder-quobyte-de9edb8c-a2ac-4cfe-959a-c4ff15e13107" acquired by "delete_volume" :: waited 0.034s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:53:37 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fbe864c-c2a2-4151-bdfa-0f9cb7da0bed]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:53:37 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-7bcfe902-c0c7-4bbf-8c0a-937a7a661b34 tempest-VolumesExtendTest-25562998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-de9edb8c-a2ac-4cfe-959a-c4ff15e13107 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:53:37 devstack sudo[97749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-de9edb8c-a2ac-4cfe-959a-c4ff15e13107
Jun 15 15:53:37 devstack sudo[97749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:53:38 devstack sudo[97749]: pam_unix(sudo:session): session closed for user root
Jun 15 15:53:38 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-7bcfe902-c0c7-4bbf-8c0a-937a7a661b34 tempest-VolumesExtendTest-25562998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-de9edb8c-a2ac-4cfe-959a-c4ff15e13107" returned: 0 in 0.932s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:53:38 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-7bcfe902-c0c7-4bbf-8c0a-937a7a661b34 tempest-VolumesExtendTest-25562998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-de9edb8c-a2ac-4cfe-959a-c4ff15e13107 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:53:38 devstack sudo[98089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-de9edb8c-a2ac-4cfe-959a-c4ff15e13107
Jun 15 15:53:38 devstack sudo[98089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:53:39 devstack sudo[98089]: pam_unix(sudo:session): session closed for user root
Jun 15 15:53:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-7bcfe902-c0c7-4bbf-8c0a-937a7a661b34 tempest-VolumesExtendTest-25562998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-de9edb8c-a2ac-4cfe-959a-c4ff15e13107" returned: 0 in 0.699s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:53:39 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-7bcfe902-c0c7-4bbf-8c0a-937a7a661b34 tempest-VolumesExtendTest-25562998 None] Lock "cinder-quobyte-de9edb8c-a2ac-4cfe-959a-c4ff15e13107" released by "delete_volume" :: held 1.720s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:53:39 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-7bcfe902-c0c7-4bbf-8c0a-937a7a661b34 tempest-VolumesExtendTest-25562998 None] Created reservations ['67f44184-a05f-43e5-81cf-37954d7f1616', 'ddf17d4b-b584-4898-b2d8-fcf37b1ab668', '6c7d0041-846e-4ff4-ae87-a4456f40ae35', 'd2feea29-df87-43e8-87be-49952770684c'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:53:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-7bcfe902-c0c7-4bbf-8c0a-937a7a661b34 tempest-VolumesExtendTest-25562998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:53:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-7bcfe902-c0c7-4bbf-8c0a-937a7a661b34 tempest-VolumesExtendTest-25562998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:53:39 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-7bcfe902-c0c7-4bbf-8c0a-937a7a661b34 tempest-VolumesExtendTest-25562998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:53:39 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-7bcfe902-c0c7-4bbf-8c0a-937a7a661b34 tempest-VolumesExtendTest-25562998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:53:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-7bcfe902-c0c7-4bbf-8c0a-937a7a661b34 tempest-VolumesExtendTest-25562998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:53:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-7bcfe902-c0c7-4bbf-8c0a-937a7a661b34 tempest-VolumesExtendTest-25562998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:53:39 devstack sudo[98100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:53:39 devstack sudo[98100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:53:40 devstack sudo[98100]: pam_unix(sudo:session): session closed for user root
Jun 15 15:53:40 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-7bcfe902-c0c7-4bbf-8c0a-937a7a661b34 tempest-VolumesExtendTest-25562998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.771s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:53:40 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-7bcfe902-c0c7-4bbf-8c0a-937a7a661b34 tempest-VolumesExtendTest-25562998 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:53:40 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-7bcfe902-c0c7-4bbf-8c0a-937a7a661b34 tempest-VolumesExtendTest-25562998 None] Deleted volume successfully.
Jun 15 15:53:40 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-7bcfe902-c0c7-4bbf-8c0a-937a7a661b34 tempest-VolumesExtendTest-25562998 None] Lock "cinder-de9edb8c-a2ac-4cfe-959a-c4ff15e13107-delete_volume" released by "delete_volume" :: held 2.819s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:53:42 devstack cinder-volume[91863]: INFO cinder.volume.manager [req-96491a7a-4995-4b32-a899-dce7c58452f0 req-353ca4ae-f780-4287-b6ce-a847e57bd083 tempest-AttachVolumeNegativeTest-1849283913 None] Terminate volume connection completed successfully.
Jun 15 15:53:42 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [req-96491a7a-4995-4b32-a899-dce7c58452f0 req-353ca4ae-f780-4287-b6ce-a847e57bd083 tempest-AttachVolumeNegativeTest-1849283913 None] Deleting attachment ce7f8778-5cd1-4c3d-9b76-9f96d1825eaf. {{(pid=91863) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 15 15:53:50 devstack cinder-volume[91863]: DEBUG dbcounter [-] [91863] Writing DB stats cinder:SELECT=59,cinder:INSERT=17,cinder:UPDATE=64,cinder:DELETE=6 {{(pid=91863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 15:53:50 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f117be8-8aee-4bfe-ae05-d3b5a89b3d18 tempest-VolumesSnapshotNegativeTestJSON-921660006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 15:53:50 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5f117be8-8aee-4bfe-ae05-d3b5a89b3d18 tempest-VolumesSnapshotNegativeTestJSON-921660006 None] Flow 'volume_create_manager' (79de6cfd-40f3-4951-b662-1d739c0f3430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:53:50 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5f117be8-8aee-4bfe-ae05-d3b5a89b3d18 tempest-VolumesSnapshotNegativeTestJSON-921660006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41612ef1-0bb8-4732-9c28-60e3ef0cfba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:53:50 devstack cinder-volume[91863]: DEBUG dbcounter [-] [91863] Writing DB stats cinder:UPDATE=56,cinder:DELETE=4,cinder:SELECT=53,cinder:INSERT=21 {{(pid=91863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 15:53:50 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5f117be8-8aee-4bfe-ae05-d3b5a89b3d18 tempest-VolumesSnapshotNegativeTestJSON-921660006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41612ef1-0bb8-4732-9c28-60e3ef0cfba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:53:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1837310398',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b267f5a4-165f-49cf-9b5c-1482cbf3d189,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbb2818a31364dd2ad979a6149df1799',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:53:50Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:53:50Z,use_quota=True,user_id='78362be39ae6400bb8f3392d82eaea47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:53:50 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5f117be8-8aee-4bfe-ae05-d3b5a89b3d18 tempest-VolumesSnapshotNegativeTestJSON-921660006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4b8957c-0022-461f-a1d1-2fd4296bb04b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:53:50 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5f117be8-8aee-4bfe-ae05-d3b5a89b3d18 tempest-VolumesSnapshotNegativeTestJSON-921660006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4b8957c-0022-461f-a1d1-2fd4296bb04b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:53:50 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5f117be8-8aee-4bfe-ae05-d3b5a89b3d18 tempest-VolumesSnapshotNegativeTestJSON-921660006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77b08bed-12d4-4a93-9b60-05c8ab136e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:53:50 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5f117be8-8aee-4bfe-ae05-d3b5a89b3d18 tempest-VolumesSnapshotNegativeTestJSON-921660006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77b08bed-12d4-4a93-9b60-05c8ab136e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b267f5a4-165f-49cf-9b5c-1482cbf3d189', 'volume_name': 'volume-b267f5a4-165f-49cf-9b5c-1482cbf3d189', 'volume_size': 2}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:53:50 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5f117be8-8aee-4bfe-ae05-d3b5a89b3d18 tempest-VolumesSnapshotNegativeTestJSON-921660006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18cf5b42-a9dd-4dc5-8c4f-1c3f3adf11c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:53:50 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5f117be8-8aee-4bfe-ae05-d3b5a89b3d18 tempest-VolumesSnapshotNegativeTestJSON-921660006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18cf5b42-a9dd-4dc5-8c4f-1c3f3adf11c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:53:50 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5f117be8-8aee-4bfe-ae05-d3b5a89b3d18 tempest-VolumesSnapshotNegativeTestJSON-921660006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90ebb991-e258-48d6-9d97-d199d63cf168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:53:50 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-5f117be8-8aee-4bfe-ae05-d3b5a89b3d18 tempest-VolumesSnapshotNegativeTestJSON-921660006 None] Volume b267f5a4-165f-49cf-9b5c-1482cbf3d189: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b267f5a4-165f-49cf-9b5c-1482cbf3d189', 'volume_size': 2}
Jun 15 15:53:50 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-5f117be8-8aee-4bfe-ae05-d3b5a89b3d18 tempest-VolumesSnapshotNegativeTestJSON-921660006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:53:50 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-5f117be8-8aee-4bfe-ae05-d3b5a89b3d18 tempest-VolumesSnapshotNegativeTestJSON-921660006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:53:50 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-5f117be8-8aee-4bfe-ae05-d3b5a89b3d18 tempest-VolumesSnapshotNegativeTestJSON-921660006 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:53:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1837310398',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b267f5a4-165f-49cf-9b5c-1482cbf3d189,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbb2818a31364dd2ad979a6149df1799',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:53:50Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:53:50Z,use_quota=True,user_id='78362be39ae6400bb8f3392d82eaea47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 15:53:50 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-5f117be8-8aee-4bfe-ae05-d3b5a89b3d18 tempest-VolumesSnapshotNegativeTestJSON-921660006 None] Creating volume b267f5a4-165f-49cf-9b5c-1482cbf3d189 {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 15:53:50 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-5f117be8-8aee-4bfe-ae05-d3b5a89b3d18 tempest-VolumesSnapshotNegativeTestJSON-921660006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:53:50 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-5f117be8-8aee-4bfe-ae05-d3b5a89b3d18 tempest-VolumesSnapshotNegativeTestJSON-921660006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:53:50 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-5f117be8-8aee-4bfe-ae05-d3b5a89b3d18 tempest-VolumesSnapshotNegativeTestJSON-921660006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:53:50 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-5f117be8-8aee-4bfe-ae05-d3b5a89b3d18 tempest-VolumesSnapshotNegativeTestJSON-921660006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:53:50 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-5f117be8-8aee-4bfe-ae05-d3b5a89b3d18 tempest-VolumesSnapshotNegativeTestJSON-921660006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:53:50 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-5f117be8-8aee-4bfe-ae05-d3b5a89b3d18 tempest-VolumesSnapshotNegativeTestJSON-921660006 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 15:53:50 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-5f117be8-8aee-4bfe-ae05-d3b5a89b3d18 tempest-VolumesSnapshotNegativeTestJSON-921660006 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 15:53:50 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5f117be8-8aee-4bfe-ae05-d3b5a89b3d18 tempest-VolumesSnapshotNegativeTestJSON-921660006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b267f5a4-165f-49cf-9b5c-1482cbf3d189 2147483648 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:53:50 devstack sudo[98299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b267f5a4-165f-49cf-9b5c-1482cbf3d189 2147483648
Jun 15 15:53:50 devstack sudo[98299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:53:51 devstack sudo[98299]: pam_unix(sudo:session): session closed for user root
Jun 15 15:53:51 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5f117be8-8aee-4bfe-ae05-d3b5a89b3d18 tempest-VolumesSnapshotNegativeTestJSON-921660006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b267f5a4-165f-49cf-9b5c-1482cbf3d189 2147483648" returned: 0 in 1.170s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:53:51 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5f117be8-8aee-4bfe-ae05-d3b5a89b3d18 tempest-VolumesSnapshotNegativeTestJSON-921660006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b267f5a4-165f-49cf-9b5c-1482cbf3d189 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:53:52 devstack sudo[98309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b267f5a4-165f-49cf-9b5c-1482cbf3d189
Jun 15 15:53:52 devstack sudo[98309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:53:52 devstack sudo[98309]: pam_unix(sudo:session): session closed for user root
Jun 15 15:53:52 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5f117be8-8aee-4bfe-ae05-d3b5a89b3d18 tempest-VolumesSnapshotNegativeTestJSON-921660006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b267f5a4-165f-49cf-9b5c-1482cbf3d189" returned: 0 in 0.833s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:53:52 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-5f117be8-8aee-4bfe-ae05-d3b5a89b3d18 tempest-VolumesSnapshotNegativeTestJSON-921660006 None] <== create_volume: return (2123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 15:53:52 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-5f117be8-8aee-4bfe-ae05-d3b5a89b3d18 tempest-VolumesSnapshotNegativeTestJSON-921660006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.127s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:53:52 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5f117be8-8aee-4bfe-ae05-d3b5a89b3d18 tempest-VolumesSnapshotNegativeTestJSON-921660006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90ebb991-e258-48d6-9d97-d199d63cf168) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b267f5a4-165f-49cf-9b5c-1482cbf3d189', 'volume_size': 2}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:53:52 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5f117be8-8aee-4bfe-ae05-d3b5a89b3d18 tempest-VolumesSnapshotNegativeTestJSON-921660006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d0131fd-75c2-48c9-a678-b95c1a37a9e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:53:52 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-5f117be8-8aee-4bfe-ae05-d3b5a89b3d18 tempest-VolumesSnapshotNegativeTestJSON-921660006 None] Volume volume-b267f5a4-165f-49cf-9b5c-1482cbf3d189 (b267f5a4-165f-49cf-9b5c-1482cbf3d189): created successfully
Jun 15 15:53:52 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5f117be8-8aee-4bfe-ae05-d3b5a89b3d18 tempest-VolumesSnapshotNegativeTestJSON-921660006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d0131fd-75c2-48c9-a678-b95c1a37a9e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:53:52 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5f117be8-8aee-4bfe-ae05-d3b5a89b3d18 tempest-VolumesSnapshotNegativeTestJSON-921660006 None] Flow 'volume_create_manager' (79de6cfd-40f3-4951-b662-1d739c0f3430) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:53:52 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-5f117be8-8aee-4bfe-ae05-d3b5a89b3d18 tempest-VolumesSnapshotNegativeTestJSON-921660006 None] Created volume successfully.
Jun 15 15:53:54 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-f4b85478-9e1b-465a-957b-e2c4639b2052 tempest-VolumesSnapshotNegativeTestJSON-921660006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:53:54 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-f4b85478-9e1b-465a-957b-e2c4639b2052 tempest-VolumesSnapshotNegativeTestJSON-921660006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:53:54 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-f4b85478-9e1b-465a-957b-e2c4639b2052 tempest-VolumesSnapshotNegativeTestJSON-921660006 None] Creating offline snapshot 4d6f105b-a02d-4762-80f1-093ec0245246 of volume b267f5a4-165f-49cf-9b5c-1482cbf3d189 {{(pid=91863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 15 15:53:54 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a76eab-ab0d-498f-a3ac-8db0707dcc5f]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:53:54 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-f4b85478-9e1b-465a-957b-e2c4639b2052 tempest-VolumesSnapshotNegativeTestJSON-921660006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b267f5a4-165f-49cf-9b5c-1482cbf3d189 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:53:54 devstack sudo[98313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b267f5a4-165f-49cf-9b5c-1482cbf3d189
Jun 15 15:53:54 devstack sudo[98313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:53:55 devstack sudo[98313]: pam_unix(sudo:session): session closed for user root
Jun 15 15:53:55 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-f4b85478-9e1b-465a-957b-e2c4639b2052 tempest-VolumesSnapshotNegativeTestJSON-921660006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b267f5a4-165f-49cf-9b5c-1482cbf3d189" returned: 0 in 1.044s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:53:55 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-f4b85478-9e1b-465a-957b-e2c4639b2052 tempest-VolumesSnapshotNegativeTestJSON-921660006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b267f5a4-165f-49cf-9b5c-1482cbf3d189,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b267f5a4-165f-49cf-9b5c-1482cbf3d189.4d6f105b-a02d-4762-80f1-093ec0245246 2G {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:53:55 devstack sudo[98318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b267f5a4-165f-49cf-9b5c-1482cbf3d189,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b267f5a4-165f-49cf-9b5c-1482cbf3d189.4d6f105b-a02d-4762-80f1-093ec0245246 2G
Jun 15 15:53:55 devstack sudo[98318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:53:56 devstack sudo[98318]: pam_unix(sudo:session): session closed for user root
Jun 15 15:53:56 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-f4b85478-9e1b-465a-957b-e2c4639b2052 tempest-VolumesSnapshotNegativeTestJSON-921660006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b267f5a4-165f-49cf-9b5c-1482cbf3d189,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b267f5a4-165f-49cf-9b5c-1482cbf3d189.4d6f105b-a02d-4762-80f1-093ec0245246 2G" returned: 0 in 1.169s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:53:56 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-f4b85478-9e1b-465a-957b-e2c4639b2052 tempest-VolumesSnapshotNegativeTestJSON-921660006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b267f5a4-165f-49cf-9b5c-1482cbf3d189 -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b267f5a4-165f-49cf-9b5c-1482cbf3d189.4d6f105b-a02d-4762-80f1-093ec0245246 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:53:56 devstack sudo[98325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b267f5a4-165f-49cf-9b5c-1482cbf3d189 -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b267f5a4-165f-49cf-9b5c-1482cbf3d189.4d6f105b-a02d-4762-80f1-093ec0245246
Jun 15 15:53:56 devstack sudo[98325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:53:58 devstack sudo[98325]: pam_unix(sudo:session): session closed for user root
Jun 15 15:53:58 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-f4b85478-9e1b-465a-957b-e2c4639b2052 tempest-VolumesSnapshotNegativeTestJSON-921660006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b267f5a4-165f-49cf-9b5c-1482cbf3d189 -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b267f5a4-165f-49cf-9b5c-1482cbf3d189.4d6f105b-a02d-4762-80f1-093ec0245246" returned: 0 in 1.484s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:53:58 devstack cinder-volume[91863]: WARNING cinder.volume.drivers.remotefs [None req-f4b85478-9e1b-465a-957b-e2c4639b2052 tempest-VolumesSnapshotNegativeTestJSON-921660006 None] /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b267f5a4-165f-49cf-9b5c-1482cbf3d189.4d6f105b-a02d-4762-80f1-093ec0245246 is being set with open permissions: ugo+rw
Jun 15 15:53:58 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-f4b85478-9e1b-465a-957b-e2c4639b2052 tempest-VolumesSnapshotNegativeTestJSON-921660006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b267f5a4-165f-49cf-9b5c-1482cbf3d189.4d6f105b-a02d-4762-80f1-093ec0245246 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:53:58 devstack sudo[98330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b267f5a4-165f-49cf-9b5c-1482cbf3d189.4d6f105b-a02d-4762-80f1-093ec0245246
Jun 15 15:53:58 devstack sudo[98330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:53:59 devstack sudo[98330]: pam_unix(sudo:session): session closed for user root
Jun 15 15:53:59 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-f4b85478-9e1b-465a-957b-e2c4639b2052 tempest-VolumesSnapshotNegativeTestJSON-921660006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b267f5a4-165f-49cf-9b5c-1482cbf3d189.4d6f105b-a02d-4762-80f1-093ec0245246" returned: 0 in 1.569s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:53:59 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-f4b85478-9e1b-465a-957b-e2c4639b2052 tempest-VolumesSnapshotNegativeTestJSON-921660006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b267f5a4-165f-49cf-9b5c-1482cbf3d189.info {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:53:59 devstack sudo[98345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b267f5a4-165f-49cf-9b5c-1482cbf3d189.info
Jun 15 15:53:59 devstack sudo[98345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:54:00 devstack sudo[98345]: pam_unix(sudo:session): session closed for user root
Jun 15 15:54:00 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-f4b85478-9e1b-465a-957b-e2c4639b2052 tempest-VolumesSnapshotNegativeTestJSON-921660006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b267f5a4-165f-49cf-9b5c-1482cbf3d189.info" returned: 0 in 0.909s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:54:00 devstack cinder-volume[91863]: WARNING cinder.volume.drivers.remotefs [None req-f4b85478-9e1b-465a-957b-e2c4639b2052 tempest-VolumesSnapshotNegativeTestJSON-921660006 None] /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b267f5a4-165f-49cf-9b5c-1482cbf3d189.info is being set with open permissions: ugo+rw
Jun 15 15:54:00 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-f4b85478-9e1b-465a-957b-e2c4639b2052 tempest-VolumesSnapshotNegativeTestJSON-921660006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b267f5a4-165f-49cf-9b5c-1482cbf3d189.info {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:54:00 devstack sudo[98368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b267f5a4-165f-49cf-9b5c-1482cbf3d189.info
Jun 15 15:54:00 devstack sudo[98368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:54:01 devstack sudo[98368]: pam_unix(sudo:session): session closed for user root
Jun 15 15:54:01 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-f4b85478-9e1b-465a-957b-e2c4639b2052 tempest-VolumesSnapshotNegativeTestJSON-921660006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b267f5a4-165f-49cf-9b5c-1482cbf3d189.info" returned: 0 in 1.151s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:54:01 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-f4b85478-9e1b-465a-957b-e2c4639b2052 tempest-VolumesSnapshotNegativeTestJSON-921660006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.537s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:54:01 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-f4b85478-9e1b-465a-957b-e2c4639b2052 tempest-VolumesSnapshotNegativeTestJSON-921660006 None] Create snapshot completed successfully
Jun 15 15:54:03 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-1ade80c8-a6aa-4895-a3ba-0b2d5ef39a14 tempest-VolumesSnapshotNegativeTestJSON-921660006 None] Acquiring lock "cinder-4d6f105b-a02d-4762-80f1-093ec0245246-delete_snapshot" by "delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:54:03 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-1ade80c8-a6aa-4895-a3ba-0b2d5ef39a14 tempest-VolumesSnapshotNegativeTestJSON-921660006 None] Lock "cinder-4d6f105b-a02d-4762-80f1-093ec0245246-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:54:03 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-1ade80c8-a6aa-4895-a3ba-0b2d5ef39a14 tempest-VolumesSnapshotNegativeTestJSON-921660006 None] Acquiring lock "cinder-quobyte-b267f5a4-165f-49cf-9b5c-1482cbf3d189" by "delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:54:03 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-1ade80c8-a6aa-4895-a3ba-0b2d5ef39a14 tempest-VolumesSnapshotNegativeTestJSON-921660006 None] Lock "cinder-quobyte-b267f5a4-165f-49cf-9b5c-1482cbf3d189" acquired by "delete_snapshot" :: waited 0.024s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:54:03 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-1ade80c8-a6aa-4895-a3ba-0b2d5ef39a14 tempest-VolumesSnapshotNegativeTestJSON-921660006 None] Acquiring lock "cinder-quobyte-4d6f105b-a02d-4762-80f1-093ec0245246" by "_delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:54:03 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-1ade80c8-a6aa-4895-a3ba-0b2d5ef39a14 tempest-VolumesSnapshotNegativeTestJSON-921660006 None] Lock "cinder-quobyte-4d6f105b-a02d-4762-80f1-093ec0245246" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:54:03 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-1ade80c8-a6aa-4895-a3ba-0b2d5ef39a14 tempest-VolumesSnapshotNegativeTestJSON-921660006 None] Deleting offline snapshot 4d6f105b-a02d-4762-80f1-093ec0245246 of volume b267f5a4-165f-49cf-9b5c-1482cbf3d189 {{(pid=91863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 15 15:54:03 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-1ade80c8-a6aa-4895-a3ba-0b2d5ef39a14 tempest-VolumesSnapshotNegativeTestJSON-921660006 None] snapshot_file for this snap is: volume-b267f5a4-165f-49cf-9b5c-1482cbf3d189.4d6f105b-a02d-4762-80f1-093ec0245246 {{(pid=91863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 15 15:54:03 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0761404d-7120-4ad3-8977-9e7e32f85630]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:54:03 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-1ade80c8-a6aa-4895-a3ba-0b2d5ef39a14 tempest-VolumesSnapshotNegativeTestJSON-921660006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b267f5a4-165f-49cf-9b5c-1482cbf3d189.4d6f105b-a02d-4762-80f1-093ec0245246 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:54:03 devstack sudo[98406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b267f5a4-165f-49cf-9b5c-1482cbf3d189.4d6f105b-a02d-4762-80f1-093ec0245246
Jun 15 15:54:03 devstack sudo[98406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:54:04 devstack sudo[98406]: pam_unix(sudo:session): session closed for user root
Jun 15 15:54:04 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-1ade80c8-a6aa-4895-a3ba-0b2d5ef39a14 tempest-VolumesSnapshotNegativeTestJSON-921660006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b267f5a4-165f-49cf-9b5c-1482cbf3d189.4d6f105b-a02d-4762-80f1-093ec0245246" returned: 0 in 0.992s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:54:04 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-1ade80c8-a6aa-4895-a3ba-0b2d5ef39a14 tempest-VolumesSnapshotNegativeTestJSON-921660006 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b267f5a4-165f-49cf-9b5c-1482cbf3d189(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 15:54:04 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c2a462-0325-4fec-b226-f475e1f33d0c]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:54:04 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-1ade80c8-a6aa-4895-a3ba-0b2d5ef39a14 tempest-VolumesSnapshotNegativeTestJSON-921660006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b267f5a4-165f-49cf-9b5c-1482cbf3d189 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:54:04 devstack sudo[98415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b267f5a4-165f-49cf-9b5c-1482cbf3d189
Jun 15 15:54:04 devstack sudo[98415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:54:04 devstack sudo[98415]: pam_unix(sudo:session): session closed for user root
Jun 15 15:54:04 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-1ade80c8-a6aa-4895-a3ba-0b2d5ef39a14 tempest-VolumesSnapshotNegativeTestJSON-921660006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b267f5a4-165f-49cf-9b5c-1482cbf3d189" returned: 0 in 0.753s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:54:04 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-1ade80c8-a6aa-4895-a3ba-0b2d5ef39a14 tempest-VolumesSnapshotNegativeTestJSON-921660006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b267f5a4-165f-49cf-9b5c-1482cbf3d189.4d6f105b-a02d-4762-80f1-093ec0245246 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:54:04 devstack sudo[98420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b267f5a4-165f-49cf-9b5c-1482cbf3d189.4d6f105b-a02d-4762-80f1-093ec0245246
Jun 15 15:54:04 devstack sudo[98420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:54:05 devstack sudo[98420]: pam_unix(sudo:session): session closed for user root
Jun 15 15:54:05 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-1ade80c8-a6aa-4895-a3ba-0b2d5ef39a14 tempest-VolumesSnapshotNegativeTestJSON-921660006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b267f5a4-165f-49cf-9b5c-1482cbf3d189.4d6f105b-a02d-4762-80f1-093ec0245246" returned: 0 in 0.686s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:54:05 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-1ade80c8-a6aa-4895-a3ba-0b2d5ef39a14 tempest-VolumesSnapshotNegativeTestJSON-921660006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b267f5a4-165f-49cf-9b5c-1482cbf3d189.4d6f105b-a02d-4762-80f1-093ec0245246 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:54:05 devstack sudo[98428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b267f5a4-165f-49cf-9b5c-1482cbf3d189.4d6f105b-a02d-4762-80f1-093ec0245246
Jun 15 15:54:05 devstack sudo[98428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:54:06 devstack sudo[98428]: pam_unix(sudo:session): session closed for user root
Jun 15 15:54:06 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-1ade80c8-a6aa-4895-a3ba-0b2d5ef39a14 tempest-VolumesSnapshotNegativeTestJSON-921660006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b267f5a4-165f-49cf-9b5c-1482cbf3d189.4d6f105b-a02d-4762-80f1-093ec0245246" returned: 0 in 0.636s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:54:06 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-1ade80c8-a6aa-4895-a3ba-0b2d5ef39a14 tempest-VolumesSnapshotNegativeTestJSON-921660006 None] Lock "cinder-quobyte-4d6f105b-a02d-4762-80f1-093ec0245246" released by "_delete_snapshot" :: held 3.197s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:54:06 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-1ade80c8-a6aa-4895-a3ba-0b2d5ef39a14 tempest-VolumesSnapshotNegativeTestJSON-921660006 None] Lock "cinder-quobyte-b267f5a4-165f-49cf-9b5c-1482cbf3d189" released by "delete_snapshot" :: held 3.226s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:54:06 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-1ade80c8-a6aa-4895-a3ba-0b2d5ef39a14 tempest-VolumesSnapshotNegativeTestJSON-921660006 None] Created reservations ['501e9fb9-7e6e-48da-8574-cbf196409289', 'd0c313f5-4c8e-4f98-a51a-273036dc6a56', '2082176a-09a6-4a52-ba9c-114a4f7be9d7', '3b80df21-f8d0-4888-addf-1971f56d9555'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:54:06 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-1ade80c8-a6aa-4895-a3ba-0b2d5ef39a14 tempest-VolumesSnapshotNegativeTestJSON-921660006 None] Delete snapshot completed successfully.
Jun 15 15:54:06 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-1ade80c8-a6aa-4895-a3ba-0b2d5ef39a14 tempest-VolumesSnapshotNegativeTestJSON-921660006 None] Lock "cinder-4d6f105b-a02d-4762-80f1-093ec0245246-delete_snapshot" released by "delete_snapshot" :: held 3.376s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:54:07 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-35c80e77-921a-42fd-9d68-301a3f6e6e6f tempest-VolumesSnapshotNegativeTestJSON-921660006 None] Acquiring lock "cinder-b267f5a4-165f-49cf-9b5c-1482cbf3d189-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:54:07 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-35c80e77-921a-42fd-9d68-301a3f6e6e6f tempest-VolumesSnapshotNegativeTestJSON-921660006 None] Lock "cinder-b267f5a4-165f-49cf-9b5c-1482cbf3d189-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:54:07 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-35c80e77-921a-42fd-9d68-301a3f6e6e6f tempest-VolumesSnapshotNegativeTestJSON-921660006 None] Acquiring lock "cinder-quobyte-b267f5a4-165f-49cf-9b5c-1482cbf3d189" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:54:07 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-35c80e77-921a-42fd-9d68-301a3f6e6e6f tempest-VolumesSnapshotNegativeTestJSON-921660006 None] Lock "cinder-quobyte-b267f5a4-165f-49cf-9b5c-1482cbf3d189" acquired by "delete_volume" :: waited 0.035s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:54:07 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[6adbe120-bfcf-4fe3-a3d7-bdf1b787796a]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:54:07 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-35c80e77-921a-42fd-9d68-301a3f6e6e6f tempest-VolumesSnapshotNegativeTestJSON-921660006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b267f5a4-165f-49cf-9b5c-1482cbf3d189 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:54:08 devstack sudo[98467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b267f5a4-165f-49cf-9b5c-1482cbf3d189
Jun 15 15:54:08 devstack sudo[98467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:54:09 devstack sudo[98467]: pam_unix(sudo:session): session closed for user root
Jun 15 15:54:09 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-35c80e77-921a-42fd-9d68-301a3f6e6e6f tempest-VolumesSnapshotNegativeTestJSON-921660006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b267f5a4-165f-49cf-9b5c-1482cbf3d189" returned: 0 in 1.490s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:54:09 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-35c80e77-921a-42fd-9d68-301a3f6e6e6f tempest-VolumesSnapshotNegativeTestJSON-921660006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b267f5a4-165f-49cf-9b5c-1482cbf3d189 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:54:09 devstack sudo[98476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b267f5a4-165f-49cf-9b5c-1482cbf3d189
Jun 15 15:54:09 devstack sudo[98476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:54:10 devstack sudo[98476]: pam_unix(sudo:session): session closed for user root
Jun 15 15:54:10 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-35c80e77-921a-42fd-9d68-301a3f6e6e6f tempest-VolumesSnapshotNegativeTestJSON-921660006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b267f5a4-165f-49cf-9b5c-1482cbf3d189" returned: 0 in 1.344s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:54:10 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-35c80e77-921a-42fd-9d68-301a3f6e6e6f tempest-VolumesSnapshotNegativeTestJSON-921660006 None] Lock "cinder-quobyte-b267f5a4-165f-49cf-9b5c-1482cbf3d189" released by "delete_volume" :: held 2.959s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:54:10 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-35c80e77-921a-42fd-9d68-301a3f6e6e6f tempest-VolumesSnapshotNegativeTestJSON-921660006 None] Created reservations ['65be8c2d-3f72-4dc1-8077-71004a701b12', '4566bc48-94fe-46d9-9447-58841ca408fe', 'b598c5eb-6b01-45ec-a5b0-379abbf7114c', '72a1bc80-9c3a-48f7-becf-3cc0e5516807'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:54:10 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-35c80e77-921a-42fd-9d68-301a3f6e6e6f tempest-VolumesSnapshotNegativeTestJSON-921660006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:54:10 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-35c80e77-921a-42fd-9d68-301a3f6e6e6f tempest-VolumesSnapshotNegativeTestJSON-921660006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:54:10 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-35c80e77-921a-42fd-9d68-301a3f6e6e6f tempest-VolumesSnapshotNegativeTestJSON-921660006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:54:10 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-35c80e77-921a-42fd-9d68-301a3f6e6e6f tempest-VolumesSnapshotNegativeTestJSON-921660006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:54:10 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-35c80e77-921a-42fd-9d68-301a3f6e6e6f tempest-VolumesSnapshotNegativeTestJSON-921660006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:54:10 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-35c80e77-921a-42fd-9d68-301a3f6e6e6f tempest-VolumesSnapshotNegativeTestJSON-921660006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:54:10 devstack sudo[98487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:54:10 devstack sudo[98487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:54:11 devstack sudo[98487]: pam_unix(sudo:session): session closed for user root
Jun 15 15:54:11 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-35c80e77-921a-42fd-9d68-301a3f6e6e6f tempest-VolumesSnapshotNegativeTestJSON-921660006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 1.124s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:54:11 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-35c80e77-921a-42fd-9d68-301a3f6e6e6f tempest-VolumesSnapshotNegativeTestJSON-921660006 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:54:11 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-35c80e77-921a-42fd-9d68-301a3f6e6e6f tempest-VolumesSnapshotNegativeTestJSON-921660006 None] Deleted volume successfully.
Jun 15 15:54:12 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-35c80e77-921a-42fd-9d68-301a3f6e6e6f tempest-VolumesSnapshotNegativeTestJSON-921660006 None] Lock "cinder-b267f5a4-165f-49cf-9b5c-1482cbf3d189-delete_volume" released by "delete_volume" :: held 4.477s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:54:16 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ba54477-00c9-43d0-8c60-7f9177e0cf72 tempest-CreateVolumesFromImageTest-646327476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 15:54:16 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-4ba54477-00c9-43d0-8c60-7f9177e0cf72 tempest-CreateVolumesFromImageTest-646327476 None] Flow 'volume_create_manager' (ddf9a790-b411-4963-920a-c88bc0f09018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:54:16 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-4ba54477-00c9-43d0-8c60-7f9177e0cf72 tempest-CreateVolumesFromImageTest-646327476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88d08134-6207-47f3-8415-2149f365669f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:54:16 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-4ba54477-00c9-43d0-8c60-7f9177e0cf72 tempest-CreateVolumesFromImageTest-646327476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88d08134-6207-47f3-8415-2149f365669f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:54:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-844043401',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e1e2cfe-9346-4142-8a35-38165e9ea954,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9bf548361814937a988d96233f09ce1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:54:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:54:17Z,use_quota=True,user_id='c0e6a4d72b2c488e80615b9aee1e78dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:54:16 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-4ba54477-00c9-43d0-8c60-7f9177e0cf72 tempest-CreateVolumesFromImageTest-646327476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (156fbfb3-7e70-4d76-90d8-1d10e00c3a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:54:16 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-4ba54477-00c9-43d0-8c60-7f9177e0cf72 tempest-CreateVolumesFromImageTest-646327476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (156fbfb3-7e70-4d76-90d8-1d10e00c3a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:54:16 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-4ba54477-00c9-43d0-8c60-7f9177e0cf72 tempest-CreateVolumesFromImageTest-646327476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (252c27ca-ba9a-4fdf-a170-3c0921081ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:54:16 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-4ba54477-00c9-43d0-8c60-7f9177e0cf72 tempest-CreateVolumesFromImageTest-646327476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (252c27ca-ba9a-4fdf-a170-3c0921081ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e1e2cfe-9346-4142-8a35-38165e9ea954', 'volume_name': 'volume-6e1e2cfe-9346-4142-8a35-38165e9ea954', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:54:16 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-4ba54477-00c9-43d0-8c60-7f9177e0cf72 tempest-CreateVolumesFromImageTest-646327476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2684a320-b580-4ecd-888d-e3df42d3685f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:54:16 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-4ba54477-00c9-43d0-8c60-7f9177e0cf72 tempest-CreateVolumesFromImageTest-646327476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2684a320-b580-4ecd-888d-e3df42d3685f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:54:16 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-4ba54477-00c9-43d0-8c60-7f9177e0cf72 tempest-CreateVolumesFromImageTest-646327476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96e59fd1-a496-4569-8087-a3d90997f423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:54:16 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-4ba54477-00c9-43d0-8c60-7f9177e0cf72 tempest-CreateVolumesFromImageTest-646327476 None] Volume 6e1e2cfe-9346-4142-8a35-38165e9ea954: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e1e2cfe-9346-4142-8a35-38165e9ea954', 'volume_size': 1}
Jun 15 15:54:16 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-4ba54477-00c9-43d0-8c60-7f9177e0cf72 tempest-CreateVolumesFromImageTest-646327476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:54:16 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-4ba54477-00c9-43d0-8c60-7f9177e0cf72 tempest-CreateVolumesFromImageTest-646327476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:54:16 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-4ba54477-00c9-43d0-8c60-7f9177e0cf72 tempest-CreateVolumesFromImageTest-646327476 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:54:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-844043401',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e1e2cfe-9346-4142-8a35-38165e9ea954,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9bf548361814937a988d96233f09ce1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:54:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:54:17Z,use_quota=True,user_id='c0e6a4d72b2c488e80615b9aee1e78dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 15:54:16 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-4ba54477-00c9-43d0-8c60-7f9177e0cf72 tempest-CreateVolumesFromImageTest-646327476 None] Creating volume 6e1e2cfe-9346-4142-8a35-38165e9ea954 {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 15:54:16 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-4ba54477-00c9-43d0-8c60-7f9177e0cf72 tempest-CreateVolumesFromImageTest-646327476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:54:16 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-4ba54477-00c9-43d0-8c60-7f9177e0cf72 tempest-CreateVolumesFromImageTest-646327476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:54:16 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-4ba54477-00c9-43d0-8c60-7f9177e0cf72 tempest-CreateVolumesFromImageTest-646327476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:54:16 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-4ba54477-00c9-43d0-8c60-7f9177e0cf72 tempest-CreateVolumesFromImageTest-646327476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:54:16 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-4ba54477-00c9-43d0-8c60-7f9177e0cf72 tempest-CreateVolumesFromImageTest-646327476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:54:16 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-4ba54477-00c9-43d0-8c60-7f9177e0cf72 tempest-CreateVolumesFromImageTest-646327476 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 15:54:16 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-4ba54477-00c9-43d0-8c60-7f9177e0cf72 tempest-CreateVolumesFromImageTest-646327476 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 15:54:16 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-4ba54477-00c9-43d0-8c60-7f9177e0cf72 tempest-CreateVolumesFromImageTest-646327476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-6e1e2cfe-9346-4142-8a35-38165e9ea954 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:54:16 devstack sudo[98570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-6e1e2cfe-9346-4142-8a35-38165e9ea954 1073741824
Jun 15 15:54:16 devstack sudo[98570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:54:17 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-35c7c91f-d4fe-4791-ac94-fc46c885518f tempest-CreateVolumesFromImageTest-646327476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 15:54:17 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-35c7c91f-d4fe-4791-ac94-fc46c885518f tempest-CreateVolumesFromImageTest-646327476 None] Flow 'volume_create_manager' (3a404ceb-1ea4-417b-abc3-3b8a02933413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:54:17 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-35c7c91f-d4fe-4791-ac94-fc46c885518f tempest-CreateVolumesFromImageTest-646327476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e418db90-704a-4d67-a3aa-6e14d41e1cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:54:17 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-35c7c91f-d4fe-4791-ac94-fc46c885518f tempest-CreateVolumesFromImageTest-646327476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e418db90-704a-4d67-a3aa-6e14d41e1cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:54:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-807736037',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d900c3e-0377-4d68-944b-07f8d5dfc116,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9bf548361814937a988d96233f09ce1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:54:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:54:17Z,use_quota=True,user_id='c0e6a4d72b2c488e80615b9aee1e78dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:54:17 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-35c7c91f-d4fe-4791-ac94-fc46c885518f tempest-CreateVolumesFromImageTest-646327476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d8a8ef2-d4ed-4939-9e76-802700cebaa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:54:17 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-35c7c91f-d4fe-4791-ac94-fc46c885518f tempest-CreateVolumesFromImageTest-646327476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d8a8ef2-d4ed-4939-9e76-802700cebaa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:54:17 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-35c7c91f-d4fe-4791-ac94-fc46c885518f tempest-CreateVolumesFromImageTest-646327476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31393559-af73-4385-9a75-beda723593f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:54:17 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-35c7c91f-d4fe-4791-ac94-fc46c885518f tempest-CreateVolumesFromImageTest-646327476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31393559-af73-4385-9a75-beda723593f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d900c3e-0377-4d68-944b-07f8d5dfc116', 'volume_name': 'volume-2d900c3e-0377-4d68-944b-07f8d5dfc116', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:54:17 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-35c7c91f-d4fe-4791-ac94-fc46c885518f tempest-CreateVolumesFromImageTest-646327476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ba142a0-5327-42d0-8596-a52748158390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:54:17 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-35c7c91f-d4fe-4791-ac94-fc46c885518f tempest-CreateVolumesFromImageTest-646327476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ba142a0-5327-42d0-8596-a52748158390) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:54:17 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-35c7c91f-d4fe-4791-ac94-fc46c885518f tempest-CreateVolumesFromImageTest-646327476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f2e7285-ba1c-4abb-bcf0-c3504b365005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:54:17 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-35c7c91f-d4fe-4791-ac94-fc46c885518f tempest-CreateVolumesFromImageTest-646327476 None] Volume 2d900c3e-0377-4d68-944b-07f8d5dfc116: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d900c3e-0377-4d68-944b-07f8d5dfc116', 'volume_size': 1}
Jun 15 15:54:17 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-35c7c91f-d4fe-4791-ac94-fc46c885518f tempest-CreateVolumesFromImageTest-646327476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:54:18 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f0fd7c0-864f-461e-8ff7-c08bd88d12b6 tempest-CreateVolumesFromImageTest-646327476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 15:54:18 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-3f0fd7c0-864f-461e-8ff7-c08bd88d12b6 tempest-CreateVolumesFromImageTest-646327476 None] Flow 'volume_create_manager' (772cf24c-e42d-4f1e-b948-42fec9b3c86b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:54:18 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-3f0fd7c0-864f-461e-8ff7-c08bd88d12b6 tempest-CreateVolumesFromImageTest-646327476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4085dc4f-9816-4b29-a3dd-c6bbd24c152d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:54:18 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-3f0fd7c0-864f-461e-8ff7-c08bd88d12b6 tempest-CreateVolumesFromImageTest-646327476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4085dc4f-9816-4b29-a3dd-c6bbd24c152d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:54:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1787614306',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14426d40-900b-4680-8964-76a66e441e57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9bf548361814937a988d96233f09ce1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:54:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:54:18Z,use_quota=True,user_id='c0e6a4d72b2c488e80615b9aee1e78dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:54:18 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-3f0fd7c0-864f-461e-8ff7-c08bd88d12b6 tempest-CreateVolumesFromImageTest-646327476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2aca2e29-3dd5-45be-9141-aa8c94f91f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:54:18 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-3f0fd7c0-864f-461e-8ff7-c08bd88d12b6 tempest-CreateVolumesFromImageTest-646327476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2aca2e29-3dd5-45be-9141-aa8c94f91f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:54:18 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-3f0fd7c0-864f-461e-8ff7-c08bd88d12b6 tempest-CreateVolumesFromImageTest-646327476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f736499-bda2-4c11-849c-388c7c13e930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:54:18 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-3f0fd7c0-864f-461e-8ff7-c08bd88d12b6 tempest-CreateVolumesFromImageTest-646327476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f736499-bda2-4c11-849c-388c7c13e930) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14426d40-900b-4680-8964-76a66e441e57', 'volume_name': 'volume-14426d40-900b-4680-8964-76a66e441e57', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:54:18 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-3f0fd7c0-864f-461e-8ff7-c08bd88d12b6 tempest-CreateVolumesFromImageTest-646327476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37b5f332-61ac-4963-93d9-9cb016ed5346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:54:18 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-3f0fd7c0-864f-461e-8ff7-c08bd88d12b6 tempest-CreateVolumesFromImageTest-646327476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37b5f332-61ac-4963-93d9-9cb016ed5346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:54:18 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-3f0fd7c0-864f-461e-8ff7-c08bd88d12b6 tempest-CreateVolumesFromImageTest-646327476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (feefce48-bb6c-48f7-9206-45af344c9948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:54:18 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-3f0fd7c0-864f-461e-8ff7-c08bd88d12b6 tempest-CreateVolumesFromImageTest-646327476 None] Volume 14426d40-900b-4680-8964-76a66e441e57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14426d40-900b-4680-8964-76a66e441e57', 'volume_size': 1}
Jun 15 15:54:18 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-3f0fd7c0-864f-461e-8ff7-c08bd88d12b6 tempest-CreateVolumesFromImageTest-646327476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:54:18 devstack sudo[98570]: pam_unix(sudo:session): session closed for user root
Jun 15 15:54:18 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-4ba54477-00c9-43d0-8c60-7f9177e0cf72 tempest-CreateVolumesFromImageTest-646327476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-6e1e2cfe-9346-4142-8a35-38165e9ea954 1073741824" returned: 0 in 1.467s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:54:18 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-4ba54477-00c9-43d0-8c60-7f9177e0cf72 tempest-CreateVolumesFromImageTest-646327476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-6e1e2cfe-9346-4142-8a35-38165e9ea954 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:54:18 devstack sudo[98581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-6e1e2cfe-9346-4142-8a35-38165e9ea954
Jun 15 15:54:18 devstack sudo[98581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:54:18 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c31fec5-7a93-47db-a0eb-73c23ace515c tempest-CreateVolumesFromImageTest-646327476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 15:54:18 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-1c31fec5-7a93-47db-a0eb-73c23ace515c tempest-CreateVolumesFromImageTest-646327476 None] Flow 'volume_create_manager' (81f7bd12-4895-4629-b1be-f46228250a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:54:18 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-1c31fec5-7a93-47db-a0eb-73c23ace515c tempest-CreateVolumesFromImageTest-646327476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c70069b-7dbc-4e82-8f94-c4ead052835f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:54:18 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-1c31fec5-7a93-47db-a0eb-73c23ace515c tempest-CreateVolumesFromImageTest-646327476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c70069b-7dbc-4e82-8f94-c4ead052835f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:54:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-369217344',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=139d220c-6a34-4f28-bf8d-9c7672f90ab5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9bf548361814937a988d96233f09ce1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:54:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:54:19Z,use_quota=True,user_id='c0e6a4d72b2c488e80615b9aee1e78dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:54:18 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-1c31fec5-7a93-47db-a0eb-73c23ace515c tempest-CreateVolumesFromImageTest-646327476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a56d9742-5bca-48b6-9798-63d38f091ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:54:18 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-1c31fec5-7a93-47db-a0eb-73c23ace515c tempest-CreateVolumesFromImageTest-646327476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a56d9742-5bca-48b6-9798-63d38f091ce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:54:18 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-1c31fec5-7a93-47db-a0eb-73c23ace515c tempest-CreateVolumesFromImageTest-646327476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (351eaa7a-73aa-401f-94a0-faa2611ade8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:54:18 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-1c31fec5-7a93-47db-a0eb-73c23ace515c tempest-CreateVolumesFromImageTest-646327476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (351eaa7a-73aa-401f-94a0-faa2611ade8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '139d220c-6a34-4f28-bf8d-9c7672f90ab5', 'volume_name': 'volume-139d220c-6a34-4f28-bf8d-9c7672f90ab5', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:54:18 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-1c31fec5-7a93-47db-a0eb-73c23ace515c tempest-CreateVolumesFromImageTest-646327476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5509ed80-6332-4859-955a-7e150b22d2fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:54:18 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-1c31fec5-7a93-47db-a0eb-73c23ace515c tempest-CreateVolumesFromImageTest-646327476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5509ed80-6332-4859-955a-7e150b22d2fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:54:18 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-1c31fec5-7a93-47db-a0eb-73c23ace515c tempest-CreateVolumesFromImageTest-646327476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (105480cf-7d13-488b-8538-5b334d648c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:54:18 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-1c31fec5-7a93-47db-a0eb-73c23ace515c tempest-CreateVolumesFromImageTest-646327476 None] Volume 139d220c-6a34-4f28-bf8d-9c7672f90ab5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-139d220c-6a34-4f28-bf8d-9c7672f90ab5', 'volume_size': 1}
Jun 15 15:54:18 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-1c31fec5-7a93-47db-a0eb-73c23ace515c tempest-CreateVolumesFromImageTest-646327476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:54:18 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d4a7736-f0b8-4939-80d7-27cdfc4b041c tempest-CreateVolumesFromImageTest-646327476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 15:54:19 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-9d4a7736-f0b8-4939-80d7-27cdfc4b041c tempest-CreateVolumesFromImageTest-646327476 None] Flow 'volume_create_manager' (50c36069-0fa0-4f3b-870e-27c3966960f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:54:19 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-9d4a7736-f0b8-4939-80d7-27cdfc4b041c tempest-CreateVolumesFromImageTest-646327476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0412f66-ec00-4993-92dc-217d706c5974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:54:19 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-9d4a7736-f0b8-4939-80d7-27cdfc4b041c tempest-CreateVolumesFromImageTest-646327476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0412f66-ec00-4993-92dc-217d706c5974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:54:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-467528993',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af824c61-4651-4a58-9fbb-b5a14ab825fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9bf548361814937a988d96233f09ce1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:54:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:54:19Z,use_quota=True,user_id='c0e6a4d72b2c488e80615b9aee1e78dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:54:19 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-9d4a7736-f0b8-4939-80d7-27cdfc4b041c tempest-CreateVolumesFromImageTest-646327476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e216c6f-5bd3-4895-9452-6c24614abf92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:54:19 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-9d4a7736-f0b8-4939-80d7-27cdfc4b041c tempest-CreateVolumesFromImageTest-646327476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e216c6f-5bd3-4895-9452-6c24614abf92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:54:19 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-9d4a7736-f0b8-4939-80d7-27cdfc4b041c tempest-CreateVolumesFromImageTest-646327476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8276c170-ee1b-4713-90f8-c044d5067562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:54:19 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-9d4a7736-f0b8-4939-80d7-27cdfc4b041c tempest-CreateVolumesFromImageTest-646327476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8276c170-ee1b-4713-90f8-c044d5067562) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af824c61-4651-4a58-9fbb-b5a14ab825fc', 'volume_name': 'volume-af824c61-4651-4a58-9fbb-b5a14ab825fc', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:54:19 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-9d4a7736-f0b8-4939-80d7-27cdfc4b041c tempest-CreateVolumesFromImageTest-646327476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4d4329b-f679-4851-8e0e-a2a9a0f15973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:54:19 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-9d4a7736-f0b8-4939-80d7-27cdfc4b041c tempest-CreateVolumesFromImageTest-646327476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4d4329b-f679-4851-8e0e-a2a9a0f15973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:54:19 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-9d4a7736-f0b8-4939-80d7-27cdfc4b041c tempest-CreateVolumesFromImageTest-646327476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83514f29-e26e-4798-a556-2505fa69105b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:54:19 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-9d4a7736-f0b8-4939-80d7-27cdfc4b041c tempest-CreateVolumesFromImageTest-646327476 None] Volume af824c61-4651-4a58-9fbb-b5a14ab825fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af824c61-4651-4a58-9fbb-b5a14ab825fc', 'volume_size': 1}
Jun 15 15:54:19 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-9d4a7736-f0b8-4939-80d7-27cdfc4b041c tempest-CreateVolumesFromImageTest-646327476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:54:19 devstack sudo[98581]: pam_unix(sudo:session): session closed for user root
Jun 15 15:54:19 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-4ba54477-00c9-43d0-8c60-7f9177e0cf72 tempest-CreateVolumesFromImageTest-646327476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-6e1e2cfe-9346-4142-8a35-38165e9ea954" returned: 0 in 1.163s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:54:19 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-4ba54477-00c9-43d0-8c60-7f9177e0cf72 tempest-CreateVolumesFromImageTest-646327476 None] <== create_volume: return (2697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 15:54:19 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-4ba54477-00c9-43d0-8c60-7f9177e0cf72 tempest-CreateVolumesFromImageTest-646327476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.700s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:54:19 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-35c7c91f-d4fe-4791-ac94-fc46c885518f tempest-CreateVolumesFromImageTest-646327476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.032s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:54:19 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-35c7c91f-d4fe-4791-ac94-fc46c885518f tempest-CreateVolumesFromImageTest-646327476 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:54:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-807736037',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d900c3e-0377-4d68-944b-07f8d5dfc116,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9bf548361814937a988d96233f09ce1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:54:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:54:17Z,use_quota=True,user_id='c0e6a4d72b2c488e80615b9aee1e78dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 15:54:19 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-35c7c91f-d4fe-4791-ac94-fc46c885518f tempest-CreateVolumesFromImageTest-646327476 None] Creating volume 2d900c3e-0377-4d68-944b-07f8d5dfc116 {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 15:54:19 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-35c7c91f-d4fe-4791-ac94-fc46c885518f tempest-CreateVolumesFromImageTest-646327476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:54:19 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-35c7c91f-d4fe-4791-ac94-fc46c885518f tempest-CreateVolumesFromImageTest-646327476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:54:19 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-35c7c91f-d4fe-4791-ac94-fc46c885518f tempest-CreateVolumesFromImageTest-646327476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:54:19 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-35c7c91f-d4fe-4791-ac94-fc46c885518f tempest-CreateVolumesFromImageTest-646327476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:54:19 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-35c7c91f-d4fe-4791-ac94-fc46c885518f tempest-CreateVolumesFromImageTest-646327476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:54:19 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-35c7c91f-d4fe-4791-ac94-fc46c885518f tempest-CreateVolumesFromImageTest-646327476 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 15:54:19 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-35c7c91f-d4fe-4791-ac94-fc46c885518f tempest-CreateVolumesFromImageTest-646327476 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 15:54:19 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-35c7c91f-d4fe-4791-ac94-fc46c885518f tempest-CreateVolumesFromImageTest-646327476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2d900c3e-0377-4d68-944b-07f8d5dfc116 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:54:19 devstack sudo[98637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2d900c3e-0377-4d68-944b-07f8d5dfc116 1073741824
Jun 15 15:54:19 devstack sudo[98637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:54:19 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-4ba54477-00c9-43d0-8c60-7f9177e0cf72 tempest-CreateVolumesFromImageTest-646327476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96e59fd1-a496-4569-8087-a3d90997f423) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e1e2cfe-9346-4142-8a35-38165e9ea954', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:54:19 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-4ba54477-00c9-43d0-8c60-7f9177e0cf72 tempest-CreateVolumesFromImageTest-646327476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3819794f-b30e-4cba-8445-ba6715371edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:54:19 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-4ba54477-00c9-43d0-8c60-7f9177e0cf72 tempest-CreateVolumesFromImageTest-646327476 None] Volume volume-6e1e2cfe-9346-4142-8a35-38165e9ea954 (6e1e2cfe-9346-4142-8a35-38165e9ea954): created successfully
Jun 15 15:54:19 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-4ba54477-00c9-43d0-8c60-7f9177e0cf72 tempest-CreateVolumesFromImageTest-646327476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3819794f-b30e-4cba-8445-ba6715371edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:54:19 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-4ba54477-00c9-43d0-8c60-7f9177e0cf72 tempest-CreateVolumesFromImageTest-646327476 None] Flow 'volume_create_manager' (ddf9a790-b411-4963-920a-c88bc0f09018) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:54:19 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-4ba54477-00c9-43d0-8c60-7f9177e0cf72 tempest-CreateVolumesFromImageTest-646327476 None] Created volume successfully.
Jun 15 15:54:20 devstack sudo[98637]: pam_unix(sudo:session): session closed for user root
Jun 15 15:54:20 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-35c7c91f-d4fe-4791-ac94-fc46c885518f tempest-CreateVolumesFromImageTest-646327476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2d900c3e-0377-4d68-944b-07f8d5dfc116 1073741824" returned: 0 in 1.286s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:54:20 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-35c7c91f-d4fe-4791-ac94-fc46c885518f tempest-CreateVolumesFromImageTest-646327476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2d900c3e-0377-4d68-944b-07f8d5dfc116 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:54:20 devstack sudo[98652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2d900c3e-0377-4d68-944b-07f8d5dfc116
Jun 15 15:54:20 devstack sudo[98652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:54:21 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-6eed0e46-77e9-4e92-b27b-6360c7a4cc85 tempest-AttachVolumeShelveTestJSON-1587912764 None] Acquiring lock "cinder-0d1ddc76-52a6-4f15-ab8d-e0cffbaf014e-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:54:21 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-6eed0e46-77e9-4e92-b27b-6360c7a4cc85 tempest-AttachVolumeShelveTestJSON-1587912764 None] Lock "cinder-0d1ddc76-52a6-4f15-ab8d-e0cffbaf014e-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:54:22 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-6eed0e46-77e9-4e92-b27b-6360c7a4cc85 tempest-AttachVolumeShelveTestJSON-1587912764 None] Acquiring lock "cinder-quobyte-0d1ddc76-52a6-4f15-ab8d-e0cffbaf014e" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:54:22 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-6eed0e46-77e9-4e92-b27b-6360c7a4cc85 tempest-AttachVolumeShelveTestJSON-1587912764 None] Lock "cinder-quobyte-0d1ddc76-52a6-4f15-ab8d-e0cffbaf014e" acquired by "delete_volume" :: waited 0.053s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:54:22 devstack sudo[98652]: pam_unix(sudo:session): session closed for user root
Jun 15 15:54:22 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-35c7c91f-d4fe-4791-ac94-fc46c885518f tempest-CreateVolumesFromImageTest-646327476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2d900c3e-0377-4d68-944b-07f8d5dfc116" returned: 0 in 1.165s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:54:22 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-35c7c91f-d4fe-4791-ac94-fc46c885518f tempest-CreateVolumesFromImageTest-646327476 None] <== create_volume: return (2501ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 15:54:22 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-35c7c91f-d4fe-4791-ac94-fc46c885518f tempest-CreateVolumesFromImageTest-646327476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.505s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:54:22 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-3f0fd7c0-864f-461e-8ff7-c08bd88d12b6 tempest-CreateVolumesFromImageTest-646327476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.909s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:54:22 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-3f0fd7c0-864f-461e-8ff7-c08bd88d12b6 tempest-CreateVolumesFromImageTest-646327476 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:54:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1787614306',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14426d40-900b-4680-8964-76a66e441e57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9bf548361814937a988d96233f09ce1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:54:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:54:18Z,use_quota=True,user_id='c0e6a4d72b2c488e80615b9aee1e78dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 15:54:22 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-3f0fd7c0-864f-461e-8ff7-c08bd88d12b6 tempest-CreateVolumesFromImageTest-646327476 None] Creating volume 14426d40-900b-4680-8964-76a66e441e57 {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 15:54:22 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-3f0fd7c0-864f-461e-8ff7-c08bd88d12b6 tempest-CreateVolumesFromImageTest-646327476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:54:22 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-3f0fd7c0-864f-461e-8ff7-c08bd88d12b6 tempest-CreateVolumesFromImageTest-646327476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:54:22 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-3f0fd7c0-864f-461e-8ff7-c08bd88d12b6 tempest-CreateVolumesFromImageTest-646327476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:54:22 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-3f0fd7c0-864f-461e-8ff7-c08bd88d12b6 tempest-CreateVolumesFromImageTest-646327476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:54:22 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-3f0fd7c0-864f-461e-8ff7-c08bd88d12b6 tempest-CreateVolumesFromImageTest-646327476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:54:22 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-3f0fd7c0-864f-461e-8ff7-c08bd88d12b6 tempest-CreateVolumesFromImageTest-646327476 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 15:54:22 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-3f0fd7c0-864f-461e-8ff7-c08bd88d12b6 tempest-CreateVolumesFromImageTest-646327476 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 15:54:22 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3f0fd7c0-864f-461e-8ff7-c08bd88d12b6 tempest-CreateVolumesFromImageTest-646327476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-14426d40-900b-4680-8964-76a66e441e57 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:54:22 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae7ed975-fa46-4e36-a90d-4dd26952f764]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:54:22 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6eed0e46-77e9-4e92-b27b-6360c7a4cc85 tempest-AttachVolumeShelveTestJSON-1587912764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-0d1ddc76-52a6-4f15-ab8d-e0cffbaf014e {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:54:22 devstack sudo[98655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-14426d40-900b-4680-8964-76a66e441e57 1073741824
Jun 15 15:54:22 devstack sudo[98655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:54:22 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-35c7c91f-d4fe-4791-ac94-fc46c885518f tempest-CreateVolumesFromImageTest-646327476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f2e7285-ba1c-4abb-bcf0-c3504b365005) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d900c3e-0377-4d68-944b-07f8d5dfc116', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:54:22 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-35c7c91f-d4fe-4791-ac94-fc46c885518f tempest-CreateVolumesFromImageTest-646327476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9009cef0-b495-48cd-8272-69bbc6617178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:54:22 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-35c7c91f-d4fe-4791-ac94-fc46c885518f tempest-CreateVolumesFromImageTest-646327476 None] Volume volume-2d900c3e-0377-4d68-944b-07f8d5dfc116 (2d900c3e-0377-4d68-944b-07f8d5dfc116): created successfully
Jun 15 15:54:22 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-35c7c91f-d4fe-4791-ac94-fc46c885518f tempest-CreateVolumesFromImageTest-646327476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9009cef0-b495-48cd-8272-69bbc6617178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:54:22 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-35c7c91f-d4fe-4791-ac94-fc46c885518f tempest-CreateVolumesFromImageTest-646327476 None] Flow 'volume_create_manager' (3a404ceb-1ea4-417b-abc3-3b8a02933413) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:54:22 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-35c7c91f-d4fe-4791-ac94-fc46c885518f tempest-CreateVolumesFromImageTest-646327476 None] Created volume successfully.
Jun 15 15:54:22 devstack sudo[98656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-0d1ddc76-52a6-4f15-ab8d-e0cffbaf014e
Jun 15 15:54:22 devstack sudo[98656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:54:22 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e27ddc6-437d-48d5-ab94-774edbc79807 tempest-ServersNegativeTestJSON-182957050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 15:54:22 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5e27ddc6-437d-48d5-ab94-774edbc79807 tempest-ServersNegativeTestJSON-182957050 None] Flow 'volume_create_manager' (14f29a9a-476d-476a-a7e4-07c755650c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:54:22 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5e27ddc6-437d-48d5-ab94-774edbc79807 tempest-ServersNegativeTestJSON-182957050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (605ffdd1-e3a3-4250-98b4-2ccb479bbced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:54:22 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5e27ddc6-437d-48d5-ab94-774edbc79807 tempest-ServersNegativeTestJSON-182957050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (605ffdd1-e3a3-4250-98b4-2ccb479bbced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:54:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-690034942',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32da1963-3d59-437f-a513-5789abd39d07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6173d183aa94430b83e22b26e80f0d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:54:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:54:23Z,use_quota=True,user_id='88d2bfb328ea4b819e66539949236263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:54:22 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5e27ddc6-437d-48d5-ab94-774edbc79807 tempest-ServersNegativeTestJSON-182957050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a3fd5bc-d26e-4702-ac13-8acbbd9a0d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:54:22 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5e27ddc6-437d-48d5-ab94-774edbc79807 tempest-ServersNegativeTestJSON-182957050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a3fd5bc-d26e-4702-ac13-8acbbd9a0d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:54:23 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5e27ddc6-437d-48d5-ab94-774edbc79807 tempest-ServersNegativeTestJSON-182957050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c80fc8fe-ed19-4114-bc11-7aac20b0278c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:54:23 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5e27ddc6-437d-48d5-ab94-774edbc79807 tempest-ServersNegativeTestJSON-182957050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c80fc8fe-ed19-4114-bc11-7aac20b0278c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32da1963-3d59-437f-a513-5789abd39d07', 'volume_name': 'volume-32da1963-3d59-437f-a513-5789abd39d07', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:54:23 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5e27ddc6-437d-48d5-ab94-774edbc79807 tempest-ServersNegativeTestJSON-182957050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4aaa456f-4000-4a3f-8e73-810df6975131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:54:23 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5e27ddc6-437d-48d5-ab94-774edbc79807 tempest-ServersNegativeTestJSON-182957050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4aaa456f-4000-4a3f-8e73-810df6975131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:54:23 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5e27ddc6-437d-48d5-ab94-774edbc79807 tempest-ServersNegativeTestJSON-182957050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d2a7f0e-7d3a-4ced-b563-91f2f51fee23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:54:23 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-5e27ddc6-437d-48d5-ab94-774edbc79807 tempest-ServersNegativeTestJSON-182957050 None] Volume 32da1963-3d59-437f-a513-5789abd39d07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32da1963-3d59-437f-a513-5789abd39d07', 'volume_size': 1}
Jun 15 15:54:23 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-5e27ddc6-437d-48d5-ab94-774edbc79807 tempest-ServersNegativeTestJSON-182957050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:54:23 devstack sudo[98655]: pam_unix(sudo:session): session closed for user root
Jun 15 15:54:23 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3f0fd7c0-864f-461e-8ff7-c08bd88d12b6 tempest-CreateVolumesFromImageTest-646327476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-14426d40-900b-4680-8964-76a66e441e57 1073741824" returned: 0 in 1.279s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:54:23 devstack sudo[98656]: pam_unix(sudo:session): session closed for user root
Jun 15 15:54:23 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6eed0e46-77e9-4e92-b27b-6360c7a4cc85 tempest-AttachVolumeShelveTestJSON-1587912764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-0d1ddc76-52a6-4f15-ab8d-e0cffbaf014e" returned: 0 in 1.281s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:54:23 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6eed0e46-77e9-4e92-b27b-6360c7a4cc85 tempest-AttachVolumeShelveTestJSON-1587912764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-0d1ddc76-52a6-4f15-ab8d-e0cffbaf014e {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:54:23 devstack sudo[98672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-0d1ddc76-52a6-4f15-ab8d-e0cffbaf014e
Jun 15 15:54:23 devstack sudo[98672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:54:23 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3f0fd7c0-864f-461e-8ff7-c08bd88d12b6 tempest-CreateVolumesFromImageTest-646327476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-14426d40-900b-4680-8964-76a66e441e57 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:54:23 devstack sudo[98674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-14426d40-900b-4680-8964-76a66e441e57
Jun 15 15:54:23 devstack sudo[98674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:54:24 devstack sudo[98672]: pam_unix(sudo:session): session closed for user root
Jun 15 15:54:24 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6eed0e46-77e9-4e92-b27b-6360c7a4cc85 tempest-AttachVolumeShelveTestJSON-1587912764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-0d1ddc76-52a6-4f15-ab8d-e0cffbaf014e" returned: 0 in 0.749s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:54:24 devstack sudo[98674]: pam_unix(sudo:session): session closed for user root
Jun 15 15:54:24 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-6eed0e46-77e9-4e92-b27b-6360c7a4cc85 tempest-AttachVolumeShelveTestJSON-1587912764 None] Lock "cinder-quobyte-0d1ddc76-52a6-4f15-ab8d-e0cffbaf014e" released by "delete_volume" :: held 2.128s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:54:24 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3f0fd7c0-864f-461e-8ff7-c08bd88d12b6 tempest-CreateVolumesFromImageTest-646327476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-14426d40-900b-4680-8964-76a66e441e57" returned: 0 in 0.702s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:54:24 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-3f0fd7c0-864f-461e-8ff7-c08bd88d12b6 tempest-CreateVolumesFromImageTest-646327476 None] <== create_volume: return (2094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 15:54:24 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-3f0fd7c0-864f-461e-8ff7-c08bd88d12b6 tempest-CreateVolumesFromImageTest-646327476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.097s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:54:24 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-1c31fec5-7a93-47db-a0eb-73c23ace515c tempest-CreateVolumesFromImageTest-646327476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.455s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:54:24 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-1c31fec5-7a93-47db-a0eb-73c23ace515c tempest-CreateVolumesFromImageTest-646327476 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:54:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-369217344',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=139d220c-6a34-4f28-bf8d-9c7672f90ab5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9bf548361814937a988d96233f09ce1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:54:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:54:19Z,use_quota=True,user_id='c0e6a4d72b2c488e80615b9aee1e78dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 15:54:24 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-1c31fec5-7a93-47db-a0eb-73c23ace515c tempest-CreateVolumesFromImageTest-646327476 None] Creating volume 139d220c-6a34-4f28-bf8d-9c7672f90ab5 {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 15:54:24 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-1c31fec5-7a93-47db-a0eb-73c23ace515c tempest-CreateVolumesFromImageTest-646327476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:54:24 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-1c31fec5-7a93-47db-a0eb-73c23ace515c tempest-CreateVolumesFromImageTest-646327476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:54:24 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-1c31fec5-7a93-47db-a0eb-73c23ace515c tempest-CreateVolumesFromImageTest-646327476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:54:24 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-1c31fec5-7a93-47db-a0eb-73c23ace515c tempest-CreateVolumesFromImageTest-646327476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:54:24 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-1c31fec5-7a93-47db-a0eb-73c23ace515c tempest-CreateVolumesFromImageTest-646327476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:54:24 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-1c31fec5-7a93-47db-a0eb-73c23ace515c tempest-CreateVolumesFromImageTest-646327476 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 15:54:24 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-1c31fec5-7a93-47db-a0eb-73c23ace515c tempest-CreateVolumesFromImageTest-646327476 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 15:54:24 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-1c31fec5-7a93-47db-a0eb-73c23ace515c tempest-CreateVolumesFromImageTest-646327476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-139d220c-6a34-4f28-bf8d-9c7672f90ab5 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:54:24 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-3f0fd7c0-864f-461e-8ff7-c08bd88d12b6 tempest-CreateVolumesFromImageTest-646327476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (feefce48-bb6c-48f7-9206-45af344c9948) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14426d40-900b-4680-8964-76a66e441e57', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:54:24 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-3f0fd7c0-864f-461e-8ff7-c08bd88d12b6 tempest-CreateVolumesFromImageTest-646327476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (384ac2c2-93f5-4c9c-8b24-f3783ed023fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:54:24 devstack sudo[98679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-139d220c-6a34-4f28-bf8d-9c7672f90ab5 1073741824
Jun 15 15:54:24 devstack sudo[98679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:54:24 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-3f0fd7c0-864f-461e-8ff7-c08bd88d12b6 tempest-CreateVolumesFromImageTest-646327476 None] Volume volume-14426d40-900b-4680-8964-76a66e441e57 (14426d40-900b-4680-8964-76a66e441e57): created successfully
Jun 15 15:54:24 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-3f0fd7c0-864f-461e-8ff7-c08bd88d12b6 tempest-CreateVolumesFromImageTest-646327476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (384ac2c2-93f5-4c9c-8b24-f3783ed023fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:54:24 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-3f0fd7c0-864f-461e-8ff7-c08bd88d12b6 tempest-CreateVolumesFromImageTest-646327476 None] Flow 'volume_create_manager' (772cf24c-e42d-4f1e-b948-42fec9b3c86b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:54:24 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-3f0fd7c0-864f-461e-8ff7-c08bd88d12b6 tempest-CreateVolumesFromImageTest-646327476 None] Created volume successfully.
Jun 15 15:54:24 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-6eed0e46-77e9-4e92-b27b-6360c7a4cc85 tempest-AttachVolumeShelveTestJSON-1587912764 None] Created reservations ['05350bc0-af05-4e75-a5d7-2f105127b7b9', 'a3f2071d-b1a7-4ed3-9882-310701bbcaf4', 'adc92977-4936-424a-89c7-d64c343aa59b', 'a570eae3-52c5-4768-b458-3b2511731d8b'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:54:24 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6eed0e46-77e9-4e92-b27b-6360c7a4cc85 tempest-AttachVolumeShelveTestJSON-1587912764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:54:24 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6eed0e46-77e9-4e92-b27b-6360c7a4cc85 tempest-AttachVolumeShelveTestJSON-1587912764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:54:24 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6eed0e46-77e9-4e92-b27b-6360c7a4cc85 tempest-AttachVolumeShelveTestJSON-1587912764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:54:24 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6eed0e46-77e9-4e92-b27b-6360c7a4cc85 tempest-AttachVolumeShelveTestJSON-1587912764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:54:24 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6eed0e46-77e9-4e92-b27b-6360c7a4cc85 tempest-AttachVolumeShelveTestJSON-1587912764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:54:24 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6eed0e46-77e9-4e92-b27b-6360c7a4cc85 tempest-AttachVolumeShelveTestJSON-1587912764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:54:24 devstack sudo[98681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:54:24 devstack sudo[98681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:54:25 devstack sudo[98681]: pam_unix(sudo:session): session closed for user root
Jun 15 15:54:25 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6eed0e46-77e9-4e92-b27b-6360c7a4cc85 tempest-AttachVolumeShelveTestJSON-1587912764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.812s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:54:25 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-6eed0e46-77e9-4e92-b27b-6360c7a4cc85 tempest-AttachVolumeShelveTestJSON-1587912764 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:54:25 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-6eed0e46-77e9-4e92-b27b-6360c7a4cc85 tempest-AttachVolumeShelveTestJSON-1587912764 None] Deleted volume successfully.
Jun 15 15:54:25 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-6eed0e46-77e9-4e92-b27b-6360c7a4cc85 tempest-AttachVolumeShelveTestJSON-1587912764 None] Lock "cinder-0d1ddc76-52a6-4f15-ab8d-e0cffbaf014e-delete_volume" released by "delete_volume" :: held 3.365s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:54:25 devstack sudo[98679]: pam_unix(sudo:session): session closed for user root
Jun 15 15:54:25 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-1c31fec5-7a93-47db-a0eb-73c23ace515c tempest-CreateVolumesFromImageTest-646327476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-139d220c-6a34-4f28-bf8d-9c7672f90ab5 1073741824" returned: 0 in 1.107s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:54:25 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-1c31fec5-7a93-47db-a0eb-73c23ace515c tempest-CreateVolumesFromImageTest-646327476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-139d220c-6a34-4f28-bf8d-9c7672f90ab5 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:54:25 devstack sudo[98689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-139d220c-6a34-4f28-bf8d-9c7672f90ab5
Jun 15 15:54:25 devstack sudo[98689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:54:25 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-5ccb605c-407d-424d-96e7-ec044ac43770 tempest-AttachVolumeShelveTestJSON-1587912764 None] Acquiring lock "cinder-46b7eea4-131a-47a1-a9d9-ec414da9ee27-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:54:25 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-5ccb605c-407d-424d-96e7-ec044ac43770 tempest-AttachVolumeShelveTestJSON-1587912764 None] Lock "cinder-46b7eea4-131a-47a1-a9d9-ec414da9ee27-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:54:25 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-5ccb605c-407d-424d-96e7-ec044ac43770 tempest-AttachVolumeShelveTestJSON-1587912764 None] Acquiring lock "cinder-quobyte-46b7eea4-131a-47a1-a9d9-ec414da9ee27" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:54:25 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-5ccb605c-407d-424d-96e7-ec044ac43770 tempest-AttachVolumeShelveTestJSON-1587912764 None] Lock "cinder-quobyte-46b7eea4-131a-47a1-a9d9-ec414da9ee27" acquired by "delete_volume" :: waited 0.017s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:54:25 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b339b32-a696-4f8c-8100-5f529f6342f1]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:54:25 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5ccb605c-407d-424d-96e7-ec044ac43770 tempest-AttachVolumeShelveTestJSON-1587912764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-46b7eea4-131a-47a1-a9d9-ec414da9ee27 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:54:25 devstack sudo[98692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-46b7eea4-131a-47a1-a9d9-ec414da9ee27
Jun 15 15:54:25 devstack sudo[98692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:54:26 devstack sudo[98689]: pam_unix(sudo:session): session closed for user root
Jun 15 15:54:26 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-1c31fec5-7a93-47db-a0eb-73c23ace515c tempest-CreateVolumesFromImageTest-646327476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-139d220c-6a34-4f28-bf8d-9c7672f90ab5" returned: 0 in 0.730s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:54:26 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-1c31fec5-7a93-47db-a0eb-73c23ace515c tempest-CreateVolumesFromImageTest-646327476 None] <== create_volume: return (1893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 15:54:26 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-1c31fec5-7a93-47db-a0eb-73c23ace515c tempest-CreateVolumesFromImageTest-646327476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.896s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:54:26 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-9d4a7736-f0b8-4939-80d7-27cdfc4b041c tempest-CreateVolumesFromImageTest-646327476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.857s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:54:26 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-9d4a7736-f0b8-4939-80d7-27cdfc4b041c tempest-CreateVolumesFromImageTest-646327476 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:54:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-467528993',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af824c61-4651-4a58-9fbb-b5a14ab825fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9bf548361814937a988d96233f09ce1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:54:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:54:19Z,use_quota=True,user_id='c0e6a4d72b2c488e80615b9aee1e78dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 15:54:26 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-9d4a7736-f0b8-4939-80d7-27cdfc4b041c tempest-CreateVolumesFromImageTest-646327476 None] Creating volume af824c61-4651-4a58-9fbb-b5a14ab825fc {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 15:54:26 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-9d4a7736-f0b8-4939-80d7-27cdfc4b041c tempest-CreateVolumesFromImageTest-646327476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:54:26 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-9d4a7736-f0b8-4939-80d7-27cdfc4b041c tempest-CreateVolumesFromImageTest-646327476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:54:26 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-9d4a7736-f0b8-4939-80d7-27cdfc4b041c tempest-CreateVolumesFromImageTest-646327476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:54:26 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-9d4a7736-f0b8-4939-80d7-27cdfc4b041c tempest-CreateVolumesFromImageTest-646327476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:54:26 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-9d4a7736-f0b8-4939-80d7-27cdfc4b041c tempest-CreateVolumesFromImageTest-646327476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:54:26 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-9d4a7736-f0b8-4939-80d7-27cdfc4b041c tempest-CreateVolumesFromImageTest-646327476 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 15:54:26 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-9d4a7736-f0b8-4939-80d7-27cdfc4b041c tempest-CreateVolumesFromImageTest-646327476 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 15:54:26 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-9d4a7736-f0b8-4939-80d7-27cdfc4b041c tempest-CreateVolumesFromImageTest-646327476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-af824c61-4651-4a58-9fbb-b5a14ab825fc 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:54:26 devstack sudo[98695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-af824c61-4651-4a58-9fbb-b5a14ab825fc 1073741824
Jun 15 15:54:26 devstack sudo[98695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:54:26 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-1c31fec5-7a93-47db-a0eb-73c23ace515c tempest-CreateVolumesFromImageTest-646327476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (105480cf-7d13-488b-8538-5b334d648c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-139d220c-6a34-4f28-bf8d-9c7672f90ab5', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:54:26 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-1c31fec5-7a93-47db-a0eb-73c23ace515c tempest-CreateVolumesFromImageTest-646327476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7b75796-b598-41d2-b1cb-ad1a2233cb94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:54:26 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-1c31fec5-7a93-47db-a0eb-73c23ace515c tempest-CreateVolumesFromImageTest-646327476 None] Volume volume-139d220c-6a34-4f28-bf8d-9c7672f90ab5 (139d220c-6a34-4f28-bf8d-9c7672f90ab5): created successfully
Jun 15 15:54:26 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-1c31fec5-7a93-47db-a0eb-73c23ace515c tempest-CreateVolumesFromImageTest-646327476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7b75796-b598-41d2-b1cb-ad1a2233cb94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:54:26 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-1c31fec5-7a93-47db-a0eb-73c23ace515c tempest-CreateVolumesFromImageTest-646327476 None] Flow 'volume_create_manager' (81f7bd12-4895-4629-b1be-f46228250a4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:54:26 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-1c31fec5-7a93-47db-a0eb-73c23ace515c tempest-CreateVolumesFromImageTest-646327476 None] Created volume successfully.
Jun 15 15:54:26 devstack sudo[98692]: pam_unix(sudo:session): session closed for user root
Jun 15 15:54:26 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5ccb605c-407d-424d-96e7-ec044ac43770 tempest-AttachVolumeShelveTestJSON-1587912764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-46b7eea4-131a-47a1-a9d9-ec414da9ee27" returned: 0 in 0.895s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:54:26 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5ccb605c-407d-424d-96e7-ec044ac43770 tempest-AttachVolumeShelveTestJSON-1587912764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-46b7eea4-131a-47a1-a9d9-ec414da9ee27 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:54:26 devstack sudo[98700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-46b7eea4-131a-47a1-a9d9-ec414da9ee27
Jun 15 15:54:26 devstack sudo[98700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:54:27 devstack sudo[98695]: pam_unix(sudo:session): session closed for user root
Jun 15 15:54:27 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-9d4a7736-f0b8-4939-80d7-27cdfc4b041c tempest-CreateVolumesFromImageTest-646327476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-af824c61-4651-4a58-9fbb-b5a14ab825fc 1073741824" returned: 0 in 0.959s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:54:27 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-9d4a7736-f0b8-4939-80d7-27cdfc4b041c tempest-CreateVolumesFromImageTest-646327476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-af824c61-4651-4a58-9fbb-b5a14ab825fc {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:54:27 devstack sudo[98707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-af824c61-4651-4a58-9fbb-b5a14ab825fc
Jun 15 15:54:27 devstack sudo[98707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:54:27 devstack sudo[98700]: pam_unix(sudo:session): session closed for user root
Jun 15 15:54:27 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5ccb605c-407d-424d-96e7-ec044ac43770 tempest-AttachVolumeShelveTestJSON-1587912764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-46b7eea4-131a-47a1-a9d9-ec414da9ee27" returned: 0 in 0.689s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:54:27 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-5ccb605c-407d-424d-96e7-ec044ac43770 tempest-AttachVolumeShelveTestJSON-1587912764 None] Lock "cinder-quobyte-46b7eea4-131a-47a1-a9d9-ec414da9ee27" released by "delete_volume" :: held 1.639s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:54:27 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-5ccb605c-407d-424d-96e7-ec044ac43770 tempest-AttachVolumeShelveTestJSON-1587912764 None] Created reservations ['f3e5dab5-187c-4b7b-a477-c49d52b70326', '7b247d7d-dc0b-45df-abf5-92984439f329', '4bbd2790-2ac8-40de-8342-53464897e6b0', 'e2f98b8c-ab43-46de-8d23-524b04d17047'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:54:27 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-5ccb605c-407d-424d-96e7-ec044ac43770 tempest-AttachVolumeShelveTestJSON-1587912764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:54:27 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-5ccb605c-407d-424d-96e7-ec044ac43770 tempest-AttachVolumeShelveTestJSON-1587912764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:54:27 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-5ccb605c-407d-424d-96e7-ec044ac43770 tempest-AttachVolumeShelveTestJSON-1587912764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:54:27 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-5ccb605c-407d-424d-96e7-ec044ac43770 tempest-AttachVolumeShelveTestJSON-1587912764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:54:27 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-5ccb605c-407d-424d-96e7-ec044ac43770 tempest-AttachVolumeShelveTestJSON-1587912764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:54:27 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5ccb605c-407d-424d-96e7-ec044ac43770 tempest-AttachVolumeShelveTestJSON-1587912764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:54:27 devstack sudo[98709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:54:27 devstack sudo[98709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:54:27 devstack sudo[98707]: pam_unix(sudo:session): session closed for user root
Jun 15 15:54:27 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-9d4a7736-f0b8-4939-80d7-27cdfc4b041c tempest-CreateVolumesFromImageTest-646327476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-af824c61-4651-4a58-9fbb-b5a14ab825fc" returned: 0 in 0.709s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:54:27 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-9d4a7736-f0b8-4939-80d7-27cdfc4b041c tempest-CreateVolumesFromImageTest-646327476 None] <== create_volume: return (1716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 15:54:27 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-9d4a7736-f0b8-4939-80d7-27cdfc4b041c tempest-CreateVolumesFromImageTest-646327476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.720s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:54:27 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-5e27ddc6-437d-48d5-ab94-774edbc79807 tempest-ServersNegativeTestJSON-182957050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.814s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:54:27 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-5e27ddc6-437d-48d5-ab94-774edbc79807 tempest-ServersNegativeTestJSON-182957050 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:54:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-690034942',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32da1963-3d59-437f-a513-5789abd39d07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6173d183aa94430b83e22b26e80f0d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:54:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:54:23Z,use_quota=True,user_id='88d2bfb328ea4b819e66539949236263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 15:54:27 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-5e27ddc6-437d-48d5-ab94-774edbc79807 tempest-ServersNegativeTestJSON-182957050 None] Creating volume 32da1963-3d59-437f-a513-5789abd39d07 {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 15:54:27 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-5e27ddc6-437d-48d5-ab94-774edbc79807 tempest-ServersNegativeTestJSON-182957050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:54:27 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-5e27ddc6-437d-48d5-ab94-774edbc79807 tempest-ServersNegativeTestJSON-182957050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:54:27 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-5e27ddc6-437d-48d5-ab94-774edbc79807 tempest-ServersNegativeTestJSON-182957050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:54:27 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-5e27ddc6-437d-48d5-ab94-774edbc79807 tempest-ServersNegativeTestJSON-182957050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:54:27 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-5e27ddc6-437d-48d5-ab94-774edbc79807 tempest-ServersNegativeTestJSON-182957050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:54:27 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-5e27ddc6-437d-48d5-ab94-774edbc79807 tempest-ServersNegativeTestJSON-182957050 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 15:54:27 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-5e27ddc6-437d-48d5-ab94-774edbc79807 tempest-ServersNegativeTestJSON-182957050 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 15:54:27 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5e27ddc6-437d-48d5-ab94-774edbc79807 tempest-ServersNegativeTestJSON-182957050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-32da1963-3d59-437f-a513-5789abd39d07 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:54:27 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-9d4a7736-f0b8-4939-80d7-27cdfc4b041c tempest-CreateVolumesFromImageTest-646327476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83514f29-e26e-4798-a556-2505fa69105b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af824c61-4651-4a58-9fbb-b5a14ab825fc', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:54:27 devstack sudo[98712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-32da1963-3d59-437f-a513-5789abd39d07 1073741824
Jun 15 15:54:27 devstack sudo[98712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:54:27 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-9d4a7736-f0b8-4939-80d7-27cdfc4b041c tempest-CreateVolumesFromImageTest-646327476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32cb58aa-de74-499b-8543-a5ed34c5e910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:54:27 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-9d4a7736-f0b8-4939-80d7-27cdfc4b041c tempest-CreateVolumesFromImageTest-646327476 None] Volume volume-af824c61-4651-4a58-9fbb-b5a14ab825fc (af824c61-4651-4a58-9fbb-b5a14ab825fc): created successfully
Jun 15 15:54:27 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-9d4a7736-f0b8-4939-80d7-27cdfc4b041c tempest-CreateVolumesFromImageTest-646327476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32cb58aa-de74-499b-8543-a5ed34c5e910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:54:27 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-9d4a7736-f0b8-4939-80d7-27cdfc4b041c tempest-CreateVolumesFromImageTest-646327476 None] Flow 'volume_create_manager' (50c36069-0fa0-4f3b-870e-27c3966960f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:54:27 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-9d4a7736-f0b8-4939-80d7-27cdfc4b041c tempest-CreateVolumesFromImageTest-646327476 None] Created volume successfully.
Jun 15 15:54:28 devstack sudo[98709]: pam_unix(sudo:session): session closed for user root
Jun 15 15:54:28 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5ccb605c-407d-424d-96e7-ec044ac43770 tempest-AttachVolumeShelveTestJSON-1587912764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.703s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:54:28 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-5ccb605c-407d-424d-96e7-ec044ac43770 tempest-AttachVolumeShelveTestJSON-1587912764 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:54:28 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-5ccb605c-407d-424d-96e7-ec044ac43770 tempest-AttachVolumeShelveTestJSON-1587912764 None] Deleted volume successfully.
Jun 15 15:54:28 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-5ccb605c-407d-424d-96e7-ec044ac43770 tempest-AttachVolumeShelveTestJSON-1587912764 None] Lock "cinder-46b7eea4-131a-47a1-a9d9-ec414da9ee27-delete_volume" released by "delete_volume" :: held 2.646s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:54:28 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-d381074f-6c76-4643-b67f-778c1fd8d315 tempest-CreateVolumesFromImageTest-646327476 None] Acquiring lock "cinder-af824c61-4651-4a58-9fbb-b5a14ab825fc-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:54:28 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-d381074f-6c76-4643-b67f-778c1fd8d315 tempest-CreateVolumesFromImageTest-646327476 None] Lock "cinder-af824c61-4651-4a58-9fbb-b5a14ab825fc-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:54:28 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-d381074f-6c76-4643-b67f-778c1fd8d315 tempest-CreateVolumesFromImageTest-646327476 None] Acquiring lock "cinder-quobyte-af824c61-4651-4a58-9fbb-b5a14ab825fc" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:54:28 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-d381074f-6c76-4643-b67f-778c1fd8d315 tempest-CreateVolumesFromImageTest-646327476 None] Lock "cinder-quobyte-af824c61-4651-4a58-9fbb-b5a14ab825fc" acquired by "delete_volume" :: waited 0.024s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:54:28 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3987fadc-dad7-4193-b107-1963123352e4]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:54:28 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-d381074f-6c76-4643-b67f-778c1fd8d315 tempest-CreateVolumesFromImageTest-646327476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-af824c61-4651-4a58-9fbb-b5a14ab825fc {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:54:28 devstack sudo[98718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-af824c61-4651-4a58-9fbb-b5a14ab825fc
Jun 15 15:54:28 devstack sudo[98718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:54:28 devstack sudo[98712]: pam_unix(sudo:session): session closed for user root
Jun 15 15:54:28 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5e27ddc6-437d-48d5-ab94-774edbc79807 tempest-ServersNegativeTestJSON-182957050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-32da1963-3d59-437f-a513-5789abd39d07 1073741824" returned: 0 in 1.102s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:54:29 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5e27ddc6-437d-48d5-ab94-774edbc79807 tempest-ServersNegativeTestJSON-182957050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-32da1963-3d59-437f-a513-5789abd39d07 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:54:29 devstack sudo[98721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-32da1963-3d59-437f-a513-5789abd39d07
Jun 15 15:54:29 devstack sudo[98721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:54:29 devstack sudo[98718]: pam_unix(sudo:session): session closed for user root
Jun 15 15:54:29 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-d381074f-6c76-4643-b67f-778c1fd8d315 tempest-CreateVolumesFromImageTest-646327476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-af824c61-4651-4a58-9fbb-b5a14ab825fc" returned: 0 in 1.251s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:54:29 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-d381074f-6c76-4643-b67f-778c1fd8d315 tempest-CreateVolumesFromImageTest-646327476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-af824c61-4651-4a58-9fbb-b5a14ab825fc {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:54:29 devstack sudo[98762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-af824c61-4651-4a58-9fbb-b5a14ab825fc
Jun 15 15:54:29 devstack sudo[98762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:54:30 devstack sudo[98721]: pam_unix(sudo:session): session closed for user root
Jun 15 15:54:30 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5e27ddc6-437d-48d5-ab94-774edbc79807 tempest-ServersNegativeTestJSON-182957050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-32da1963-3d59-437f-a513-5789abd39d07" returned: 0 in 1.065s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:54:30 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-5e27ddc6-437d-48d5-ab94-774edbc79807 tempest-ServersNegativeTestJSON-182957050 None] <== create_volume: return (2225ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 15:54:30 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-5e27ddc6-437d-48d5-ab94-774edbc79807 tempest-ServersNegativeTestJSON-182957050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.228s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:54:30 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5e27ddc6-437d-48d5-ab94-774edbc79807 tempest-ServersNegativeTestJSON-182957050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d2a7f0e-7d3a-4ced-b563-91f2f51fee23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32da1963-3d59-437f-a513-5789abd39d07', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:54:30 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5e27ddc6-437d-48d5-ab94-774edbc79807 tempest-ServersNegativeTestJSON-182957050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76844612-c67a-4406-956f-1e94dc3138c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:54:30 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-5e27ddc6-437d-48d5-ab94-774edbc79807 tempest-ServersNegativeTestJSON-182957050 None] Volume volume-32da1963-3d59-437f-a513-5789abd39d07 (32da1963-3d59-437f-a513-5789abd39d07): created successfully
Jun 15 15:54:30 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5e27ddc6-437d-48d5-ab94-774edbc79807 tempest-ServersNegativeTestJSON-182957050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76844612-c67a-4406-956f-1e94dc3138c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:54:30 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5e27ddc6-437d-48d5-ab94-774edbc79807 tempest-ServersNegativeTestJSON-182957050 None] Flow 'volume_create_manager' (14f29a9a-476d-476a-a7e4-07c755650c18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:54:30 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-5e27ddc6-437d-48d5-ab94-774edbc79807 tempest-ServersNegativeTestJSON-182957050 None] Created volume successfully.
Jun 15 15:54:30 devstack sudo[98762]: pam_unix(sudo:session): session closed for user root
Jun 15 15:54:30 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-d381074f-6c76-4643-b67f-778c1fd8d315 tempest-CreateVolumesFromImageTest-646327476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-af824c61-4651-4a58-9fbb-b5a14ab825fc" returned: 0 in 0.986s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:54:30 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-d381074f-6c76-4643-b67f-778c1fd8d315 tempest-CreateVolumesFromImageTest-646327476 None] Lock "cinder-quobyte-af824c61-4651-4a58-9fbb-b5a14ab825fc" released by "delete_volume" :: held 2.287s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:54:30 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-d381074f-6c76-4643-b67f-778c1fd8d315 tempest-CreateVolumesFromImageTest-646327476 None] Created reservations ['e52fbc1d-d0a8-467d-b763-442832c1b49a', 'fb6b42de-8d23-4bf4-9bd4-686ddea74540', '4ebf37cd-9506-4a45-9cd9-efe73ada9c4d', 'da7b8a5d-9a63-4ffa-8274-7e1faa7af54f'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:54:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-d381074f-6c76-4643-b67f-778c1fd8d315 tempest-CreateVolumesFromImageTest-646327476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:54:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-d381074f-6c76-4643-b67f-778c1fd8d315 tempest-CreateVolumesFromImageTest-646327476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:54:31 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-d381074f-6c76-4643-b67f-778c1fd8d315 tempest-CreateVolumesFromImageTest-646327476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:54:31 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-d381074f-6c76-4643-b67f-778c1fd8d315 tempest-CreateVolumesFromImageTest-646327476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:54:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-d381074f-6c76-4643-b67f-778c1fd8d315 tempest-CreateVolumesFromImageTest-646327476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:54:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-d381074f-6c76-4643-b67f-778c1fd8d315 tempest-CreateVolumesFromImageTest-646327476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:54:31 devstack cinder-volume[91863]: DEBUG oslo_service.periodic_task [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 15:54:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:54:31 devstack sudo[98767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:54:31 devstack sudo[98767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:54:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:54:31 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:54:31 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:54:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:54:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:54:31 devstack sudo[98769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:54:31 devstack sudo[98769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:54:31 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-632cb677-6b08-41a6-afc0-e11efdf7b108 tempest-CreateVolumesFromImageTest-646327476 None] Acquiring lock "cinder-139d220c-6a34-4f28-bf8d-9c7672f90ab5-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:54:31 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-632cb677-6b08-41a6-afc0-e11efdf7b108 tempest-CreateVolumesFromImageTest-646327476 None] Lock "cinder-139d220c-6a34-4f28-bf8d-9c7672f90ab5-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:54:32 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-632cb677-6b08-41a6-afc0-e11efdf7b108 tempest-CreateVolumesFromImageTest-646327476 None] Acquiring lock "cinder-quobyte-139d220c-6a34-4f28-bf8d-9c7672f90ab5" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:54:32 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-632cb677-6b08-41a6-afc0-e11efdf7b108 tempest-CreateVolumesFromImageTest-646327476 None] Lock "cinder-quobyte-139d220c-6a34-4f28-bf8d-9c7672f90ab5" acquired by "delete_volume" :: waited 0.028s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:54:32 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1666887b-daf2-49d3-85f2-8002778d6211]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:54:32 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-632cb677-6b08-41a6-afc0-e11efdf7b108 tempest-CreateVolumesFromImageTest-646327476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-139d220c-6a34-4f28-bf8d-9c7672f90ab5 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:54:32 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-76818211-bfee-4ccb-a415-0152fc806050 tempest-ServersNegativeTestJSON-182957050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 15:54:32 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-76818211-bfee-4ccb-a415-0152fc806050 tempest-ServersNegativeTestJSON-182957050 None] Flow 'volume_create_manager' (80a30c4a-8587-401b-bd78-140ec57ea872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:54:32 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-76818211-bfee-4ccb-a415-0152fc806050 tempest-ServersNegativeTestJSON-182957050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8d4ba64-f0a4-4266-b44d-65c3c05a8a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:54:32 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-76818211-bfee-4ccb-a415-0152fc806050 tempest-ServersNegativeTestJSON-182957050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8d4ba64-f0a4-4266-b44d-65c3c05a8a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:54:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-23815857',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fedf0fbe-95e9-4b01-ae7a-1bdb4f4f005a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6173d183aa94430b83e22b26e80f0d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:54:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:54:32Z,use_quota=True,user_id='88d2bfb328ea4b819e66539949236263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:54:32 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-76818211-bfee-4ccb-a415-0152fc806050 tempest-ServersNegativeTestJSON-182957050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d70b2b11-e53a-4f2c-be73-967e50d10026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:54:32 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-76818211-bfee-4ccb-a415-0152fc806050 tempest-ServersNegativeTestJSON-182957050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d70b2b11-e53a-4f2c-be73-967e50d10026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:54:32 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-76818211-bfee-4ccb-a415-0152fc806050 tempest-ServersNegativeTestJSON-182957050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e5a88f8-b111-4531-a247-2b08a970dfc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:54:32 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-76818211-bfee-4ccb-a415-0152fc806050 tempest-ServersNegativeTestJSON-182957050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e5a88f8-b111-4531-a247-2b08a970dfc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fedf0fbe-95e9-4b01-ae7a-1bdb4f4f005a', 'volume_name': 'volume-fedf0fbe-95e9-4b01-ae7a-1bdb4f4f005a', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:54:32 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-76818211-bfee-4ccb-a415-0152fc806050 tempest-ServersNegativeTestJSON-182957050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (288fffb5-f8d3-45c6-b8e7-06d28c3714c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:54:32 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-76818211-bfee-4ccb-a415-0152fc806050 tempest-ServersNegativeTestJSON-182957050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (288fffb5-f8d3-45c6-b8e7-06d28c3714c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:54:32 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-76818211-bfee-4ccb-a415-0152fc806050 tempest-ServersNegativeTestJSON-182957050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7d1f435-a537-447e-989c-76797efa21b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:54:32 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-76818211-bfee-4ccb-a415-0152fc806050 tempest-ServersNegativeTestJSON-182957050 None] Volume fedf0fbe-95e9-4b01-ae7a-1bdb4f4f005a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fedf0fbe-95e9-4b01-ae7a-1bdb4f4f005a', 'volume_size': 1}
Jun 15 15:54:32 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-76818211-bfee-4ccb-a415-0152fc806050 tempest-ServersNegativeTestJSON-182957050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:54:32 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-76818211-bfee-4ccb-a415-0152fc806050 tempest-ServersNegativeTestJSON-182957050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:54:32 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-76818211-bfee-4ccb-a415-0152fc806050 tempest-ServersNegativeTestJSON-182957050 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:54:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-23815857',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fedf0fbe-95e9-4b01-ae7a-1bdb4f4f005a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6173d183aa94430b83e22b26e80f0d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:54:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:54:32Z,use_quota=True,user_id='88d2bfb328ea4b819e66539949236263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 15:54:32 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-76818211-bfee-4ccb-a415-0152fc806050 tempest-ServersNegativeTestJSON-182957050 None] Creating volume fedf0fbe-95e9-4b01-ae7a-1bdb4f4f005a {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 15:54:32 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-76818211-bfee-4ccb-a415-0152fc806050 tempest-ServersNegativeTestJSON-182957050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:54:32 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-76818211-bfee-4ccb-a415-0152fc806050 tempest-ServersNegativeTestJSON-182957050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:54:32 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-76818211-bfee-4ccb-a415-0152fc806050 tempest-ServersNegativeTestJSON-182957050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:54:32 devstack sudo[98767]: pam_unix(sudo:session): session closed for user root
Jun 15 15:54:32 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-76818211-bfee-4ccb-a415-0152fc806050 tempest-ServersNegativeTestJSON-182957050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:54:32 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-76818211-bfee-4ccb-a415-0152fc806050 tempest-ServersNegativeTestJSON-182957050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:54:32 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-76818211-bfee-4ccb-a415-0152fc806050 tempest-ServersNegativeTestJSON-182957050 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 15:54:32 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-76818211-bfee-4ccb-a415-0152fc806050 tempest-ServersNegativeTestJSON-182957050 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 15:54:32 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-76818211-bfee-4ccb-a415-0152fc806050 tempest-ServersNegativeTestJSON-182957050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fedf0fbe-95e9-4b01-ae7a-1bdb4f4f005a 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:54:32 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-d381074f-6c76-4643-b67f-778c1fd8d315 tempest-CreateVolumesFromImageTest-646327476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 1.386s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:54:32 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-d381074f-6c76-4643-b67f-778c1fd8d315 tempest-CreateVolumesFromImageTest-646327476 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:54:32 devstack sudo[98772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-139d220c-6a34-4f28-bf8d-9c7672f90ab5
Jun 15 15:54:32 devstack sudo[98772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:54:32 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-d381074f-6c76-4643-b67f-778c1fd8d315 tempest-CreateVolumesFromImageTest-646327476 None] Deleted volume successfully.
Jun 15 15:54:32 devstack sudo[98774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fedf0fbe-95e9-4b01-ae7a-1bdb4f4f005a 1073741824
Jun 15 15:54:32 devstack sudo[98774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:54:32 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-d381074f-6c76-4643-b67f-778c1fd8d315 tempest-CreateVolumesFromImageTest-646327476 None] Lock "cinder-af824c61-4651-4a58-9fbb-b5a14ab825fc-delete_volume" released by "delete_volume" :: held 4.051s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:54:32 devstack sudo[98769]: pam_unix(sudo:session): session closed for user root
Jun 15 15:54:32 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 1.451s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:54:32 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:54:32 devstack cinder-volume[91863]: DEBUG oslo_service.periodic_task [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Running periodic task VolumeManager._thread_info {{(pid=91863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 15:54:32 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] thread count: 28 {{(pid=91863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 15 15:54:32 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] thread info: [<_MainThread(MainThread, started 131088232640640)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131088122704576)>, <Thread(Thread-3 (stat_writer), started daemon 131088123058112)>, <Thread(Rabbit-heartbeat, started daemon 131088121268864)>, <Thread(Thread-5 (_runner), started daemon 131088121904192)>, <Thread(Thread-7 (_runner), started daemon 131088122037248)>, <Thread(fd_logger, started daemon 131088119630784)>, <Thread(privsep_reader, started daemon 131088119781440)>, <Thread(tpool_thread_0, started daemon 131088111617728)>, <Thread(tpool_thread_1, started daemon 131088103225024)>, <Thread(tpool_thread_2, started daemon 131088094832320)>, <Thread(tpool_thread_3, started daemon 131088086439616)>, <Thread(tpool_thread_4, started daemon 131088078046912)>, <Thread(tpool_thread_5, started daemon 131088069654208)>, <Thread(tpool_thread_6, started daemon 131088061261504)>, <Thread(tpool_thread_7, started daemon 131088052868800)>, <Thread(tpool_thread_8, started daemon 131088044476096)>, <Thread(tpool_thread_9, started daemon 131088036083392)>, <Thread(tpool_thread_10, started daemon 131088027690688)>, <Thread(tpool_thread_11, started daemon 131088019297984)>, <Thread(tpool_thread_12, started daemon 131088010905280)>, <Thread(tpool_thread_13, started daemon 131088002512576)>, <Thread(tpool_thread_14, started daemon 131087994119872)>, <Thread(tpool_thread_15, started daemon 131087985727168)>, <Thread(tpool_thread_16, started daemon 131087977334464)>, <Thread(tpool_thread_17, started daemon 131087968941760)>, <Thread(tpool_thread_18, started daemon 131087960549056)>, <Thread(tpool_thread_19, started daemon 131087952156352)>] {{(pid=91863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 15 15:54:33 devstack sudo[98772]: pam_unix(sudo:session): session closed for user root
Jun 15 15:54:33 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-632cb677-6b08-41a6-afc0-e11efdf7b108 tempest-CreateVolumesFromImageTest-646327476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-139d220c-6a34-4f28-bf8d-9c7672f90ab5" returned: 0 in 1.418s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:54:33 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-632cb677-6b08-41a6-afc0-e11efdf7b108 tempest-CreateVolumesFromImageTest-646327476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-139d220c-6a34-4f28-bf8d-9c7672f90ab5 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:54:33 devstack sudo[98817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-139d220c-6a34-4f28-bf8d-9c7672f90ab5
Jun 15 15:54:33 devstack sudo[98817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:54:34 devstack sudo[98774]: pam_unix(sudo:session): session closed for user root
Jun 15 15:54:34 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-76818211-bfee-4ccb-a415-0152fc806050 tempest-ServersNegativeTestJSON-182957050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fedf0fbe-95e9-4b01-ae7a-1bdb4f4f005a 1073741824" returned: 0 in 1.746s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:54:34 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-76818211-bfee-4ccb-a415-0152fc806050 tempest-ServersNegativeTestJSON-182957050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fedf0fbe-95e9-4b01-ae7a-1bdb4f4f005a {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:54:34 devstack sudo[98826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fedf0fbe-95e9-4b01-ae7a-1bdb4f4f005a
Jun 15 15:54:34 devstack sudo[98826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:54:34 devstack sudo[98817]: pam_unix(sudo:session): session closed for user root
Jun 15 15:54:34 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-632cb677-6b08-41a6-afc0-e11efdf7b108 tempest-CreateVolumesFromImageTest-646327476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-139d220c-6a34-4f28-bf8d-9c7672f90ab5" returned: 0 in 0.803s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:54:34 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-632cb677-6b08-41a6-afc0-e11efdf7b108 tempest-CreateVolumesFromImageTest-646327476 None] Lock "cinder-quobyte-139d220c-6a34-4f28-bf8d-9c7672f90ab5" released by "delete_volume" :: held 2.364s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:54:34 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-632cb677-6b08-41a6-afc0-e11efdf7b108 tempest-CreateVolumesFromImageTest-646327476 None] Created reservations ['4c26306e-745b-4d2a-a1d5-2965eae5cdad', '2748c91e-684d-4b3c-9503-ad8348b1c33d', '03137892-c659-483f-ba1b-7827d10879b5', '5045c968-4d95-48b9-b01e-5b99df90dc2c'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:54:34 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-632cb677-6b08-41a6-afc0-e11efdf7b108 tempest-CreateVolumesFromImageTest-646327476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:54:34 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-632cb677-6b08-41a6-afc0-e11efdf7b108 tempest-CreateVolumesFromImageTest-646327476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:54:34 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-632cb677-6b08-41a6-afc0-e11efdf7b108 tempest-CreateVolumesFromImageTest-646327476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:54:34 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-632cb677-6b08-41a6-afc0-e11efdf7b108 tempest-CreateVolumesFromImageTest-646327476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:54:34 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-632cb677-6b08-41a6-afc0-e11efdf7b108 tempest-CreateVolumesFromImageTest-646327476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:54:34 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-632cb677-6b08-41a6-afc0-e11efdf7b108 tempest-CreateVolumesFromImageTest-646327476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:54:34 devstack sudo[98828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:54:34 devstack sudo[98828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:54:35 devstack sudo[98826]: pam_unix(sudo:session): session closed for user root
Jun 15 15:54:35 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-76818211-bfee-4ccb-a415-0152fc806050 tempest-ServersNegativeTestJSON-182957050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fedf0fbe-95e9-4b01-ae7a-1bdb4f4f005a" returned: 0 in 0.832s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:54:35 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-76818211-bfee-4ccb-a415-0152fc806050 tempest-ServersNegativeTestJSON-182957050 None] <== create_volume: return (2664ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 15:54:35 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-76818211-bfee-4ccb-a415-0152fc806050 tempest-ServersNegativeTestJSON-182957050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.669s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:54:35 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-76818211-bfee-4ccb-a415-0152fc806050 tempest-ServersNegativeTestJSON-182957050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7d1f435-a537-447e-989c-76797efa21b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fedf0fbe-95e9-4b01-ae7a-1bdb4f4f005a', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:54:35 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-76818211-bfee-4ccb-a415-0152fc806050 tempest-ServersNegativeTestJSON-182957050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f22ebc5e-34e1-4869-ba89-cdfaf98230d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:54:35 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-76818211-bfee-4ccb-a415-0152fc806050 tempest-ServersNegativeTestJSON-182957050 None] Volume volume-fedf0fbe-95e9-4b01-ae7a-1bdb4f4f005a (fedf0fbe-95e9-4b01-ae7a-1bdb4f4f005a): created successfully
Jun 15 15:54:35 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-76818211-bfee-4ccb-a415-0152fc806050 tempest-ServersNegativeTestJSON-182957050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f22ebc5e-34e1-4869-ba89-cdfaf98230d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:54:35 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-76818211-bfee-4ccb-a415-0152fc806050 tempest-ServersNegativeTestJSON-182957050 None] Flow 'volume_create_manager' (80a30c4a-8587-401b-bd78-140ec57ea872) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:54:35 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-76818211-bfee-4ccb-a415-0152fc806050 tempest-ServersNegativeTestJSON-182957050 None] Created volume successfully.
Jun 15 15:54:35 devstack sudo[98828]: pam_unix(sudo:session): session closed for user root
Jun 15 15:54:35 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-632cb677-6b08-41a6-afc0-e11efdf7b108 tempest-CreateVolumesFromImageTest-646327476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.771s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:54:35 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-632cb677-6b08-41a6-afc0-e11efdf7b108 tempest-CreateVolumesFromImageTest-646327476 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:54:35 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-632cb677-6b08-41a6-afc0-e11efdf7b108 tempest-CreateVolumesFromImageTest-646327476 None] Deleted volume successfully.
Jun 15 15:54:35 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-632cb677-6b08-41a6-afc0-e11efdf7b108 tempest-CreateVolumesFromImageTest-646327476 None] Lock "cinder-139d220c-6a34-4f28-bf8d-9c7672f90ab5-delete_volume" released by "delete_volume" :: held 3.552s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:54:35 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-f6809578-bbd0-45ec-baa6-ca58ee0627cd tempest-CreateVolumesFromImageTest-646327476 None] Acquiring lock "cinder-14426d40-900b-4680-8964-76a66e441e57-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:54:35 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-f6809578-bbd0-45ec-baa6-ca58ee0627cd tempest-CreateVolumesFromImageTest-646327476 None] Lock "cinder-14426d40-900b-4680-8964-76a66e441e57-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:54:35 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-f6809578-bbd0-45ec-baa6-ca58ee0627cd tempest-CreateVolumesFromImageTest-646327476 None] Acquiring lock "cinder-quobyte-14426d40-900b-4680-8964-76a66e441e57" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:54:35 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-f6809578-bbd0-45ec-baa6-ca58ee0627cd tempest-CreateVolumesFromImageTest-646327476 None] Lock "cinder-quobyte-14426d40-900b-4680-8964-76a66e441e57" acquired by "delete_volume" :: waited 0.023s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:54:35 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a2e2008-5ab5-492f-8921-43938b629cfc]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:54:35 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-f6809578-bbd0-45ec-baa6-ca58ee0627cd tempest-CreateVolumesFromImageTest-646327476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-14426d40-900b-4680-8964-76a66e441e57 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:54:35 devstack sudo[98832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-14426d40-900b-4680-8964-76a66e441e57
Jun 15 15:54:35 devstack sudo[98832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:54:36 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-e0fc8f51-a435-4161-b673-e60dcd289487 tempest-ServersNegativeTestJSON-182957050 None] Acquiring lock "cinder-fedf0fbe-95e9-4b01-ae7a-1bdb4f4f005a-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:54:36 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-e0fc8f51-a435-4161-b673-e60dcd289487 tempest-ServersNegativeTestJSON-182957050 None] Lock "cinder-fedf0fbe-95e9-4b01-ae7a-1bdb4f4f005a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:54:36 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-e0fc8f51-a435-4161-b673-e60dcd289487 tempest-ServersNegativeTestJSON-182957050 None] Acquiring lock "cinder-quobyte-fedf0fbe-95e9-4b01-ae7a-1bdb4f4f005a" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:54:36 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-e0fc8f51-a435-4161-b673-e60dcd289487 tempest-ServersNegativeTestJSON-182957050 None] Lock "cinder-quobyte-fedf0fbe-95e9-4b01-ae7a-1bdb4f4f005a" acquired by "delete_volume" :: waited 0.019s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:54:36 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d320cfec-e836-4130-ab7d-d7f915227ad7]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:54:36 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-e0fc8f51-a435-4161-b673-e60dcd289487 tempest-ServersNegativeTestJSON-182957050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fedf0fbe-95e9-4b01-ae7a-1bdb4f4f005a {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:54:36 devstack sudo[98834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fedf0fbe-95e9-4b01-ae7a-1bdb4f4f005a
Jun 15 15:54:36 devstack sudo[98834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:54:36 devstack sudo[98832]: pam_unix(sudo:session): session closed for user root
Jun 15 15:54:36 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-f6809578-bbd0-45ec-baa6-ca58ee0627cd tempest-CreateVolumesFromImageTest-646327476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-14426d40-900b-4680-8964-76a66e441e57" returned: 0 in 0.901s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:54:36 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-f6809578-bbd0-45ec-baa6-ca58ee0627cd tempest-CreateVolumesFromImageTest-646327476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-14426d40-900b-4680-8964-76a66e441e57 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:54:36 devstack sudo[98839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-14426d40-900b-4680-8964-76a66e441e57
Jun 15 15:54:36 devstack sudo[98839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:54:37 devstack sudo[98834]: pam_unix(sudo:session): session closed for user root
Jun 15 15:54:37 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-e0fc8f51-a435-4161-b673-e60dcd289487 tempest-ServersNegativeTestJSON-182957050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fedf0fbe-95e9-4b01-ae7a-1bdb4f4f005a" returned: 0 in 0.793s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:54:37 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-e0fc8f51-a435-4161-b673-e60dcd289487 tempest-ServersNegativeTestJSON-182957050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fedf0fbe-95e9-4b01-ae7a-1bdb4f4f005a {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:54:37 devstack sudo[98844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fedf0fbe-95e9-4b01-ae7a-1bdb4f4f005a
Jun 15 15:54:37 devstack sudo[98844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:54:37 devstack sudo[98839]: pam_unix(sudo:session): session closed for user root
Jun 15 15:54:37 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-f6809578-bbd0-45ec-baa6-ca58ee0627cd tempest-CreateVolumesFromImageTest-646327476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-14426d40-900b-4680-8964-76a66e441e57" returned: 0 in 0.765s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:54:37 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-f6809578-bbd0-45ec-baa6-ca58ee0627cd tempest-CreateVolumesFromImageTest-646327476 None] Lock "cinder-quobyte-14426d40-900b-4680-8964-76a66e441e57" released by "delete_volume" :: held 1.739s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:54:37 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-f6809578-bbd0-45ec-baa6-ca58ee0627cd tempest-CreateVolumesFromImageTest-646327476 None] Created reservations ['1f4ae992-6fc8-481f-a2b0-17f538b21dd2', '22c3fb99-ec2e-42d7-82bd-a763597fe70f', '31be5996-4f04-4940-9215-c33979387489', 'e6fa0ce5-1f91-4d88-95ed-ca6a1e23c61f'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:54:37 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-f6809578-bbd0-45ec-baa6-ca58ee0627cd tempest-CreateVolumesFromImageTest-646327476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:54:37 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-f6809578-bbd0-45ec-baa6-ca58ee0627cd tempest-CreateVolumesFromImageTest-646327476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:54:37 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-f6809578-bbd0-45ec-baa6-ca58ee0627cd tempest-CreateVolumesFromImageTest-646327476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:54:37 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-f6809578-bbd0-45ec-baa6-ca58ee0627cd tempest-CreateVolumesFromImageTest-646327476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:54:37 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-f6809578-bbd0-45ec-baa6-ca58ee0627cd tempest-CreateVolumesFromImageTest-646327476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:54:37 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-f6809578-bbd0-45ec-baa6-ca58ee0627cd tempest-CreateVolumesFromImageTest-646327476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:54:37 devstack sudo[98847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:54:37 devstack sudo[98847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:54:37 devstack sudo[98844]: pam_unix(sudo:session): session closed for user root
Jun 15 15:54:37 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-e0fc8f51-a435-4161-b673-e60dcd289487 tempest-ServersNegativeTestJSON-182957050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fedf0fbe-95e9-4b01-ae7a-1bdb4f4f005a" returned: 0 in 0.686s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:54:37 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-e0fc8f51-a435-4161-b673-e60dcd289487 tempest-ServersNegativeTestJSON-182957050 None] Lock "cinder-quobyte-fedf0fbe-95e9-4b01-ae7a-1bdb4f4f005a" released by "delete_volume" :: held 1.549s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:54:37 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-30c42265-c4fe-47b3-825b-94b6f95c1d7e tempest-CreateVolumesFromImageTest-646327476 None] Acquiring lock "cinder-2d900c3e-0377-4d68-944b-07f8d5dfc116-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:54:38 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [req-a824a59a-5224-4999-b790-cd8116568ab8 req-a5e9cf58-bc13-4e28-90bc-5fb47a97cef0 tempest-VolumesSnapshotsTestJSON-1649418515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 15:54:38 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [req-a824a59a-5224-4999-b790-cd8116568ab8 req-a5e9cf58-bc13-4e28-90bc-5fb47a97cef0 tempest-VolumesSnapshotsTestJSON-1649418515 None] Flow 'volume_create_manager' (84a1aa02-c730-4319-a709-ee62cc474ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:54:38 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [req-a824a59a-5224-4999-b790-cd8116568ab8 req-a5e9cf58-bc13-4e28-90bc-5fb47a97cef0 tempest-VolumesSnapshotsTestJSON-1649418515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acd3202f-a15b-4349-9960-d0d91cf80381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:54:38 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-30c42265-c4fe-47b3-825b-94b6f95c1d7e tempest-CreateVolumesFromImageTest-646327476 None] Lock "cinder-2d900c3e-0377-4d68-944b-07f8d5dfc116-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:54:38 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [req-a824a59a-5224-4999-b790-cd8116568ab8 req-a5e9cf58-bc13-4e28-90bc-5fb47a97cef0 tempest-VolumesSnapshotsTestJSON-1649418515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acd3202f-a15b-4349-9960-d0d91cf80381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:54:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-353964580',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e475e619-7354-41da-b1ba-71f322da2389,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c788adfa84f40c2af4b1be3bd519783',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:54:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:54:38Z,use_quota=True,user_id='c66c2cc58ba0421db57124316620edd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:54:38 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [req-a824a59a-5224-4999-b790-cd8116568ab8 req-a5e9cf58-bc13-4e28-90bc-5fb47a97cef0 tempest-VolumesSnapshotsTestJSON-1649418515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ad894f1-bbb9-4caa-86a6-71e87bf11504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:54:38 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [req-a824a59a-5224-4999-b790-cd8116568ab8 req-a5e9cf58-bc13-4e28-90bc-5fb47a97cef0 tempest-VolumesSnapshotsTestJSON-1649418515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ad894f1-bbb9-4caa-86a6-71e87bf11504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:54:38 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [req-a824a59a-5224-4999-b790-cd8116568ab8 req-a5e9cf58-bc13-4e28-90bc-5fb47a97cef0 tempest-VolumesSnapshotsTestJSON-1649418515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50d1c86b-0cce-4c0e-8c08-d0476cc9b55d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:54:38 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [req-a824a59a-5224-4999-b790-cd8116568ab8 req-a5e9cf58-bc13-4e28-90bc-5fb47a97cef0 tempest-VolumesSnapshotsTestJSON-1649418515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50d1c86b-0cce-4c0e-8c08-d0476cc9b55d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e475e619-7354-41da-b1ba-71f322da2389', 'volume_name': 'volume-e475e619-7354-41da-b1ba-71f322da2389', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:54:38 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [req-a824a59a-5224-4999-b790-cd8116568ab8 req-a5e9cf58-bc13-4e28-90bc-5fb47a97cef0 tempest-VolumesSnapshotsTestJSON-1649418515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (740b5063-2621-4996-81bc-f061f60fa6a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:54:38 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [req-a824a59a-5224-4999-b790-cd8116568ab8 req-a5e9cf58-bc13-4e28-90bc-5fb47a97cef0 tempest-VolumesSnapshotsTestJSON-1649418515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (740b5063-2621-4996-81bc-f061f60fa6a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:54:38 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [req-a824a59a-5224-4999-b790-cd8116568ab8 req-a5e9cf58-bc13-4e28-90bc-5fb47a97cef0 tempest-VolumesSnapshotsTestJSON-1649418515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e7a4ffa-ee86-406f-bd2b-87d17dae93e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:54:38 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [req-a824a59a-5224-4999-b790-cd8116568ab8 req-a5e9cf58-bc13-4e28-90bc-5fb47a97cef0 tempest-VolumesSnapshotsTestJSON-1649418515 None] Volume e475e619-7354-41da-b1ba-71f322da2389: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e475e619-7354-41da-b1ba-71f322da2389', 'volume_size': 1}
Jun 15 15:54:38 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [req-a824a59a-5224-4999-b790-cd8116568ab8 req-a5e9cf58-bc13-4e28-90bc-5fb47a97cef0 tempest-VolumesSnapshotsTestJSON-1649418515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:54:38 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [req-a824a59a-5224-4999-b790-cd8116568ab8 req-a5e9cf58-bc13-4e28-90bc-5fb47a97cef0 tempest-VolumesSnapshotsTestJSON-1649418515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:54:38 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [req-a824a59a-5224-4999-b790-cd8116568ab8 req-a5e9cf58-bc13-4e28-90bc-5fb47a97cef0 tempest-VolumesSnapshotsTestJSON-1649418515 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:54:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-353964580',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e475e619-7354-41da-b1ba-71f322da2389,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c788adfa84f40c2af4b1be3bd519783',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:54:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:54:38Z,use_quota=True,user_id='c66c2cc58ba0421db57124316620edd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 15:54:38 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [req-a824a59a-5224-4999-b790-cd8116568ab8 req-a5e9cf58-bc13-4e28-90bc-5fb47a97cef0 tempest-VolumesSnapshotsTestJSON-1649418515 None] Creating volume e475e619-7354-41da-b1ba-71f322da2389 {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 15:54:38 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [req-a824a59a-5224-4999-b790-cd8116568ab8 req-a5e9cf58-bc13-4e28-90bc-5fb47a97cef0 tempest-VolumesSnapshotsTestJSON-1649418515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:54:38 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [req-a824a59a-5224-4999-b790-cd8116568ab8 req-a5e9cf58-bc13-4e28-90bc-5fb47a97cef0 tempest-VolumesSnapshotsTestJSON-1649418515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:54:38 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [req-a824a59a-5224-4999-b790-cd8116568ab8 req-a5e9cf58-bc13-4e28-90bc-5fb47a97cef0 tempest-VolumesSnapshotsTestJSON-1649418515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:54:38 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [req-a824a59a-5224-4999-b790-cd8116568ab8 req-a5e9cf58-bc13-4e28-90bc-5fb47a97cef0 tempest-VolumesSnapshotsTestJSON-1649418515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:54:38 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [req-a824a59a-5224-4999-b790-cd8116568ab8 req-a5e9cf58-bc13-4e28-90bc-5fb47a97cef0 tempest-VolumesSnapshotsTestJSON-1649418515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:54:38 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [req-a824a59a-5224-4999-b790-cd8116568ab8 req-a5e9cf58-bc13-4e28-90bc-5fb47a97cef0 tempest-VolumesSnapshotsTestJSON-1649418515 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 15:54:38 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [req-a824a59a-5224-4999-b790-cd8116568ab8 req-a5e9cf58-bc13-4e28-90bc-5fb47a97cef0 tempest-VolumesSnapshotsTestJSON-1649418515 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 15:54:38 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-a824a59a-5224-4999-b790-cd8116568ab8 req-a5e9cf58-bc13-4e28-90bc-5fb47a97cef0 tempest-VolumesSnapshotsTestJSON-1649418515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e475e619-7354-41da-b1ba-71f322da2389 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:54:38 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-e0fc8f51-a435-4161-b673-e60dcd289487 tempest-ServersNegativeTestJSON-182957050 None] Created reservations ['87b98943-ecca-46e8-b5d4-d201bd93fc94', '9af92f9d-d2f4-4365-b549-e1a3c2ca3711', '0dd99e22-887d-49a6-b04e-341c3dfaeccb', 'f6b8e462-d0a8-4e20-a7df-1ca5748886a7'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:54:38 devstack sudo[98851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e475e619-7354-41da-b1ba-71f322da2389 1073741824
Jun 15 15:54:38 devstack sudo[98851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:54:38 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-30c42265-c4fe-47b3-825b-94b6f95c1d7e tempest-CreateVolumesFromImageTest-646327476 None] Acquiring lock "cinder-quobyte-2d900c3e-0377-4d68-944b-07f8d5dfc116" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:54:38 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-30c42265-c4fe-47b3-825b-94b6f95c1d7e tempest-CreateVolumesFromImageTest-646327476 None] Lock "cinder-quobyte-2d900c3e-0377-4d68-944b-07f8d5dfc116" acquired by "delete_volume" :: waited 0.026s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:54:38 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[912bc8c1-dcb9-4513-8c76-ff448b208985]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:54:38 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-30c42265-c4fe-47b3-825b-94b6f95c1d7e tempest-CreateVolumesFromImageTest-646327476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2d900c3e-0377-4d68-944b-07f8d5dfc116 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:54:38 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-e0fc8f51-a435-4161-b673-e60dcd289487 tempest-ServersNegativeTestJSON-182957050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:54:38 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-e0fc8f51-a435-4161-b673-e60dcd289487 tempest-ServersNegativeTestJSON-182957050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:54:38 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-e0fc8f51-a435-4161-b673-e60dcd289487 tempest-ServersNegativeTestJSON-182957050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:54:38 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-e0fc8f51-a435-4161-b673-e60dcd289487 tempest-ServersNegativeTestJSON-182957050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:54:38 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-e0fc8f51-a435-4161-b673-e60dcd289487 tempest-ServersNegativeTestJSON-182957050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:54:38 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-e0fc8f51-a435-4161-b673-e60dcd289487 tempest-ServersNegativeTestJSON-182957050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:54:38 devstack sudo[98847]: pam_unix(sudo:session): session closed for user root
Jun 15 15:54:38 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-f6809578-bbd0-45ec-baa6-ca58ee0627cd tempest-CreateVolumesFromImageTest-646327476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.666s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:54:38 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-f6809578-bbd0-45ec-baa6-ca58ee0627cd tempest-CreateVolumesFromImageTest-646327476 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:54:38 devstack sudo[98855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:54:38 devstack sudo[98855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:54:38 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-f6809578-bbd0-45ec-baa6-ca58ee0627cd tempest-CreateVolumesFromImageTest-646327476 None] Deleted volume successfully.
Jun 15 15:54:38 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-f6809578-bbd0-45ec-baa6-ca58ee0627cd tempest-CreateVolumesFromImageTest-646327476 None] Lock "cinder-14426d40-900b-4680-8964-76a66e441e57-delete_volume" released by "delete_volume" :: held 2.700s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:54:38 devstack sudo[98854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2d900c3e-0377-4d68-944b-07f8d5dfc116
Jun 15 15:54:38 devstack sudo[98854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:54:38 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-ef9c88e8-edd6-497d-ac51-0880627b4367 tempest-ServersNegativeTestJSON-182957050 None] Acquiring lock "cinder-32da1963-3d59-437f-a513-5789abd39d07-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:54:38 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-ef9c88e8-edd6-497d-ac51-0880627b4367 tempest-ServersNegativeTestJSON-182957050 None] Lock "cinder-32da1963-3d59-437f-a513-5789abd39d07-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:54:38 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-ef9c88e8-edd6-497d-ac51-0880627b4367 tempest-ServersNegativeTestJSON-182957050 None] Acquiring lock "cinder-quobyte-32da1963-3d59-437f-a513-5789abd39d07" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:54:38 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-ef9c88e8-edd6-497d-ac51-0880627b4367 tempest-ServersNegativeTestJSON-182957050 None] Lock "cinder-quobyte-32da1963-3d59-437f-a513-5789abd39d07" acquired by "delete_volume" :: waited 0.019s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:54:38 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[6788355a-01fe-4ce2-a96b-8177c03424be]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:54:38 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ef9c88e8-edd6-497d-ac51-0880627b4367 tempest-ServersNegativeTestJSON-182957050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-32da1963-3d59-437f-a513-5789abd39d07 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:54:38 devstack sudo[98858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-32da1963-3d59-437f-a513-5789abd39d07
Jun 15 15:54:38 devstack sudo[98858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:54:38 devstack sudo[98855]: pam_unix(sudo:session): session closed for user root
Jun 15 15:54:38 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-e0fc8f51-a435-4161-b673-e60dcd289487 tempest-ServersNegativeTestJSON-182957050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.640s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:54:38 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-e0fc8f51-a435-4161-b673-e60dcd289487 tempest-ServersNegativeTestJSON-182957050 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:54:38 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-e0fc8f51-a435-4161-b673-e60dcd289487 tempest-ServersNegativeTestJSON-182957050 None] Deleted volume successfully.
Jun 15 15:54:38 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-e0fc8f51-a435-4161-b673-e60dcd289487 tempest-ServersNegativeTestJSON-182957050 None] Lock "cinder-fedf0fbe-95e9-4b01-ae7a-1bdb4f4f005a-delete_volume" released by "delete_volume" :: held 2.711s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:54:39 devstack sudo[98851]: pam_unix(sudo:session): session closed for user root
Jun 15 15:54:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-a824a59a-5224-4999-b790-cd8116568ab8 req-a5e9cf58-bc13-4e28-90bc-5fb47a97cef0 tempest-VolumesSnapshotsTestJSON-1649418515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e475e619-7354-41da-b1ba-71f322da2389 1073741824" returned: 0 in 1.059s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:54:39 devstack sudo[98854]: pam_unix(sudo:session): session closed for user root
Jun 15 15:54:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-30c42265-c4fe-47b3-825b-94b6f95c1d7e tempest-CreateVolumesFromImageTest-646327476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2d900c3e-0377-4d68-944b-07f8d5dfc116" returned: 0 in 0.942s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:54:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-30c42265-c4fe-47b3-825b-94b6f95c1d7e tempest-CreateVolumesFromImageTest-646327476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2d900c3e-0377-4d68-944b-07f8d5dfc116 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:54:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-a824a59a-5224-4999-b790-cd8116568ab8 req-a5e9cf58-bc13-4e28-90bc-5fb47a97cef0 tempest-VolumesSnapshotsTestJSON-1649418515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e475e619-7354-41da-b1ba-71f322da2389 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:54:39 devstack sudo[98867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2d900c3e-0377-4d68-944b-07f8d5dfc116
Jun 15 15:54:39 devstack sudo[98867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:54:39 devstack sudo[98868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e475e619-7354-41da-b1ba-71f322da2389
Jun 15 15:54:39 devstack sudo[98868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:54:39 devstack sudo[98858]: pam_unix(sudo:session): session closed for user root
Jun 15 15:54:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ef9c88e8-edd6-497d-ac51-0880627b4367 tempest-ServersNegativeTestJSON-182957050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-32da1963-3d59-437f-a513-5789abd39d07" returned: 0 in 0.822s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:54:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ef9c88e8-edd6-497d-ac51-0880627b4367 tempest-ServersNegativeTestJSON-182957050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-32da1963-3d59-437f-a513-5789abd39d07 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:54:39 devstack sudo[98874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-32da1963-3d59-437f-a513-5789abd39d07
Jun 15 15:54:39 devstack sudo[98874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:54:39 devstack sudo[98867]: pam_unix(sudo:session): session closed for user root
Jun 15 15:54:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-30c42265-c4fe-47b3-825b-94b6f95c1d7e tempest-CreateVolumesFromImageTest-646327476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2d900c3e-0377-4d68-944b-07f8d5dfc116" returned: 0 in 0.613s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:54:39 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-30c42265-c4fe-47b3-825b-94b6f95c1d7e tempest-CreateVolumesFromImageTest-646327476 None] Lock "cinder-quobyte-2d900c3e-0377-4d68-944b-07f8d5dfc116" released by "delete_volume" :: held 1.635s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:54:39 devstack sudo[98868]: pam_unix(sudo:session): session closed for user root
Jun 15 15:54:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-a824a59a-5224-4999-b790-cd8116568ab8 req-a5e9cf58-bc13-4e28-90bc-5fb47a97cef0 tempest-VolumesSnapshotsTestJSON-1649418515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e475e619-7354-41da-b1ba-71f322da2389" returned: 0 in 0.629s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:54:39 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [req-a824a59a-5224-4999-b790-cd8116568ab8 req-a5e9cf58-bc13-4e28-90bc-5fb47a97cef0 tempest-VolumesSnapshotsTestJSON-1649418515 None] <== create_volume: return (1735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 15:54:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [req-a824a59a-5224-4999-b790-cd8116568ab8 req-a5e9cf58-bc13-4e28-90bc-5fb47a97cef0 tempest-VolumesSnapshotsTestJSON-1649418515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.739s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:54:39 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [req-a824a59a-5224-4999-b790-cd8116568ab8 req-a5e9cf58-bc13-4e28-90bc-5fb47a97cef0 tempest-VolumesSnapshotsTestJSON-1649418515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e7a4ffa-ee86-406f-bd2b-87d17dae93e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e475e619-7354-41da-b1ba-71f322da2389', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:54:39 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [req-a824a59a-5224-4999-b790-cd8116568ab8 req-a5e9cf58-bc13-4e28-90bc-5fb47a97cef0 tempest-VolumesSnapshotsTestJSON-1649418515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b615d866-4c83-4b7c-add2-7a6daf636ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:54:39 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [req-a824a59a-5224-4999-b790-cd8116568ab8 req-a5e9cf58-bc13-4e28-90bc-5fb47a97cef0 tempest-VolumesSnapshotsTestJSON-1649418515 None] Volume volume-e475e619-7354-41da-b1ba-71f322da2389 (e475e619-7354-41da-b1ba-71f322da2389): created successfully
Jun 15 15:54:39 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [req-a824a59a-5224-4999-b790-cd8116568ab8 req-a5e9cf58-bc13-4e28-90bc-5fb47a97cef0 tempest-VolumesSnapshotsTestJSON-1649418515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b615d866-4c83-4b7c-add2-7a6daf636ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:54:39 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [req-a824a59a-5224-4999-b790-cd8116568ab8 req-a5e9cf58-bc13-4e28-90bc-5fb47a97cef0 tempest-VolumesSnapshotsTestJSON-1649418515 None] Flow 'volume_create_manager' (84a1aa02-c730-4319-a709-ee62cc474ff5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:54:39 devstack cinder-volume[91863]: INFO cinder.volume.manager [req-a824a59a-5224-4999-b790-cd8116568ab8 req-a5e9cf58-bc13-4e28-90bc-5fb47a97cef0 tempest-VolumesSnapshotsTestJSON-1649418515 None] Created volume successfully.
Jun 15 15:54:39 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-30c42265-c4fe-47b3-825b-94b6f95c1d7e tempest-CreateVolumesFromImageTest-646327476 None] Created reservations ['1b556feb-3e3e-4372-b021-78147a0180ca', '6b768446-3972-4ee1-81e1-60a22291cd55', '71ac6267-119d-487a-aa17-f1ca21e58407', 'da6297f4-3ecd-4dea-9e1d-6deeca1cddbc'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:54:40 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-30c42265-c4fe-47b3-825b-94b6f95c1d7e tempest-CreateVolumesFromImageTest-646327476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:54:40 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-30c42265-c4fe-47b3-825b-94b6f95c1d7e tempest-CreateVolumesFromImageTest-646327476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:54:40 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-30c42265-c4fe-47b3-825b-94b6f95c1d7e tempest-CreateVolumesFromImageTest-646327476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:54:40 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-30c42265-c4fe-47b3-825b-94b6f95c1d7e tempest-CreateVolumesFromImageTest-646327476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:54:40 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-30c42265-c4fe-47b3-825b-94b6f95c1d7e tempest-CreateVolumesFromImageTest-646327476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:54:40 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-30c42265-c4fe-47b3-825b-94b6f95c1d7e tempest-CreateVolumesFromImageTest-646327476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:54:40 devstack sudo[98879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:54:40 devstack sudo[98879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:54:40 devstack sudo[98874]: pam_unix(sudo:session): session closed for user root
Jun 15 15:54:40 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ef9c88e8-edd6-497d-ac51-0880627b4367 tempest-ServersNegativeTestJSON-182957050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-32da1963-3d59-437f-a513-5789abd39d07" returned: 0 in 0.600s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:54:40 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-ef9c88e8-edd6-497d-ac51-0880627b4367 tempest-ServersNegativeTestJSON-182957050 None] Lock "cinder-quobyte-32da1963-3d59-437f-a513-5789abd39d07" released by "delete_volume" :: held 1.466s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:54:40 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-ef9c88e8-edd6-497d-ac51-0880627b4367 tempest-ServersNegativeTestJSON-182957050 None] Created reservations ['ef9a2ac5-92f3-4005-9d1c-9e1d02c0b2ca', 'da438da5-49f3-463d-9d6f-20ec3ad18e5c', 'd8a277f5-3409-42fd-9e42-6ad9b85d38b0', 'b3e7d24a-9653-4a6d-8b65-ce6c699862b1'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:54:40 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-2b68f599-697f-4c00-971e-ca33eaaae6b1 tempest-CreateVolumesFromImageTest-646327476 None] Acquiring lock "cinder-6e1e2cfe-9346-4142-8a35-38165e9ea954-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:54:40 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-2b68f599-697f-4c00-971e-ca33eaaae6b1 tempest-CreateVolumesFromImageTest-646327476 None] Lock "cinder-6e1e2cfe-9346-4142-8a35-38165e9ea954-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:54:40 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-2b68f599-697f-4c00-971e-ca33eaaae6b1 tempest-CreateVolumesFromImageTest-646327476 None] Acquiring lock "cinder-quobyte-6e1e2cfe-9346-4142-8a35-38165e9ea954" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:54:40 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-2b68f599-697f-4c00-971e-ca33eaaae6b1 tempest-CreateVolumesFromImageTest-646327476 None] Lock "cinder-quobyte-6e1e2cfe-9346-4142-8a35-38165e9ea954" acquired by "delete_volume" :: waited 0.042s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:54:40 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-ef9c88e8-edd6-497d-ac51-0880627b4367 tempest-ServersNegativeTestJSON-182957050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:54:40 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-ef9c88e8-edd6-497d-ac51-0880627b4367 tempest-ServersNegativeTestJSON-182957050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:54:40 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-ef9c88e8-edd6-497d-ac51-0880627b4367 tempest-ServersNegativeTestJSON-182957050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:54:40 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-ef9c88e8-edd6-497d-ac51-0880627b4367 tempest-ServersNegativeTestJSON-182957050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:54:40 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-ef9c88e8-edd6-497d-ac51-0880627b4367 tempest-ServersNegativeTestJSON-182957050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:54:40 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ef9c88e8-edd6-497d-ac51-0880627b4367 tempest-ServersNegativeTestJSON-182957050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:54:40 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e96ec21-64ac-4a46-9d49-071c02ce4d3a]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:54:40 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-2b68f599-697f-4c00-971e-ca33eaaae6b1 tempest-CreateVolumesFromImageTest-646327476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-6e1e2cfe-9346-4142-8a35-38165e9ea954 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:54:40 devstack sudo[98881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:54:40 devstack sudo[98881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:54:40 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [req-307fd31f-9c54-4c9e-b5fc-c5c404efad66 req-369923b8-5892-45af-a6d6-cfa02e1a800d tempest-VolumesSnapshotsTestJSON-1649418515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:54:40 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [req-307fd31f-9c54-4c9e-b5fc-c5c404efad66 req-369923b8-5892-45af-a6d6-cfa02e1a800d tempest-VolumesSnapshotsTestJSON-1649418515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.007s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:54:40 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [req-307fd31f-9c54-4c9e-b5fc-c5c404efad66 req-369923b8-5892-45af-a6d6-cfa02e1a800d tempest-VolumesSnapshotsTestJSON-1649418515 None] Creating offline snapshot facf666f-d105-41a3-a3b7-4169314ae23e of volume e475e619-7354-41da-b1ba-71f322da2389 {{(pid=91863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 15 15:54:40 devstack sudo[98883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-6e1e2cfe-9346-4142-8a35-38165e9ea954
Jun 15 15:54:40 devstack sudo[98883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:54:40 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b44b8671-c130-47e7-bf16-264ca486ed48]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:54:40 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-307fd31f-9c54-4c9e-b5fc-c5c404efad66 req-369923b8-5892-45af-a6d6-cfa02e1a800d tempest-VolumesSnapshotsTestJSON-1649418515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e475e619-7354-41da-b1ba-71f322da2389 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:54:40 devstack sudo[98879]: pam_unix(sudo:session): session closed for user root
Jun 15 15:54:40 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-30c42265-c4fe-47b3-825b-94b6f95c1d7e tempest-CreateVolumesFromImageTest-646327476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.847s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:54:40 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-30c42265-c4fe-47b3-825b-94b6f95c1d7e tempest-CreateVolumesFromImageTest-646327476 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:54:40 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-30c42265-c4fe-47b3-825b-94b6f95c1d7e tempest-CreateVolumesFromImageTest-646327476 None] Deleted volume successfully.
Jun 15 15:54:40 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-30c42265-c4fe-47b3-825b-94b6f95c1d7e tempest-CreateVolumesFromImageTest-646327476 None] Lock "cinder-2d900c3e-0377-4d68-944b-07f8d5dfc116-delete_volume" released by "delete_volume" :: held 2.863s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:54:41 devstack sudo[98886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e475e619-7354-41da-b1ba-71f322da2389
Jun 15 15:54:41 devstack sudo[98886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:54:41 devstack sudo[98881]: pam_unix(sudo:session): session closed for user root
Jun 15 15:54:41 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ef9c88e8-edd6-497d-ac51-0880627b4367 tempest-ServersNegativeTestJSON-182957050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.916s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:54:41 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-ef9c88e8-edd6-497d-ac51-0880627b4367 tempest-ServersNegativeTestJSON-182957050 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:54:41 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-ef9c88e8-edd6-497d-ac51-0880627b4367 tempest-ServersNegativeTestJSON-182957050 None] Deleted volume successfully.
Jun 15 15:54:41 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-ef9c88e8-edd6-497d-ac51-0880627b4367 tempest-ServersNegativeTestJSON-182957050 None] Lock "cinder-32da1963-3d59-437f-a513-5789abd39d07-delete_volume" released by "delete_volume" :: held 2.956s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:54:41 devstack sudo[98883]: pam_unix(sudo:session): session closed for user root
Jun 15 15:54:41 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-2b68f599-697f-4c00-971e-ca33eaaae6b1 tempest-CreateVolumesFromImageTest-646327476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-6e1e2cfe-9346-4142-8a35-38165e9ea954" returned: 0 in 1.285s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:54:41 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-2b68f599-697f-4c00-971e-ca33eaaae6b1 tempest-CreateVolumesFromImageTest-646327476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-6e1e2cfe-9346-4142-8a35-38165e9ea954 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:54:41 devstack sudo[98892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-6e1e2cfe-9346-4142-8a35-38165e9ea954
Jun 15 15:54:41 devstack sudo[98892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:54:42 devstack sudo[98886]: pam_unix(sudo:session): session closed for user root
Jun 15 15:54:42 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-307fd31f-9c54-4c9e-b5fc-c5c404efad66 req-369923b8-5892-45af-a6d6-cfa02e1a800d tempest-VolumesSnapshotsTestJSON-1649418515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e475e619-7354-41da-b1ba-71f322da2389" returned: 0 in 1.217s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:54:42 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-307fd31f-9c54-4c9e-b5fc-c5c404efad66 req-369923b8-5892-45af-a6d6-cfa02e1a800d tempest-VolumesSnapshotsTestJSON-1649418515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e475e619-7354-41da-b1ba-71f322da2389,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e475e619-7354-41da-b1ba-71f322da2389.facf666f-d105-41a3-a3b7-4169314ae23e 1G {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:54:42 devstack sudo[98897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e475e619-7354-41da-b1ba-71f322da2389,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e475e619-7354-41da-b1ba-71f322da2389.facf666f-d105-41a3-a3b7-4169314ae23e 1G
Jun 15 15:54:42 devstack sudo[98897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:54:42 devstack sudo[98892]: pam_unix(sudo:session): session closed for user root
Jun 15 15:54:42 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-2b68f599-697f-4c00-971e-ca33eaaae6b1 tempest-CreateVolumesFromImageTest-646327476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-6e1e2cfe-9346-4142-8a35-38165e9ea954" returned: 0 in 0.916s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:54:42 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-2b68f599-697f-4c00-971e-ca33eaaae6b1 tempest-CreateVolumesFromImageTest-646327476 None] Lock "cinder-quobyte-6e1e2cfe-9346-4142-8a35-38165e9ea954" released by "delete_volume" :: held 2.279s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:54:42 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-2b68f599-697f-4c00-971e-ca33eaaae6b1 tempest-CreateVolumesFromImageTest-646327476 None] Created reservations ['11a006ae-7e33-47dc-a745-9ddefa6911c2', 'fb812490-83f5-4bf6-9f81-45f1a4f4673b', '57260196-9af5-4771-859a-8e4d81b7538b', 'fb7b4b1a-396c-452b-8206-9fa61928058f'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:54:42 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-2b68f599-697f-4c00-971e-ca33eaaae6b1 tempest-CreateVolumesFromImageTest-646327476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:54:42 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-2b68f599-697f-4c00-971e-ca33eaaae6b1 tempest-CreateVolumesFromImageTest-646327476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:54:42 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-2b68f599-697f-4c00-971e-ca33eaaae6b1 tempest-CreateVolumesFromImageTest-646327476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:54:42 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-2b68f599-697f-4c00-971e-ca33eaaae6b1 tempest-CreateVolumesFromImageTest-646327476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:54:42 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-2b68f599-697f-4c00-971e-ca33eaaae6b1 tempest-CreateVolumesFromImageTest-646327476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:54:42 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-2b68f599-697f-4c00-971e-ca33eaaae6b1 tempest-CreateVolumesFromImageTest-646327476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:54:43 devstack sudo[98938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:54:43 devstack sudo[98938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:54:43 devstack sudo[98897]: pam_unix(sudo:session): session closed for user root
Jun 15 15:54:43 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-307fd31f-9c54-4c9e-b5fc-c5c404efad66 req-369923b8-5892-45af-a6d6-cfa02e1a800d tempest-VolumesSnapshotsTestJSON-1649418515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e475e619-7354-41da-b1ba-71f322da2389,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e475e619-7354-41da-b1ba-71f322da2389.facf666f-d105-41a3-a3b7-4169314ae23e 1G" returned: 0 in 1.384s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:54:43 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-307fd31f-9c54-4c9e-b5fc-c5c404efad66 req-369923b8-5892-45af-a6d6-cfa02e1a800d tempest-VolumesSnapshotsTestJSON-1649418515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e475e619-7354-41da-b1ba-71f322da2389 -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e475e619-7354-41da-b1ba-71f322da2389.facf666f-d105-41a3-a3b7-4169314ae23e {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:54:43 devstack sudo[98944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e475e619-7354-41da-b1ba-71f322da2389 -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e475e619-7354-41da-b1ba-71f322da2389.facf666f-d105-41a3-a3b7-4169314ae23e
Jun 15 15:54:43 devstack sudo[98944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:54:43 devstack sudo[98938]: pam_unix(sudo:session): session closed for user root
Jun 15 15:54:43 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-2b68f599-697f-4c00-971e-ca33eaaae6b1 tempest-CreateVolumesFromImageTest-646327476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.826s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:54:43 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-2b68f599-697f-4c00-971e-ca33eaaae6b1 tempest-CreateVolumesFromImageTest-646327476 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:54:43 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-2b68f599-697f-4c00-971e-ca33eaaae6b1 tempest-CreateVolumesFromImageTest-646327476 None] Deleted volume successfully.
Jun 15 15:54:43 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-2b68f599-697f-4c00-971e-ca33eaaae6b1 tempest-CreateVolumesFromImageTest-646327476 None] Lock "cinder-6e1e2cfe-9346-4142-8a35-38165e9ea954-delete_volume" released by "delete_volume" :: held 3.450s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:54:44 devstack sudo[98944]: pam_unix(sudo:session): session closed for user root
Jun 15 15:54:44 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-307fd31f-9c54-4c9e-b5fc-c5c404efad66 req-369923b8-5892-45af-a6d6-cfa02e1a800d tempest-VolumesSnapshotsTestJSON-1649418515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e475e619-7354-41da-b1ba-71f322da2389 -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e475e619-7354-41da-b1ba-71f322da2389.facf666f-d105-41a3-a3b7-4169314ae23e" returned: 0 in 0.719s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:54:44 devstack cinder-volume[91863]: WARNING cinder.volume.drivers.remotefs [req-307fd31f-9c54-4c9e-b5fc-c5c404efad66 req-369923b8-5892-45af-a6d6-cfa02e1a800d tempest-VolumesSnapshotsTestJSON-1649418515 None] /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e475e619-7354-41da-b1ba-71f322da2389.facf666f-d105-41a3-a3b7-4169314ae23e is being set with open permissions: ugo+rw
Jun 15 15:54:44 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-307fd31f-9c54-4c9e-b5fc-c5c404efad66 req-369923b8-5892-45af-a6d6-cfa02e1a800d tempest-VolumesSnapshotsTestJSON-1649418515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e475e619-7354-41da-b1ba-71f322da2389.facf666f-d105-41a3-a3b7-4169314ae23e {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:54:44 devstack sudo[98956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e475e619-7354-41da-b1ba-71f322da2389.facf666f-d105-41a3-a3b7-4169314ae23e
Jun 15 15:54:44 devstack sudo[98956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:54:44 devstack sudo[98956]: pam_unix(sudo:session): session closed for user root
Jun 15 15:54:44 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-307fd31f-9c54-4c9e-b5fc-c5c404efad66 req-369923b8-5892-45af-a6d6-cfa02e1a800d tempest-VolumesSnapshotsTestJSON-1649418515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e475e619-7354-41da-b1ba-71f322da2389.facf666f-d105-41a3-a3b7-4169314ae23e" returned: 0 in 0.748s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:54:44 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-307fd31f-9c54-4c9e-b5fc-c5c404efad66 req-369923b8-5892-45af-a6d6-cfa02e1a800d tempest-VolumesSnapshotsTestJSON-1649418515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e475e619-7354-41da-b1ba-71f322da2389.info {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:54:44 devstack sudo[98961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e475e619-7354-41da-b1ba-71f322da2389.info
Jun 15 15:54:44 devstack sudo[98961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:54:45 devstack sudo[98961]: pam_unix(sudo:session): session closed for user root
Jun 15 15:54:45 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-307fd31f-9c54-4c9e-b5fc-c5c404efad66 req-369923b8-5892-45af-a6d6-cfa02e1a800d tempest-VolumesSnapshotsTestJSON-1649418515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e475e619-7354-41da-b1ba-71f322da2389.info" returned: 0 in 0.743s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:54:45 devstack cinder-volume[91863]: WARNING cinder.volume.drivers.remotefs [req-307fd31f-9c54-4c9e-b5fc-c5c404efad66 req-369923b8-5892-45af-a6d6-cfa02e1a800d tempest-VolumesSnapshotsTestJSON-1649418515 None] /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e475e619-7354-41da-b1ba-71f322da2389.info is being set with open permissions: ugo+rw
Jun 15 15:54:45 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-307fd31f-9c54-4c9e-b5fc-c5c404efad66 req-369923b8-5892-45af-a6d6-cfa02e1a800d tempest-VolumesSnapshotsTestJSON-1649418515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e475e619-7354-41da-b1ba-71f322da2389.info {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:54:45 devstack sudo[98966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e475e619-7354-41da-b1ba-71f322da2389.info
Jun 15 15:54:45 devstack sudo[98966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:54:45 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc3858ef-f414-4509-b6c2-838f991d2301 tempest-AttachVolumeNegativeTest-1849283913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 15:54:45 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-cc3858ef-f414-4509-b6c2-838f991d2301 tempest-AttachVolumeNegativeTest-1849283913 None] Flow 'volume_create_manager' (446e3787-6107-4078-94c6-75a80913f759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:54:45 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-cc3858ef-f414-4509-b6c2-838f991d2301 tempest-AttachVolumeNegativeTest-1849283913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28204722-25b0-4aa9-a76c-a81f69459c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:54:45 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-cc3858ef-f414-4509-b6c2-838f991d2301 tempest-AttachVolumeNegativeTest-1849283913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28204722-25b0-4aa9-a76c-a81f69459c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:54:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1726247929',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61afa8b6-adb7-49da-905b-587d2f9d9743,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3be7c3abe8246a2a9f68c6f49a031c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:54:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:54:46Z,use_quota=True,user_id='2ec357fde37a4761a6fc47aa552d9567',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:54:45 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-cc3858ef-f414-4509-b6c2-838f991d2301 tempest-AttachVolumeNegativeTest-1849283913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a2f38a2-c8e9-4f65-b2e1-9ffbf6163c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:54:45 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-cc3858ef-f414-4509-b6c2-838f991d2301 tempest-AttachVolumeNegativeTest-1849283913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a2f38a2-c8e9-4f65-b2e1-9ffbf6163c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:54:45 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-cc3858ef-f414-4509-b6c2-838f991d2301 tempest-AttachVolumeNegativeTest-1849283913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e37c500b-a5b6-46b8-bae2-82f3421d3e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:54:45 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-cc3858ef-f414-4509-b6c2-838f991d2301 tempest-AttachVolumeNegativeTest-1849283913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e37c500b-a5b6-46b8-bae2-82f3421d3e59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61afa8b6-adb7-49da-905b-587d2f9d9743', 'volume_name': 'volume-61afa8b6-adb7-49da-905b-587d2f9d9743', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:54:45 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-cc3858ef-f414-4509-b6c2-838f991d2301 tempest-AttachVolumeNegativeTest-1849283913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4513a5f4-ef7a-4e5e-9730-5ec4287280d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:54:45 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-cc3858ef-f414-4509-b6c2-838f991d2301 tempest-AttachVolumeNegativeTest-1849283913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4513a5f4-ef7a-4e5e-9730-5ec4287280d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:54:45 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-cc3858ef-f414-4509-b6c2-838f991d2301 tempest-AttachVolumeNegativeTest-1849283913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ddbbbe8-7762-429c-8157-41d1a3d381c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:54:45 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-cc3858ef-f414-4509-b6c2-838f991d2301 tempest-AttachVolumeNegativeTest-1849283913 None] Volume 61afa8b6-adb7-49da-905b-587d2f9d9743: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61afa8b6-adb7-49da-905b-587d2f9d9743', 'volume_size': 1}
Jun 15 15:54:45 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-cc3858ef-f414-4509-b6c2-838f991d2301 tempest-AttachVolumeNegativeTest-1849283913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:54:46 devstack sudo[98966]: pam_unix(sudo:session): session closed for user root
Jun 15 15:54:46 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-307fd31f-9c54-4c9e-b5fc-c5c404efad66 req-369923b8-5892-45af-a6d6-cfa02e1a800d tempest-VolumesSnapshotsTestJSON-1649418515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e475e619-7354-41da-b1ba-71f322da2389.info" returned: 0 in 0.697s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:54:46 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [req-307fd31f-9c54-4c9e-b5fc-c5c404efad66 req-369923b8-5892-45af-a6d6-cfa02e1a800d tempest-VolumesSnapshotsTestJSON-1649418515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.666s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:54:46 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-cc3858ef-f414-4509-b6c2-838f991d2301 tempest-AttachVolumeNegativeTest-1849283913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.364s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:54:46 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-cc3858ef-f414-4509-b6c2-838f991d2301 tempest-AttachVolumeNegativeTest-1849283913 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:54:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1726247929',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61afa8b6-adb7-49da-905b-587d2f9d9743,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3be7c3abe8246a2a9f68c6f49a031c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:54:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:54:46Z,use_quota=True,user_id='2ec357fde37a4761a6fc47aa552d9567',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 15:54:46 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-cc3858ef-f414-4509-b6c2-838f991d2301 tempest-AttachVolumeNegativeTest-1849283913 None] Creating volume 61afa8b6-adb7-49da-905b-587d2f9d9743 {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 15:54:46 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-cc3858ef-f414-4509-b6c2-838f991d2301 tempest-AttachVolumeNegativeTest-1849283913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:54:46 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-cc3858ef-f414-4509-b6c2-838f991d2301 tempest-AttachVolumeNegativeTest-1849283913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:54:46 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-cc3858ef-f414-4509-b6c2-838f991d2301 tempest-AttachVolumeNegativeTest-1849283913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:54:46 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-cc3858ef-f414-4509-b6c2-838f991d2301 tempest-AttachVolumeNegativeTest-1849283913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:54:46 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-cc3858ef-f414-4509-b6c2-838f991d2301 tempest-AttachVolumeNegativeTest-1849283913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:54:46 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-cc3858ef-f414-4509-b6c2-838f991d2301 tempest-AttachVolumeNegativeTest-1849283913 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 15:54:46 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-cc3858ef-f414-4509-b6c2-838f991d2301 tempest-AttachVolumeNegativeTest-1849283913 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 15:54:46 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-cc3858ef-f414-4509-b6c2-838f991d2301 tempest-AttachVolumeNegativeTest-1849283913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-61afa8b6-adb7-49da-905b-587d2f9d9743 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:54:46 devstack sudo[98969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-61afa8b6-adb7-49da-905b-587d2f9d9743 1073741824
Jun 15 15:54:46 devstack sudo[98969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:54:46 devstack cinder-volume[91863]: INFO cinder.volume.manager [req-307fd31f-9c54-4c9e-b5fc-c5c404efad66 req-369923b8-5892-45af-a6d6-cfa02e1a800d tempest-VolumesSnapshotsTestJSON-1649418515 None] Create snapshot completed successfully
Jun 15 15:54:47 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5e2a041-601d-4f55-ad63-624d1deebf87 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 15:54:47 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e5e2a041-601d-4f55-ad63-624d1deebf87 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Flow 'volume_create_manager' (7be32179-549d-4046-b603-a060acee33df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:54:47 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e5e2a041-601d-4f55-ad63-624d1deebf87 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e0ff1bf-a29b-4556-b351-c79a71349fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:54:47 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e5e2a041-601d-4f55-ad63-624d1deebf87 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e0ff1bf-a29b-4556-b351-c79a71349fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:54:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-375686050',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cb29941-8cb1-4790-85ab-369cb1352144,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb071ea7e8fa424493aabd0fd714a736',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:54:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:54:47Z,use_quota=True,user_id='1858c21dffbc467188dadbacba3f16fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:54:47 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e5e2a041-601d-4f55-ad63-624d1deebf87 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (140be394-de0e-4ad3-9538-eaadfce1ffda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:54:47 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e5e2a041-601d-4f55-ad63-624d1deebf87 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (140be394-de0e-4ad3-9538-eaadfce1ffda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:54:47 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e5e2a041-601d-4f55-ad63-624d1deebf87 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d6d9e4b-4bc0-4cae-903a-4c6609a1a416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:54:47 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e5e2a041-601d-4f55-ad63-624d1deebf87 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d6d9e4b-4bc0-4cae-903a-4c6609a1a416) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cb29941-8cb1-4790-85ab-369cb1352144', 'volume_name': 'volume-4cb29941-8cb1-4790-85ab-369cb1352144', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:54:47 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e5e2a041-601d-4f55-ad63-624d1deebf87 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (088ca6c6-e324-440b-8e05-219450b7b0ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:54:47 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e5e2a041-601d-4f55-ad63-624d1deebf87 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (088ca6c6-e324-440b-8e05-219450b7b0ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:54:47 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e5e2a041-601d-4f55-ad63-624d1deebf87 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0e79971-aff9-4418-9437-ce05d66eb2fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:54:47 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-e5e2a041-601d-4f55-ad63-624d1deebf87 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Volume 4cb29941-8cb1-4790-85ab-369cb1352144: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cb29941-8cb1-4790-85ab-369cb1352144', 'volume_size': 1}
Jun 15 15:54:47 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-e5e2a041-601d-4f55-ad63-624d1deebf87 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:54:47 devstack sudo[98969]: pam_unix(sudo:session): session closed for user root
Jun 15 15:54:47 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-cc3858ef-f414-4509-b6c2-838f991d2301 tempest-AttachVolumeNegativeTest-1849283913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-61afa8b6-adb7-49da-905b-587d2f9d9743 1073741824" returned: 0 in 0.875s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:54:47 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-cc3858ef-f414-4509-b6c2-838f991d2301 tempest-AttachVolumeNegativeTest-1849283913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-61afa8b6-adb7-49da-905b-587d2f9d9743 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:54:47 devstack sudo[98974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-61afa8b6-adb7-49da-905b-587d2f9d9743
Jun 15 15:54:47 devstack sudo[98974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:54:47 devstack cinder-volume[91863]: DEBUG cinder.coordination [req-a2c85626-ccbb-40bb-9bf8-2a02bdac3f48 req-c929a6e4-2eb5-4f1c-be6d-4bc9284cecef tempest-VolumesSnapshotsTestJSON-1649418515 None] Acquiring lock "cinder-facf666f-d105-41a3-a3b7-4169314ae23e-delete_snapshot" by "delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:54:47 devstack cinder-volume[91863]: DEBUG cinder.coordination [req-a2c85626-ccbb-40bb-9bf8-2a02bdac3f48 req-c929a6e4-2eb5-4f1c-be6d-4bc9284cecef tempest-VolumesSnapshotsTestJSON-1649418515 None] Lock "cinder-facf666f-d105-41a3-a3b7-4169314ae23e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:54:47 devstack cinder-volume[91863]: DEBUG cinder.coordination [req-a2c85626-ccbb-40bb-9bf8-2a02bdac3f48 req-c929a6e4-2eb5-4f1c-be6d-4bc9284cecef tempest-VolumesSnapshotsTestJSON-1649418515 None] Acquiring lock "cinder-quobyte-e475e619-7354-41da-b1ba-71f322da2389" by "delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:54:47 devstack cinder-volume[91863]: DEBUG cinder.coordination [req-a2c85626-ccbb-40bb-9bf8-2a02bdac3f48 req-c929a6e4-2eb5-4f1c-be6d-4bc9284cecef tempest-VolumesSnapshotsTestJSON-1649418515 None] Lock "cinder-quobyte-e475e619-7354-41da-b1ba-71f322da2389" acquired by "delete_snapshot" :: waited 0.021s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:54:47 devstack cinder-volume[91863]: DEBUG cinder.coordination [req-a2c85626-ccbb-40bb-9bf8-2a02bdac3f48 req-c929a6e4-2eb5-4f1c-be6d-4bc9284cecef tempest-VolumesSnapshotsTestJSON-1649418515 None] Acquiring lock "cinder-quobyte-facf666f-d105-41a3-a3b7-4169314ae23e" by "_delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:54:47 devstack cinder-volume[91863]: DEBUG cinder.coordination [req-a2c85626-ccbb-40bb-9bf8-2a02bdac3f48 req-c929a6e4-2eb5-4f1c-be6d-4bc9284cecef tempest-VolumesSnapshotsTestJSON-1649418515 None] Lock "cinder-quobyte-facf666f-d105-41a3-a3b7-4169314ae23e" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:54:47 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [req-a2c85626-ccbb-40bb-9bf8-2a02bdac3f48 req-c929a6e4-2eb5-4f1c-be6d-4bc9284cecef tempest-VolumesSnapshotsTestJSON-1649418515 None] Deleting offline snapshot facf666f-d105-41a3-a3b7-4169314ae23e of volume e475e619-7354-41da-b1ba-71f322da2389 {{(pid=91863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 15 15:54:47 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [req-a2c85626-ccbb-40bb-9bf8-2a02bdac3f48 req-c929a6e4-2eb5-4f1c-be6d-4bc9284cecef tempest-VolumesSnapshotsTestJSON-1649418515 None] snapshot_file for this snap is: volume-e475e619-7354-41da-b1ba-71f322da2389.facf666f-d105-41a3-a3b7-4169314ae23e {{(pid=91863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 15 15:54:47 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7cbaca2-f4b2-4d5b-a95e-3d27e812f29b]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:54:47 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-a2c85626-ccbb-40bb-9bf8-2a02bdac3f48 req-c929a6e4-2eb5-4f1c-be6d-4bc9284cecef tempest-VolumesSnapshotsTestJSON-1649418515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e475e619-7354-41da-b1ba-71f322da2389.facf666f-d105-41a3-a3b7-4169314ae23e {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:54:47 devstack sudo[98976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e475e619-7354-41da-b1ba-71f322da2389.facf666f-d105-41a3-a3b7-4169314ae23e
Jun 15 15:54:47 devstack sudo[98976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:54:47 devstack sudo[98974]: pam_unix(sudo:session): session closed for user root
Jun 15 15:54:47 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-cc3858ef-f414-4509-b6c2-838f991d2301 tempest-AttachVolumeNegativeTest-1849283913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-61afa8b6-adb7-49da-905b-587d2f9d9743" returned: 0 in 0.615s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:54:47 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-cc3858ef-f414-4509-b6c2-838f991d2301 tempest-AttachVolumeNegativeTest-1849283913 None] <== create_volume: return (1530ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 15:54:47 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-cc3858ef-f414-4509-b6c2-838f991d2301 tempest-AttachVolumeNegativeTest-1849283913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.534s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:54:47 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-e5e2a041-601d-4f55-ad63-624d1deebf87 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.697s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:54:47 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-e5e2a041-601d-4f55-ad63-624d1deebf87 tempest-CreateVolumesFromSnapshotTest-2024832147 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:54:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-375686050',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cb29941-8cb1-4790-85ab-369cb1352144,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb071ea7e8fa424493aabd0fd714a736',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:54:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:54:47Z,use_quota=True,user_id='1858c21dffbc467188dadbacba3f16fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 15:54:47 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-e5e2a041-601d-4f55-ad63-624d1deebf87 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Creating volume 4cb29941-8cb1-4790-85ab-369cb1352144 {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 15:54:47 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-e5e2a041-601d-4f55-ad63-624d1deebf87 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:54:47 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-e5e2a041-601d-4f55-ad63-624d1deebf87 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:54:47 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-e5e2a041-601d-4f55-ad63-624d1deebf87 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:54:47 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-e5e2a041-601d-4f55-ad63-624d1deebf87 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:54:47 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-e5e2a041-601d-4f55-ad63-624d1deebf87 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:54:47 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-e5e2a041-601d-4f55-ad63-624d1deebf87 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 15:54:47 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-e5e2a041-601d-4f55-ad63-624d1deebf87 tempest-CreateVolumesFromSnapshotTest-2024832147 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 15:54:47 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-e5e2a041-601d-4f55-ad63-624d1deebf87 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4cb29941-8cb1-4790-85ab-369cb1352144 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:54:47 devstack sudo[98979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4cb29941-8cb1-4790-85ab-369cb1352144 1073741824
Jun 15 15:54:47 devstack sudo[98979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:54:47 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-cc3858ef-f414-4509-b6c2-838f991d2301 tempest-AttachVolumeNegativeTest-1849283913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ddbbbe8-7762-429c-8157-41d1a3d381c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61afa8b6-adb7-49da-905b-587d2f9d9743', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:54:47 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-cc3858ef-f414-4509-b6c2-838f991d2301 tempest-AttachVolumeNegativeTest-1849283913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fcc2ddc-43a5-4716-8ee7-ee8944f510c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:54:48 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-cc3858ef-f414-4509-b6c2-838f991d2301 tempest-AttachVolumeNegativeTest-1849283913 None] Volume volume-61afa8b6-adb7-49da-905b-587d2f9d9743 (61afa8b6-adb7-49da-905b-587d2f9d9743): created successfully
Jun 15 15:54:48 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-cc3858ef-f414-4509-b6c2-838f991d2301 tempest-AttachVolumeNegativeTest-1849283913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fcc2ddc-43a5-4716-8ee7-ee8944f510c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:54:48 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-cc3858ef-f414-4509-b6c2-838f991d2301 tempest-AttachVolumeNegativeTest-1849283913 None] Flow 'volume_create_manager' (446e3787-6107-4078-94c6-75a80913f759) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:54:48 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-cc3858ef-f414-4509-b6c2-838f991d2301 tempest-AttachVolumeNegativeTest-1849283913 None] Created volume successfully.
Jun 15 15:54:48 devstack sudo[98976]: pam_unix(sudo:session): session closed for user root
Jun 15 15:54:48 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-a2c85626-ccbb-40bb-9bf8-2a02bdac3f48 req-c929a6e4-2eb5-4f1c-be6d-4bc9284cecef tempest-VolumesSnapshotsTestJSON-1649418515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e475e619-7354-41da-b1ba-71f322da2389.facf666f-d105-41a3-a3b7-4169314ae23e" returned: 0 in 0.892s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:54:48 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [req-a2c85626-ccbb-40bb-9bf8-2a02bdac3f48 req-c929a6e4-2eb5-4f1c-be6d-4bc9284cecef tempest-VolumesSnapshotsTestJSON-1649418515 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e475e619-7354-41da-b1ba-71f322da2389(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 15:54:48 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e24ca6b5-cefd-4555-85e9-1a97105807e1]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:54:48 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-a2c85626-ccbb-40bb-9bf8-2a02bdac3f48 req-c929a6e4-2eb5-4f1c-be6d-4bc9284cecef tempest-VolumesSnapshotsTestJSON-1649418515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e475e619-7354-41da-b1ba-71f322da2389 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:54:48 devstack sudo[98988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e475e619-7354-41da-b1ba-71f322da2389
Jun 15 15:54:48 devstack sudo[98988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:54:48 devstack sudo[98979]: pam_unix(sudo:session): session closed for user root
Jun 15 15:54:48 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-e5e2a041-601d-4f55-ad63-624d1deebf87 tempest-CreateVolumesFromSnapshotTest-2024832147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4cb29941-8cb1-4790-85ab-369cb1352144 1073741824" returned: 0 in 0.923s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:54:48 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-e5e2a041-601d-4f55-ad63-624d1deebf87 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4cb29941-8cb1-4790-85ab-369cb1352144 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:54:48 devstack sudo[98991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4cb29941-8cb1-4790-85ab-369cb1352144
Jun 15 15:54:48 devstack sudo[98991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:54:49 devstack sudo[98988]: pam_unix(sudo:session): session closed for user root
Jun 15 15:54:49 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-a2c85626-ccbb-40bb-9bf8-2a02bdac3f48 req-c929a6e4-2eb5-4f1c-be6d-4bc9284cecef tempest-VolumesSnapshotsTestJSON-1649418515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e475e619-7354-41da-b1ba-71f322da2389" returned: 0 in 0.890s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:54:49 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-a2c85626-ccbb-40bb-9bf8-2a02bdac3f48 req-c929a6e4-2eb5-4f1c-be6d-4bc9284cecef tempest-VolumesSnapshotsTestJSON-1649418515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e475e619-7354-41da-b1ba-71f322da2389.facf666f-d105-41a3-a3b7-4169314ae23e {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:54:49 devstack sudo[98998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e475e619-7354-41da-b1ba-71f322da2389.facf666f-d105-41a3-a3b7-4169314ae23e
Jun 15 15:54:49 devstack sudo[98998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:54:49 devstack sudo[98991]: pam_unix(sudo:session): session closed for user root
Jun 15 15:54:49 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-e5e2a041-601d-4f55-ad63-624d1deebf87 tempest-CreateVolumesFromSnapshotTest-2024832147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4cb29941-8cb1-4790-85ab-369cb1352144" returned: 0 in 0.703s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:54:49 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-e5e2a041-601d-4f55-ad63-624d1deebf87 tempest-CreateVolumesFromSnapshotTest-2024832147 None] <== create_volume: return (1689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 15:54:49 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-e5e2a041-601d-4f55-ad63-624d1deebf87 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.694s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:54:49 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e5e2a041-601d-4f55-ad63-624d1deebf87 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0e79971-aff9-4418-9437-ce05d66eb2fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cb29941-8cb1-4790-85ab-369cb1352144', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:54:49 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e5e2a041-601d-4f55-ad63-624d1deebf87 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0baf5f8c-8809-4763-9203-b766dd2c100c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:54:49 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-e5e2a041-601d-4f55-ad63-624d1deebf87 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Volume volume-4cb29941-8cb1-4790-85ab-369cb1352144 (4cb29941-8cb1-4790-85ab-369cb1352144): created successfully
Jun 15 15:54:49 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e5e2a041-601d-4f55-ad63-624d1deebf87 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0baf5f8c-8809-4763-9203-b766dd2c100c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:54:49 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e5e2a041-601d-4f55-ad63-624d1deebf87 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Flow 'volume_create_manager' (7be32179-549d-4046-b603-a060acee33df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:54:49 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-e5e2a041-601d-4f55-ad63-624d1deebf87 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Created volume successfully.
Jun 15 15:54:50 devstack sudo[98998]: pam_unix(sudo:session): session closed for user root
Jun 15 15:54:50 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-a2c85626-ccbb-40bb-9bf8-2a02bdac3f48 req-c929a6e4-2eb5-4f1c-be6d-4bc9284cecef tempest-VolumesSnapshotsTestJSON-1649418515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e475e619-7354-41da-b1ba-71f322da2389.facf666f-d105-41a3-a3b7-4169314ae23e" returned: 0 in 0.724s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:54:50 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-a2c85626-ccbb-40bb-9bf8-2a02bdac3f48 req-c929a6e4-2eb5-4f1c-be6d-4bc9284cecef tempest-VolumesSnapshotsTestJSON-1649418515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e475e619-7354-41da-b1ba-71f322da2389.facf666f-d105-41a3-a3b7-4169314ae23e {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:54:50 devstack sudo[99004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e475e619-7354-41da-b1ba-71f322da2389.facf666f-d105-41a3-a3b7-4169314ae23e
Jun 15 15:54:50 devstack sudo[99004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:54:50 devstack cinder-volume[91863]: DEBUG dbcounter [-] [91863] Writing DB stats cinder:SELECT=87,cinder:UPDATE=126,cinder:INSERT=27,cinder:DELETE=13 {{(pid=91863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 15:54:50 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-04a6efff-dc27-49d2-922a-611e90e86c15 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:54:50 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-04a6efff-dc27-49d2-922a-611e90e86c15 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:54:50 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-04a6efff-dc27-49d2-922a-611e90e86c15 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Creating offline snapshot 487e6706-9a09-42be-8194-07061803f676 of volume 4cb29941-8cb1-4790-85ab-369cb1352144 {{(pid=91863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 15 15:54:50 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5110a072-0f8f-4482-b778-4b5f68909dc6]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:54:50 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-04a6efff-dc27-49d2-922a-611e90e86c15 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4cb29941-8cb1-4790-85ab-369cb1352144 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:54:50 devstack sudo[99006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4cb29941-8cb1-4790-85ab-369cb1352144
Jun 15 15:54:50 devstack sudo[99006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:54:50 devstack sudo[99004]: pam_unix(sudo:session): session closed for user root
Jun 15 15:54:50 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-a2c85626-ccbb-40bb-9bf8-2a02bdac3f48 req-c929a6e4-2eb5-4f1c-be6d-4bc9284cecef tempest-VolumesSnapshotsTestJSON-1649418515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e475e619-7354-41da-b1ba-71f322da2389.facf666f-d105-41a3-a3b7-4169314ae23e" returned: 0 in 0.679s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:54:50 devstack cinder-volume[91863]: DEBUG cinder.coordination [req-a2c85626-ccbb-40bb-9bf8-2a02bdac3f48 req-c929a6e4-2eb5-4f1c-be6d-4bc9284cecef tempest-VolumesSnapshotsTestJSON-1649418515 None] Lock "cinder-quobyte-facf666f-d105-41a3-a3b7-4169314ae23e" released by "_delete_snapshot" :: held 3.319s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:54:50 devstack cinder-volume[91863]: DEBUG cinder.coordination [req-a2c85626-ccbb-40bb-9bf8-2a02bdac3f48 req-c929a6e4-2eb5-4f1c-be6d-4bc9284cecef tempest-VolumesSnapshotsTestJSON-1649418515 None] Lock "cinder-quobyte-e475e619-7354-41da-b1ba-71f322da2389" released by "delete_snapshot" :: held 3.345s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:54:50 devstack cinder-volume[91863]: DEBUG dbcounter [-] [91863] Writing DB stats cinder:UPDATE=118,cinder:INSERT=30,cinder:DELETE=10,cinder:SELECT=84 {{(pid=91863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 15:54:51 devstack cinder-volume[91863]: DEBUG cinder.quota [req-a2c85626-ccbb-40bb-9bf8-2a02bdac3f48 req-c929a6e4-2eb5-4f1c-be6d-4bc9284cecef tempest-VolumesSnapshotsTestJSON-1649418515 None] Created reservations ['732d9317-67a9-442a-b7b8-5448fd93867c', '0efe0a37-dece-4de9-8732-bd32cb274414', '531a4ef9-0a83-4def-88b1-a20c968684a6', '73bd2de3-1f33-4fa1-9ff0-e75cf355a901'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:54:51 devstack cinder-volume[91863]: INFO cinder.volume.manager [req-a2c85626-ccbb-40bb-9bf8-2a02bdac3f48 req-c929a6e4-2eb5-4f1c-be6d-4bc9284cecef tempest-VolumesSnapshotsTestJSON-1649418515 None] Delete snapshot completed successfully.
Jun 15 15:54:51 devstack cinder-volume[91863]: DEBUG cinder.coordination [req-a2c85626-ccbb-40bb-9bf8-2a02bdac3f48 req-c929a6e4-2eb5-4f1c-be6d-4bc9284cecef tempest-VolumesSnapshotsTestJSON-1649418515 None] Lock "cinder-facf666f-d105-41a3-a3b7-4169314ae23e-delete_snapshot" released by "delete_snapshot" :: held 3.504s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:54:51 devstack sudo[99006]: pam_unix(sudo:session): session closed for user root
Jun 15 15:54:51 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-04a6efff-dc27-49d2-922a-611e90e86c15 tempest-CreateVolumesFromSnapshotTest-2024832147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4cb29941-8cb1-4790-85ab-369cb1352144" returned: 0 in 0.854s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:54:51 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-04a6efff-dc27-49d2-922a-611e90e86c15 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4cb29941-8cb1-4790-85ab-369cb1352144,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4cb29941-8cb1-4790-85ab-369cb1352144.487e6706-9a09-42be-8194-07061803f676 1G {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:54:51 devstack sudo[99015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4cb29941-8cb1-4790-85ab-369cb1352144,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4cb29941-8cb1-4790-85ab-369cb1352144.487e6706-9a09-42be-8194-07061803f676 1G
Jun 15 15:54:51 devstack sudo[99015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:54:51 devstack cinder-volume[91863]: DEBUG cinder.coordination [req-814b830d-6923-4df9-ae4a-70fd93b453ee req-ca43047a-cef2-40be-bdf6-fd1234af1d83 tempest-VolumesSnapshotsTestJSON-1649418515 None] Acquiring lock "cinder-e475e619-7354-41da-b1ba-71f322da2389-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:54:52 devstack cinder-volume[91863]: DEBUG cinder.coordination [req-814b830d-6923-4df9-ae4a-70fd93b453ee req-ca43047a-cef2-40be-bdf6-fd1234af1d83 tempest-VolumesSnapshotsTestJSON-1649418515 None] Lock "cinder-e475e619-7354-41da-b1ba-71f322da2389-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:54:52 devstack cinder-volume[91863]: DEBUG cinder.coordination [req-814b830d-6923-4df9-ae4a-70fd93b453ee req-ca43047a-cef2-40be-bdf6-fd1234af1d83 tempest-VolumesSnapshotsTestJSON-1649418515 None] Acquiring lock "cinder-quobyte-e475e619-7354-41da-b1ba-71f322da2389" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:54:52 devstack cinder-volume[91863]: DEBUG cinder.coordination [req-814b830d-6923-4df9-ae4a-70fd93b453ee req-ca43047a-cef2-40be-bdf6-fd1234af1d83 tempest-VolumesSnapshotsTestJSON-1649418515 None] Lock "cinder-quobyte-e475e619-7354-41da-b1ba-71f322da2389" acquired by "delete_volume" :: waited 0.017s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:54:52 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[141818fb-8783-4dd5-b61d-686f53f9eebf]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:54:52 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-814b830d-6923-4df9-ae4a-70fd93b453ee req-ca43047a-cef2-40be-bdf6-fd1234af1d83 tempest-VolumesSnapshotsTestJSON-1649418515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e475e619-7354-41da-b1ba-71f322da2389 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:54:52 devstack sudo[99017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e475e619-7354-41da-b1ba-71f322da2389
Jun 15 15:54:52 devstack sudo[99017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:54:52 devstack sudo[99015]: pam_unix(sudo:session): session closed for user root
Jun 15 15:54:52 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-04a6efff-dc27-49d2-922a-611e90e86c15 tempest-CreateVolumesFromSnapshotTest-2024832147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4cb29941-8cb1-4790-85ab-369cb1352144,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4cb29941-8cb1-4790-85ab-369cb1352144.487e6706-9a09-42be-8194-07061803f676 1G" returned: 0 in 1.040s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:54:52 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-04a6efff-dc27-49d2-922a-611e90e86c15 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cb29941-8cb1-4790-85ab-369cb1352144 -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4cb29941-8cb1-4790-85ab-369cb1352144.487e6706-9a09-42be-8194-07061803f676 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:54:52 devstack sudo[99032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cb29941-8cb1-4790-85ab-369cb1352144 -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4cb29941-8cb1-4790-85ab-369cb1352144.487e6706-9a09-42be-8194-07061803f676
Jun 15 15:54:52 devstack sudo[99032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:54:52 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [req-3c84bf96-f222-449e-ace9-30e07de62ae7 req-a2f3e9e3-8a21-4f56-8447-d0ed85ef0e98 tempest-AttachVolumeNegativeTest-1849283913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:54:53 devstack sudo[99017]: pam_unix(sudo:session): session closed for user root
Jun 15 15:54:53 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-814b830d-6923-4df9-ae4a-70fd93b453ee req-ca43047a-cef2-40be-bdf6-fd1234af1d83 tempest-VolumesSnapshotsTestJSON-1649418515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e475e619-7354-41da-b1ba-71f322da2389" returned: 0 in 0.910s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:54:53 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-814b830d-6923-4df9-ae4a-70fd93b453ee req-ca43047a-cef2-40be-bdf6-fd1234af1d83 tempest-VolumesSnapshotsTestJSON-1649418515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e475e619-7354-41da-b1ba-71f322da2389 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:54:53 devstack sudo[99037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e475e619-7354-41da-b1ba-71f322da2389
Jun 15 15:54:53 devstack sudo[99037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:54:53 devstack sudo[99032]: pam_unix(sudo:session): session closed for user root
Jun 15 15:54:53 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-04a6efff-dc27-49d2-922a-611e90e86c15 tempest-CreateVolumesFromSnapshotTest-2024832147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cb29941-8cb1-4790-85ab-369cb1352144 -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4cb29941-8cb1-4790-85ab-369cb1352144.487e6706-9a09-42be-8194-07061803f676" returned: 0 in 0.735s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:54:53 devstack cinder-volume[91863]: WARNING cinder.volume.drivers.remotefs [None req-04a6efff-dc27-49d2-922a-611e90e86c15 tempest-CreateVolumesFromSnapshotTest-2024832147 None] /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4cb29941-8cb1-4790-85ab-369cb1352144.487e6706-9a09-42be-8194-07061803f676 is being set with open permissions: ugo+rw
Jun 15 15:54:53 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-04a6efff-dc27-49d2-922a-611e90e86c15 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4cb29941-8cb1-4790-85ab-369cb1352144.487e6706-9a09-42be-8194-07061803f676 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:54:53 devstack sudo[99043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4cb29941-8cb1-4790-85ab-369cb1352144.487e6706-9a09-42be-8194-07061803f676
Jun 15 15:54:53 devstack sudo[99043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:54:53 devstack sudo[99037]: pam_unix(sudo:session): session closed for user root
Jun 15 15:54:53 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-814b830d-6923-4df9-ae4a-70fd93b453ee req-ca43047a-cef2-40be-bdf6-fd1234af1d83 tempest-VolumesSnapshotsTestJSON-1649418515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e475e619-7354-41da-b1ba-71f322da2389" returned: 0 in 0.681s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:54:53 devstack cinder-volume[91863]: DEBUG cinder.coordination [req-814b830d-6923-4df9-ae4a-70fd93b453ee req-ca43047a-cef2-40be-bdf6-fd1234af1d83 tempest-VolumesSnapshotsTestJSON-1649418515 None] Lock "cinder-quobyte-e475e619-7354-41da-b1ba-71f322da2389" released by "delete_volume" :: held 1.662s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:54:53 devstack cinder-volume[91863]: DEBUG cinder.quota [req-814b830d-6923-4df9-ae4a-70fd93b453ee req-ca43047a-cef2-40be-bdf6-fd1234af1d83 tempest-VolumesSnapshotsTestJSON-1649418515 None] Created reservations ['f820e760-772a-46ee-932b-285b3bf3edb6', 'c4e769f2-8d90-4c79-a1db-7baca484ed4e', 'e491669d-cce2-47bb-a060-113607425acf', '014a350f-f592-47ee-b064-6440738442fc'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:54:53 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [req-814b830d-6923-4df9-ae4a-70fd93b453ee req-ca43047a-cef2-40be-bdf6-fd1234af1d83 tempest-VolumesSnapshotsTestJSON-1649418515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:54:53 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [req-814b830d-6923-4df9-ae4a-70fd93b453ee req-ca43047a-cef2-40be-bdf6-fd1234af1d83 tempest-VolumesSnapshotsTestJSON-1649418515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:54:53 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [req-814b830d-6923-4df9-ae4a-70fd93b453ee req-ca43047a-cef2-40be-bdf6-fd1234af1d83 tempest-VolumesSnapshotsTestJSON-1649418515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:54:53 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [req-814b830d-6923-4df9-ae4a-70fd93b453ee req-ca43047a-cef2-40be-bdf6-fd1234af1d83 tempest-VolumesSnapshotsTestJSON-1649418515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:54:53 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [req-814b830d-6923-4df9-ae4a-70fd93b453ee req-ca43047a-cef2-40be-bdf6-fd1234af1d83 tempest-VolumesSnapshotsTestJSON-1649418515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:54:53 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-814b830d-6923-4df9-ae4a-70fd93b453ee req-ca43047a-cef2-40be-bdf6-fd1234af1d83 tempest-VolumesSnapshotsTestJSON-1649418515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:54:53 devstack sudo[99046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:54:53 devstack sudo[99046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:54:54 devstack sudo[99043]: pam_unix(sudo:session): session closed for user root
Jun 15 15:54:54 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-04a6efff-dc27-49d2-922a-611e90e86c15 tempest-CreateVolumesFromSnapshotTest-2024832147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4cb29941-8cb1-4790-85ab-369cb1352144.487e6706-9a09-42be-8194-07061803f676" returned: 0 in 0.696s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:54:54 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-04a6efff-dc27-49d2-922a-611e90e86c15 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4cb29941-8cb1-4790-85ab-369cb1352144.info {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:54:54 devstack sudo[99049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4cb29941-8cb1-4790-85ab-369cb1352144.info
Jun 15 15:54:54 devstack sudo[99049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:54:54 devstack sudo[99046]: pam_unix(sudo:session): session closed for user root
Jun 15 15:54:54 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-814b830d-6923-4df9-ae4a-70fd93b453ee req-ca43047a-cef2-40be-bdf6-fd1234af1d83 tempest-VolumesSnapshotsTestJSON-1649418515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.712s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:54:54 devstack cinder-volume[91863]: DEBUG cinder.manager [req-814b830d-6923-4df9-ae4a-70fd93b453ee req-ca43047a-cef2-40be-bdf6-fd1234af1d83 tempest-VolumesSnapshotsTestJSON-1649418515 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:54:54 devstack cinder-volume[91863]: INFO cinder.volume.manager [req-814b830d-6923-4df9-ae4a-70fd93b453ee req-ca43047a-cef2-40be-bdf6-fd1234af1d83 tempest-VolumesSnapshotsTestJSON-1649418515 None] Deleted volume successfully.
Jun 15 15:54:54 devstack cinder-volume[91863]: DEBUG cinder.coordination [req-814b830d-6923-4df9-ae4a-70fd93b453ee req-ca43047a-cef2-40be-bdf6-fd1234af1d83 tempest-VolumesSnapshotsTestJSON-1649418515 None] Lock "cinder-e475e619-7354-41da-b1ba-71f322da2389-delete_volume" released by "delete_volume" :: held 2.612s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:54:54 devstack sudo[99049]: pam_unix(sudo:session): session closed for user root
Jun 15 15:54:54 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-04a6efff-dc27-49d2-922a-611e90e86c15 tempest-CreateVolumesFromSnapshotTest-2024832147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4cb29941-8cb1-4790-85ab-369cb1352144.info" returned: 0 in 0.726s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:54:54 devstack cinder-volume[91863]: WARNING cinder.volume.drivers.remotefs [None req-04a6efff-dc27-49d2-922a-611e90e86c15 tempest-CreateVolumesFromSnapshotTest-2024832147 None] /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4cb29941-8cb1-4790-85ab-369cb1352144.info is being set with open permissions: ugo+rw
Jun 15 15:54:54 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-04a6efff-dc27-49d2-922a-611e90e86c15 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4cb29941-8cb1-4790-85ab-369cb1352144.info {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:54:54 devstack sudo[99054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4cb29941-8cb1-4790-85ab-369cb1352144.info
Jun 15 15:54:54 devstack sudo[99054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:54:55 devstack sudo[99054]: pam_unix(sudo:session): session closed for user root
Jun 15 15:54:55 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-04a6efff-dc27-49d2-922a-611e90e86c15 tempest-CreateVolumesFromSnapshotTest-2024832147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4cb29941-8cb1-4790-85ab-369cb1352144.info" returned: 0 in 0.622s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:54:55 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-04a6efff-dc27-49d2-922a-611e90e86c15 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.789s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:54:55 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [req-3c84bf96-f222-449e-ace9-30e07de62ae7 req-a2f3e9e3-8a21-4f56-8447-d0ed85ef0e98 tempest-AttachVolumeNegativeTest-1849283913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.705s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:54:55 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[832bc57f-a788-4024-95fc-ab5082f81a24]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:54:55 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-3c84bf96-f222-449e-ace9-30e07de62ae7 req-a2f3e9e3-8a21-4f56-8447-d0ed85ef0e98 tempest-AttachVolumeNegativeTest-1849283913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-61afa8b6-adb7-49da-905b-587d2f9d9743 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:54:55 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-04a6efff-dc27-49d2-922a-611e90e86c15 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Create snapshot completed successfully
Jun 15 15:54:55 devstack sudo[99057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-61afa8b6-adb7-49da-905b-587d2f9d9743
Jun 15 15:54:55 devstack sudo[99057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:54:56 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c3dd92a-7f49-4112-add1-b5c8653cfd53 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 15:54:56 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5c3dd92a-7f49-4112-add1-b5c8653cfd53 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Flow 'volume_create_manager' (d3587138-b792-49f7-9b7f-ac8d4d7d99e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:54:56 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5c3dd92a-7f49-4112-add1-b5c8653cfd53 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c581f113-8648-4072-9de8-c9c72e8bea3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:54:56 devstack sudo[99057]: pam_unix(sudo:session): session closed for user root
Jun 15 15:54:56 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5c3dd92a-7f49-4112-add1-b5c8653cfd53 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c581f113-8648-4072-9de8-c9c72e8bea3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:54:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2036141586',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98025975-34c6-4562-b689-7119a58c970e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb071ea7e8fa424493aabd0fd714a736',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:54:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:54:56Z,use_quota=True,user_id='1858c21dffbc467188dadbacba3f16fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:54:56 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5c3dd92a-7f49-4112-add1-b5c8653cfd53 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a563aee2-dbef-476a-968a-ef6e9b493b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:54:56 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5c3dd92a-7f49-4112-add1-b5c8653cfd53 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a563aee2-dbef-476a-968a-ef6e9b493b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:54:56 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5c3dd92a-7f49-4112-add1-b5c8653cfd53 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27163dab-ab20-421f-ac46-2cb0c11b08d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:54:56 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5c3dd92a-7f49-4112-add1-b5c8653cfd53 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27163dab-ab20-421f-ac46-2cb0c11b08d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98025975-34c6-4562-b689-7119a58c970e', 'volume_name': 'volume-98025975-34c6-4562-b689-7119a58c970e', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:54:56 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5c3dd92a-7f49-4112-add1-b5c8653cfd53 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (999d124e-fb16-4215-b20d-3cc644e5396e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:54:56 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5c3dd92a-7f49-4112-add1-b5c8653cfd53 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (999d124e-fb16-4215-b20d-3cc644e5396e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:54:56 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5c3dd92a-7f49-4112-add1-b5c8653cfd53 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66facfd9-c2ce-421f-88ee-7aba70909c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:54:56 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-5c3dd92a-7f49-4112-add1-b5c8653cfd53 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Volume 98025975-34c6-4562-b689-7119a58c970e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98025975-34c6-4562-b689-7119a58c970e', 'volume_size': 1}
Jun 15 15:54:56 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-5c3dd92a-7f49-4112-add1-b5c8653cfd53 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:54:56 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-3c84bf96-f222-449e-ace9-30e07de62ae7 req-a2f3e9e3-8a21-4f56-8447-d0ed85ef0e98 tempest-AttachVolumeNegativeTest-1849283913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-61afa8b6-adb7-49da-905b-587d2f9d9743" returned: 0 in 1.301s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:54:56 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [req-3c84bf96-f222-449e-ace9-30e07de62ae7 req-a2f3e9e3-8a21-4f56-8447-d0ed85ef0e98 tempest-AttachVolumeNegativeTest-1849283913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.331s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:54:56 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-5c3dd92a-7f49-4112-add1-b5c8653cfd53 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:54:56 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-5c3dd92a-7f49-4112-add1-b5c8653cfd53 tempest-CreateVolumesFromSnapshotTest-2024832147 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:54:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2036141586',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98025975-34c6-4562-b689-7119a58c970e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb071ea7e8fa424493aabd0fd714a736',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:54:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:54:56Z,use_quota=True,user_id='1858c21dffbc467188dadbacba3f16fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 15:54:56 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-5c3dd92a-7f49-4112-add1-b5c8653cfd53 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Creating volume 98025975-34c6-4562-b689-7119a58c970e {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 15:54:56 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-5c3dd92a-7f49-4112-add1-b5c8653cfd53 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:54:56 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-5c3dd92a-7f49-4112-add1-b5c8653cfd53 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:54:56 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-5c3dd92a-7f49-4112-add1-b5c8653cfd53 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:54:56 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-5c3dd92a-7f49-4112-add1-b5c8653cfd53 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:54:56 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-5c3dd92a-7f49-4112-add1-b5c8653cfd53 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:54:56 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-5c3dd92a-7f49-4112-add1-b5c8653cfd53 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 15:54:56 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-5c3dd92a-7f49-4112-add1-b5c8653cfd53 tempest-CreateVolumesFromSnapshotTest-2024832147 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 15:54:56 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5c3dd92a-7f49-4112-add1-b5c8653cfd53 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-98025975-34c6-4562-b689-7119a58c970e 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:54:56 devstack sudo[99062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-98025975-34c6-4562-b689-7119a58c970e 1073741824
Jun 15 15:54:56 devstack sudo[99062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:54:56 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [req-3c84bf96-f222-449e-ace9-30e07de62ae7 req-a2f3e9e3-8a21-4f56-8447-d0ed85ef0e98 tempest-AttachVolumeNegativeTest-1849283913 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc', 'name': 'volume-61afa8b6-adb7-49da-905b-587d2f9d9743', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a928c347-0c53-4f2e-b3e3-aacb9e0ceec7', 'enforce_multipath': True} {{(pid=91863) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 15 15:54:57 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-119feb31-63d3-4f4f-9300-6c6b75f37a0c tempest-CreateVolumesFromSnapshotTest-2024832147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 15:54:57 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-119feb31-63d3-4f4f-9300-6c6b75f37a0c tempest-CreateVolumesFromSnapshotTest-2024832147 None] Flow 'volume_create_manager' (04136054-85fa-43c2-b5cb-21545bf5a709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:54:57 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-119feb31-63d3-4f4f-9300-6c6b75f37a0c tempest-CreateVolumesFromSnapshotTest-2024832147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63c62437-6814-4ec4-8ca0-406fb571cb1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:54:57 devstack cinder-volume[91863]: INFO cinder.volume.manager [req-3c84bf96-f222-449e-ace9-30e07de62ae7 req-a2f3e9e3-8a21-4f56-8447-d0ed85ef0e98 tempest-AttachVolumeNegativeTest-1849283913 None] attachment_update completed successfully.
Jun 15 15:54:57 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-119feb31-63d3-4f4f-9300-6c6b75f37a0c tempest-CreateVolumesFromSnapshotTest-2024832147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63c62437-6814-4ec4-8ca0-406fb571cb1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:54:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1868929258',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab092b55-a0ba-41a7-a609-dcb597274873,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb071ea7e8fa424493aabd0fd714a736',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:54:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:54:57Z,use_quota=True,user_id='1858c21dffbc467188dadbacba3f16fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:54:57 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-119feb31-63d3-4f4f-9300-6c6b75f37a0c tempest-CreateVolumesFromSnapshotTest-2024832147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ce8799f-1772-48e5-8394-c24cd422f60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:54:57 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-119feb31-63d3-4f4f-9300-6c6b75f37a0c tempest-CreateVolumesFromSnapshotTest-2024832147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ce8799f-1772-48e5-8394-c24cd422f60e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:54:57 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-119feb31-63d3-4f4f-9300-6c6b75f37a0c tempest-CreateVolumesFromSnapshotTest-2024832147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72bca752-f72c-4613-935b-fa1370049dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:54:57 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-119feb31-63d3-4f4f-9300-6c6b75f37a0c tempest-CreateVolumesFromSnapshotTest-2024832147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72bca752-f72c-4613-935b-fa1370049dd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab092b55-a0ba-41a7-a609-dcb597274873', 'volume_name': 'volume-ab092b55-a0ba-41a7-a609-dcb597274873', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:54:57 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-119feb31-63d3-4f4f-9300-6c6b75f37a0c tempest-CreateVolumesFromSnapshotTest-2024832147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71a4ba3f-4c2b-42ba-aa67-809bb432a5aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:54:57 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-119feb31-63d3-4f4f-9300-6c6b75f37a0c tempest-CreateVolumesFromSnapshotTest-2024832147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71a4ba3f-4c2b-42ba-aa67-809bb432a5aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:54:57 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-119feb31-63d3-4f4f-9300-6c6b75f37a0c tempest-CreateVolumesFromSnapshotTest-2024832147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (083ca398-de97-4ec3-bb82-8edcd5e7675e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:54:57 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-119feb31-63d3-4f4f-9300-6c6b75f37a0c tempest-CreateVolumesFromSnapshotTest-2024832147 None] Volume ab092b55-a0ba-41a7-a609-dcb597274873: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab092b55-a0ba-41a7-a609-dcb597274873', 'volume_size': 1}
Jun 15 15:54:57 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-119feb31-63d3-4f4f-9300-6c6b75f37a0c tempest-CreateVolumesFromSnapshotTest-2024832147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:54:57 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-511a9521-b50d-420f-95a0-c6f029f10da2 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 15:54:57 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-511a9521-b50d-420f-95a0-c6f029f10da2 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Flow 'volume_create_manager' (a984740e-d897-473a-a721-5e7246a01391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:54:57 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-511a9521-b50d-420f-95a0-c6f029f10da2 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1a8fffb-05b7-4c20-bb81-ef74cbbac551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:54:57 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-511a9521-b50d-420f-95a0-c6f029f10da2 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1a8fffb-05b7-4c20-bb81-ef74cbbac551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:54:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2005626184',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9798e563-cd4c-4e20-b2f9-fb459fcdad5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb071ea7e8fa424493aabd0fd714a736',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:54:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:54:58Z,use_quota=True,user_id='1858c21dffbc467188dadbacba3f16fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:54:57 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-511a9521-b50d-420f-95a0-c6f029f10da2 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b75c6a28-ceb8-48ae-8b9d-b60f44adffec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:54:57 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-511a9521-b50d-420f-95a0-c6f029f10da2 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b75c6a28-ceb8-48ae-8b9d-b60f44adffec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:54:57 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-511a9521-b50d-420f-95a0-c6f029f10da2 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90fbbba3-cebc-4494-8baf-8f25bed06314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:54:57 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-511a9521-b50d-420f-95a0-c6f029f10da2 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90fbbba3-cebc-4494-8baf-8f25bed06314) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9798e563-cd4c-4e20-b2f9-fb459fcdad5d', 'volume_name': 'volume-9798e563-cd4c-4e20-b2f9-fb459fcdad5d', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:54:57 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-511a9521-b50d-420f-95a0-c6f029f10da2 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87f33b7c-ff57-4520-a36b-015a887a6c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:54:57 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-511a9521-b50d-420f-95a0-c6f029f10da2 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87f33b7c-ff57-4520-a36b-015a887a6c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:54:57 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-511a9521-b50d-420f-95a0-c6f029f10da2 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec6db250-fa95-437e-b861-bc958055e4fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:54:57 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-511a9521-b50d-420f-95a0-c6f029f10da2 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Volume 9798e563-cd4c-4e20-b2f9-fb459fcdad5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9798e563-cd4c-4e20-b2f9-fb459fcdad5d', 'volume_size': 1}
Jun 15 15:54:57 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-511a9521-b50d-420f-95a0-c6f029f10da2 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:54:58 devstack sudo[99062]: pam_unix(sudo:session): session closed for user root
Jun 15 15:54:58 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5c3dd92a-7f49-4112-add1-b5c8653cfd53 tempest-CreateVolumesFromSnapshotTest-2024832147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-98025975-34c6-4562-b689-7119a58c970e 1073741824" returned: 0 in 1.253s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:54:58 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5c3dd92a-7f49-4112-add1-b5c8653cfd53 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-98025975-34c6-4562-b689-7119a58c970e {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:54:58 devstack sudo[99135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-98025975-34c6-4562-b689-7119a58c970e
Jun 15 15:54:58 devstack sudo[99135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:54:58 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-8985614f-d0ef-495e-bd53-3cdc5c2094c1 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 15:54:58 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8985614f-d0ef-495e-bd53-3cdc5c2094c1 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Flow 'volume_create_manager' (1308c351-7dc6-42e7-a8b7-cebae8963b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:54:58 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8985614f-d0ef-495e-bd53-3cdc5c2094c1 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f7e876e-5489-4416-b491-ef2ae1777b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:54:58 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8985614f-d0ef-495e-bd53-3cdc5c2094c1 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f7e876e-5489-4416-b491-ef2ae1777b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:54:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-599480620',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7df8d58-9fd3-4316-9efd-eb84ca10ac6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb071ea7e8fa424493aabd0fd714a736',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:54:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:54:58Z,use_quota=True,user_id='1858c21dffbc467188dadbacba3f16fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:54:58 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8985614f-d0ef-495e-bd53-3cdc5c2094c1 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5180d381-13bc-45aa-a2c7-1a9caa3c7d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:54:58 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8985614f-d0ef-495e-bd53-3cdc5c2094c1 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5180d381-13bc-45aa-a2c7-1a9caa3c7d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:54:58 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8985614f-d0ef-495e-bd53-3cdc5c2094c1 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0de2f114-b15a-4d28-85f1-be339ad548f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:54:58 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8985614f-d0ef-495e-bd53-3cdc5c2094c1 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0de2f114-b15a-4d28-85f1-be339ad548f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7df8d58-9fd3-4316-9efd-eb84ca10ac6b', 'volume_name': 'volume-f7df8d58-9fd3-4316-9efd-eb84ca10ac6b', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:54:58 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8985614f-d0ef-495e-bd53-3cdc5c2094c1 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96681c67-5afc-4a4f-9916-7db3cf572389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:54:58 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8985614f-d0ef-495e-bd53-3cdc5c2094c1 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96681c67-5afc-4a4f-9916-7db3cf572389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:54:58 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8985614f-d0ef-495e-bd53-3cdc5c2094c1 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ad21056-c03b-4e9b-a6cb-b23270928bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:54:58 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-8985614f-d0ef-495e-bd53-3cdc5c2094c1 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Volume f7df8d58-9fd3-4316-9efd-eb84ca10ac6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7df8d58-9fd3-4316-9efd-eb84ca10ac6b', 'volume_size': 1}
Jun 15 15:54:58 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-8985614f-d0ef-495e-bd53-3cdc5c2094c1 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:54:59 devstack sudo[99135]: pam_unix(sudo:session): session closed for user root
Jun 15 15:54:59 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5c3dd92a-7f49-4112-add1-b5c8653cfd53 tempest-CreateVolumesFromSnapshotTest-2024832147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-98025975-34c6-4562-b689-7119a58c970e" returned: 0 in 0.972s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:54:59 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-5c3dd92a-7f49-4112-add1-b5c8653cfd53 tempest-CreateVolumesFromSnapshotTest-2024832147 None] <== create_volume: return (2296ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 15:54:59 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-5c3dd92a-7f49-4112-add1-b5c8653cfd53 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.299s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:54:59 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-119feb31-63d3-4f4f-9300-6c6b75f37a0c tempest-CreateVolumesFromSnapshotTest-2024832147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.918s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:54:59 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-119feb31-63d3-4f4f-9300-6c6b75f37a0c tempest-CreateVolumesFromSnapshotTest-2024832147 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:54:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1868929258',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab092b55-a0ba-41a7-a609-dcb597274873,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb071ea7e8fa424493aabd0fd714a736',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:54:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:54:57Z,use_quota=True,user_id='1858c21dffbc467188dadbacba3f16fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 15:54:59 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-119feb31-63d3-4f4f-9300-6c6b75f37a0c tempest-CreateVolumesFromSnapshotTest-2024832147 None] Creating volume ab092b55-a0ba-41a7-a609-dcb597274873 {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 15:54:59 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-119feb31-63d3-4f4f-9300-6c6b75f37a0c tempest-CreateVolumesFromSnapshotTest-2024832147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:54:59 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-119feb31-63d3-4f4f-9300-6c6b75f37a0c tempest-CreateVolumesFromSnapshotTest-2024832147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:54:59 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-119feb31-63d3-4f4f-9300-6c6b75f37a0c tempest-CreateVolumesFromSnapshotTest-2024832147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:54:59 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-119feb31-63d3-4f4f-9300-6c6b75f37a0c tempest-CreateVolumesFromSnapshotTest-2024832147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:54:59 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-119feb31-63d3-4f4f-9300-6c6b75f37a0c tempest-CreateVolumesFromSnapshotTest-2024832147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:54:59 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-119feb31-63d3-4f4f-9300-6c6b75f37a0c tempest-CreateVolumesFromSnapshotTest-2024832147 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 15:54:59 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-119feb31-63d3-4f4f-9300-6c6b75f37a0c tempest-CreateVolumesFromSnapshotTest-2024832147 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 15:54:59 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-119feb31-63d3-4f4f-9300-6c6b75f37a0c tempest-CreateVolumesFromSnapshotTest-2024832147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-ab092b55-a0ba-41a7-a609-dcb597274873 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:54:59 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5c3dd92a-7f49-4112-add1-b5c8653cfd53 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66facfd9-c2ce-421f-88ee-7aba70909c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98025975-34c6-4562-b689-7119a58c970e', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:54:59 devstack sudo[99454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-ab092b55-a0ba-41a7-a609-dcb597274873 1073741824
Jun 15 15:54:59 devstack sudo[99454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:54:59 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5c3dd92a-7f49-4112-add1-b5c8653cfd53 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbcebd78-cd98-4758-9c7d-daa0186df981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:54:59 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-366b2b45-e17b-4bbd-b93f-8d4cd38aeabf tempest-CreateVolumesFromSnapshotTest-2024832147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 15:54:59 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-366b2b45-e17b-4bbd-b93f-8d4cd38aeabf tempest-CreateVolumesFromSnapshotTest-2024832147 None] Flow 'volume_create_manager' (73aebfd7-8950-4144-9364-23f445d6deca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:54:59 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-366b2b45-e17b-4bbd-b93f-8d4cd38aeabf tempest-CreateVolumesFromSnapshotTest-2024832147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e21e9543-e049-4fd3-b620-8608eea1b3e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:54:59 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-366b2b45-e17b-4bbd-b93f-8d4cd38aeabf tempest-CreateVolumesFromSnapshotTest-2024832147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e21e9543-e049-4fd3-b620-8608eea1b3e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:54:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-518550267',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=902b693d-3fab-4da6-9f50-db652bd8c924,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb071ea7e8fa424493aabd0fd714a736',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:54:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:54:59Z,use_quota=True,user_id='1858c21dffbc467188dadbacba3f16fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:54:59 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-366b2b45-e17b-4bbd-b93f-8d4cd38aeabf tempest-CreateVolumesFromSnapshotTest-2024832147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f38cfbb-8e0b-4515-bb88-a8a6715961bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:54:59 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-366b2b45-e17b-4bbd-b93f-8d4cd38aeabf tempest-CreateVolumesFromSnapshotTest-2024832147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f38cfbb-8e0b-4515-bb88-a8a6715961bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:54:59 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-366b2b45-e17b-4bbd-b93f-8d4cd38aeabf tempest-CreateVolumesFromSnapshotTest-2024832147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ac8830e-03d3-45d4-9c99-f339532d4f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:54:59 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-366b2b45-e17b-4bbd-b93f-8d4cd38aeabf tempest-CreateVolumesFromSnapshotTest-2024832147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ac8830e-03d3-45d4-9c99-f339532d4f79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '902b693d-3fab-4da6-9f50-db652bd8c924', 'volume_name': 'volume-902b693d-3fab-4da6-9f50-db652bd8c924', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:54:59 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-366b2b45-e17b-4bbd-b93f-8d4cd38aeabf tempest-CreateVolumesFromSnapshotTest-2024832147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6960ecf7-e045-408a-af5a-e760eb97dc58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:54:59 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-366b2b45-e17b-4bbd-b93f-8d4cd38aeabf tempest-CreateVolumesFromSnapshotTest-2024832147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6960ecf7-e045-408a-af5a-e760eb97dc58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:54:59 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-366b2b45-e17b-4bbd-b93f-8d4cd38aeabf tempest-CreateVolumesFromSnapshotTest-2024832147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99e65051-5428-4e30-8543-58affae07985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:54:59 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-366b2b45-e17b-4bbd-b93f-8d4cd38aeabf tempest-CreateVolumesFromSnapshotTest-2024832147 None] Volume 902b693d-3fab-4da6-9f50-db652bd8c924: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-902b693d-3fab-4da6-9f50-db652bd8c924', 'volume_size': 1}
Jun 15 15:54:59 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-366b2b45-e17b-4bbd-b93f-8d4cd38aeabf tempest-CreateVolumesFromSnapshotTest-2024832147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:54:59 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-5c3dd92a-7f49-4112-add1-b5c8653cfd53 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Volume volume-98025975-34c6-4562-b689-7119a58c970e (98025975-34c6-4562-b689-7119a58c970e): created successfully
Jun 15 15:54:59 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5c3dd92a-7f49-4112-add1-b5c8653cfd53 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbcebd78-cd98-4758-9c7d-daa0186df981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:54:59 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5c3dd92a-7f49-4112-add1-b5c8653cfd53 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Flow 'volume_create_manager' (d3587138-b792-49f7-9b7f-ac8d4d7d99e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:54:59 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-5c3dd92a-7f49-4112-add1-b5c8653cfd53 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Created volume successfully.
Jun 15 15:55:00 devstack sudo[99454]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:00 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-119feb31-63d3-4f4f-9300-6c6b75f37a0c tempest-CreateVolumesFromSnapshotTest-2024832147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-ab092b55-a0ba-41a7-a609-dcb597274873 1073741824" returned: 0 in 0.935s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:00 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-119feb31-63d3-4f4f-9300-6c6b75f37a0c tempest-CreateVolumesFromSnapshotTest-2024832147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-ab092b55-a0ba-41a7-a609-dcb597274873 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:00 devstack sudo[99460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-ab092b55-a0ba-41a7-a609-dcb597274873
Jun 15 15:55:00 devstack sudo[99460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:00 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-d530575d-c538-47c2-bab3-e0fbfa1b8a97 tempest-SnapshotsActionsTest-1914407753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 15:55:00 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-d530575d-c538-47c2-bab3-e0fbfa1b8a97 tempest-SnapshotsActionsTest-1914407753 None] Flow 'volume_create_manager' (02a3addc-44d9-4951-b8dc-1376eef205af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:55:00 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-d530575d-c538-47c2-bab3-e0fbfa1b8a97 tempest-SnapshotsActionsTest-1914407753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44f5cbcc-97df-4798-9888-2da2c2790411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:55:00 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-d530575d-c538-47c2-bab3-e0fbfa1b8a97 tempest-SnapshotsActionsTest-1914407753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44f5cbcc-97df-4798-9888-2da2c2790411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:55:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-85739247',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a338138-ed36-447f-bf04-1f3e19ab34b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='741b6d8e4c3d4940a03cb6fa488e041d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:55:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:55:01Z,use_quota=True,user_id='b621b5094b00490f88aa7aee2922502f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:55:00 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-d530575d-c538-47c2-bab3-e0fbfa1b8a97 tempest-SnapshotsActionsTest-1914407753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (280d5c39-1bea-4637-ba93-22f23343a545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:55:00 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-d530575d-c538-47c2-bab3-e0fbfa1b8a97 tempest-SnapshotsActionsTest-1914407753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (280d5c39-1bea-4637-ba93-22f23343a545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:55:00 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-d530575d-c538-47c2-bab3-e0fbfa1b8a97 tempest-SnapshotsActionsTest-1914407753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (344f3fb9-2680-4a36-9c48-4772ff898cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:55:00 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-d530575d-c538-47c2-bab3-e0fbfa1b8a97 tempest-SnapshotsActionsTest-1914407753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (344f3fb9-2680-4a36-9c48-4772ff898cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a338138-ed36-447f-bf04-1f3e19ab34b9', 'volume_name': 'volume-2a338138-ed36-447f-bf04-1f3e19ab34b9', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:55:00 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-d530575d-c538-47c2-bab3-e0fbfa1b8a97 tempest-SnapshotsActionsTest-1914407753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3325657-bbcc-46c9-845b-5a5cc76332db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:55:00 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-d530575d-c538-47c2-bab3-e0fbfa1b8a97 tempest-SnapshotsActionsTest-1914407753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3325657-bbcc-46c9-845b-5a5cc76332db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:55:00 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-d530575d-c538-47c2-bab3-e0fbfa1b8a97 tempest-SnapshotsActionsTest-1914407753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a92aaa2c-ea6f-49b3-84b5-2f712ae20052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:55:00 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-d530575d-c538-47c2-bab3-e0fbfa1b8a97 tempest-SnapshotsActionsTest-1914407753 None] Volume 2a338138-ed36-447f-bf04-1f3e19ab34b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a338138-ed36-447f-bf04-1f3e19ab34b9', 'volume_size': 1}
Jun 15 15:55:00 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-d530575d-c538-47c2-bab3-e0fbfa1b8a97 tempest-SnapshotsActionsTest-1914407753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:55:00 devstack sudo[99460]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:00 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-119feb31-63d3-4f4f-9300-6c6b75f37a0c tempest-CreateVolumesFromSnapshotTest-2024832147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-ab092b55-a0ba-41a7-a609-dcb597274873" returned: 0 in 0.806s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:00 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-119feb31-63d3-4f4f-9300-6c6b75f37a0c tempest-CreateVolumesFromSnapshotTest-2024832147 None] <== create_volume: return (1805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 15:55:00 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-119feb31-63d3-4f4f-9300-6c6b75f37a0c tempest-CreateVolumesFromSnapshotTest-2024832147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.808s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:55:00 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-511a9521-b50d-420f-95a0-c6f029f10da2 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.038s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:55:00 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-511a9521-b50d-420f-95a0-c6f029f10da2 tempest-CreateVolumesFromSnapshotTest-2024832147 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:54:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2005626184',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9798e563-cd4c-4e20-b2f9-fb459fcdad5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb071ea7e8fa424493aabd0fd714a736',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:54:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:54:58Z,use_quota=True,user_id='1858c21dffbc467188dadbacba3f16fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 15:55:00 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-511a9521-b50d-420f-95a0-c6f029f10da2 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Creating volume 9798e563-cd4c-4e20-b2f9-fb459fcdad5d {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 15:55:00 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-511a9521-b50d-420f-95a0-c6f029f10da2 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:55:00 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-511a9521-b50d-420f-95a0-c6f029f10da2 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:55:00 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-511a9521-b50d-420f-95a0-c6f029f10da2 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:55:00 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-511a9521-b50d-420f-95a0-c6f029f10da2 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:55:00 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-511a9521-b50d-420f-95a0-c6f029f10da2 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:55:00 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-511a9521-b50d-420f-95a0-c6f029f10da2 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 15:55:00 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-511a9521-b50d-420f-95a0-c6f029f10da2 tempest-CreateVolumesFromSnapshotTest-2024832147 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 15:55:00 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-511a9521-b50d-420f-95a0-c6f029f10da2 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-9798e563-cd4c-4e20-b2f9-fb459fcdad5d 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:00 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-119feb31-63d3-4f4f-9300-6c6b75f37a0c tempest-CreateVolumesFromSnapshotTest-2024832147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (083ca398-de97-4ec3-bb82-8edcd5e7675e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab092b55-a0ba-41a7-a609-dcb597274873', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:55:00 devstack sudo[99489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-9798e563-cd4c-4e20-b2f9-fb459fcdad5d 1073741824
Jun 15 15:55:00 devstack sudo[99489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:00 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-119feb31-63d3-4f4f-9300-6c6b75f37a0c tempest-CreateVolumesFromSnapshotTest-2024832147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4dc4f91-c8c7-4964-85a2-3035cff1dcda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:55:00 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-119feb31-63d3-4f4f-9300-6c6b75f37a0c tempest-CreateVolumesFromSnapshotTest-2024832147 None] Volume volume-ab092b55-a0ba-41a7-a609-dcb597274873 (ab092b55-a0ba-41a7-a609-dcb597274873): created successfully
Jun 15 15:55:00 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-119feb31-63d3-4f4f-9300-6c6b75f37a0c tempest-CreateVolumesFromSnapshotTest-2024832147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4dc4f91-c8c7-4964-85a2-3035cff1dcda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:55:00 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-119feb31-63d3-4f4f-9300-6c6b75f37a0c tempest-CreateVolumesFromSnapshotTest-2024832147 None] Flow 'volume_create_manager' (04136054-85fa-43c2-b5cb-21545bf5a709) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:55:00 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-119feb31-63d3-4f4f-9300-6c6b75f37a0c tempest-CreateVolumesFromSnapshotTest-2024832147 None] Created volume successfully.
Jun 15 15:55:01 devstack sudo[99489]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:01 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-511a9521-b50d-420f-95a0-c6f029f10da2 tempest-CreateVolumesFromSnapshotTest-2024832147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-9798e563-cd4c-4e20-b2f9-fb459fcdad5d 1073741824" returned: 0 in 1.069s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:02 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-511a9521-b50d-420f-95a0-c6f029f10da2 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-9798e563-cd4c-4e20-b2f9-fb459fcdad5d {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:02 devstack sudo[99803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-9798e563-cd4c-4e20-b2f9-fb459fcdad5d
Jun 15 15:55:02 devstack sudo[99803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:02 devstack sudo[99803]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:02 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-511a9521-b50d-420f-95a0-c6f029f10da2 tempest-CreateVolumesFromSnapshotTest-2024832147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-9798e563-cd4c-4e20-b2f9-fb459fcdad5d" returned: 0 in 0.708s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:02 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-511a9521-b50d-420f-95a0-c6f029f10da2 tempest-CreateVolumesFromSnapshotTest-2024832147 None] <== create_volume: return (1869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 15:55:02 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-511a9521-b50d-420f-95a0-c6f029f10da2 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.872s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:55:02 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-8985614f-d0ef-495e-bd53-3cdc5c2094c1 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.304s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:55:02 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-8985614f-d0ef-495e-bd53-3cdc5c2094c1 tempest-CreateVolumesFromSnapshotTest-2024832147 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:54:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-599480620',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7df8d58-9fd3-4316-9efd-eb84ca10ac6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb071ea7e8fa424493aabd0fd714a736',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:54:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:54:58Z,use_quota=True,user_id='1858c21dffbc467188dadbacba3f16fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 15:55:02 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-8985614f-d0ef-495e-bd53-3cdc5c2094c1 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Creating volume f7df8d58-9fd3-4316-9efd-eb84ca10ac6b {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 15:55:02 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-8985614f-d0ef-495e-bd53-3cdc5c2094c1 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:55:02 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-8985614f-d0ef-495e-bd53-3cdc5c2094c1 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:55:02 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-8985614f-d0ef-495e-bd53-3cdc5c2094c1 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:55:02 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-8985614f-d0ef-495e-bd53-3cdc5c2094c1 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:55:02 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-8985614f-d0ef-495e-bd53-3cdc5c2094c1 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:55:02 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-8985614f-d0ef-495e-bd53-3cdc5c2094c1 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 15:55:02 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-8985614f-d0ef-495e-bd53-3cdc5c2094c1 tempest-CreateVolumesFromSnapshotTest-2024832147 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 15:55:02 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-8985614f-d0ef-495e-bd53-3cdc5c2094c1 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-f7df8d58-9fd3-4316-9efd-eb84ca10ac6b 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:02 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-511a9521-b50d-420f-95a0-c6f029f10da2 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec6db250-fa95-437e-b861-bc958055e4fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9798e563-cd4c-4e20-b2f9-fb459fcdad5d', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:55:02 devstack sudo[99817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-f7df8d58-9fd3-4316-9efd-eb84ca10ac6b 1073741824
Jun 15 15:55:02 devstack sudo[99817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:02 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-511a9521-b50d-420f-95a0-c6f029f10da2 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a4aac88-cae5-499a-aecd-f834c2e4d539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:55:02 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-511a9521-b50d-420f-95a0-c6f029f10da2 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Volume volume-9798e563-cd4c-4e20-b2f9-fb459fcdad5d (9798e563-cd4c-4e20-b2f9-fb459fcdad5d): created successfully
Jun 15 15:55:02 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-511a9521-b50d-420f-95a0-c6f029f10da2 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a4aac88-cae5-499a-aecd-f834c2e4d539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:55:02 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-511a9521-b50d-420f-95a0-c6f029f10da2 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Flow 'volume_create_manager' (a984740e-d897-473a-a721-5e7246a01391) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:55:02 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-511a9521-b50d-420f-95a0-c6f029f10da2 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Created volume successfully.
Jun 15 15:55:03 devstack cinder-volume[91863]: INFO cinder.volume.manager [req-d60f9b9b-6eb4-4f02-99ec-f2441c2a4e8a req-52835df8-5291-43e4-914f-1743f451e08a tempest-AttachVolumeNegativeTest-1849283913 None] Terminate volume connection completed successfully.
Jun 15 15:55:03 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [req-d60f9b9b-6eb4-4f02-99ec-f2441c2a4e8a req-52835df8-5291-43e4-914f-1743f451e08a tempest-AttachVolumeNegativeTest-1849283913 None] Deleting attachment a928c347-0c53-4f2e-b3e3-aacb9e0ceec7. {{(pid=91863) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 15 15:55:03 devstack sudo[99817]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:03 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-8985614f-d0ef-495e-bd53-3cdc5c2094c1 tempest-CreateVolumesFromSnapshotTest-2024832147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-f7df8d58-9fd3-4316-9efd-eb84ca10ac6b 1073741824" returned: 0 in 1.197s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:04 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-8985614f-d0ef-495e-bd53-3cdc5c2094c1 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-f7df8d58-9fd3-4316-9efd-eb84ca10ac6b {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:04 devstack sudo[99851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-f7df8d58-9fd3-4316-9efd-eb84ca10ac6b
Jun 15 15:55:04 devstack sudo[99851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:04 devstack sudo[99851]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:04 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-8985614f-d0ef-495e-bd53-3cdc5c2094c1 tempest-CreateVolumesFromSnapshotTest-2024832147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-f7df8d58-9fd3-4316-9efd-eb84ca10ac6b" returned: 0 in 0.753s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:04 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-8985614f-d0ef-495e-bd53-3cdc5c2094c1 tempest-CreateVolumesFromSnapshotTest-2024832147 None] <== create_volume: return (2013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 15:55:04 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-8985614f-d0ef-495e-bd53-3cdc5c2094c1 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.017s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:55:04 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-366b2b45-e17b-4bbd-b93f-8d4cd38aeabf tempest-CreateVolumesFromSnapshotTest-2024832147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.520s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:55:04 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-366b2b45-e17b-4bbd-b93f-8d4cd38aeabf tempest-CreateVolumesFromSnapshotTest-2024832147 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:54:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-518550267',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=902b693d-3fab-4da6-9f50-db652bd8c924,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb071ea7e8fa424493aabd0fd714a736',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:54:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:54:59Z,use_quota=True,user_id='1858c21dffbc467188dadbacba3f16fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 15:55:04 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-366b2b45-e17b-4bbd-b93f-8d4cd38aeabf tempest-CreateVolumesFromSnapshotTest-2024832147 None] Creating volume 902b693d-3fab-4da6-9f50-db652bd8c924 {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 15:55:04 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-366b2b45-e17b-4bbd-b93f-8d4cd38aeabf tempest-CreateVolumesFromSnapshotTest-2024832147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:55:04 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-366b2b45-e17b-4bbd-b93f-8d4cd38aeabf tempest-CreateVolumesFromSnapshotTest-2024832147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:55:04 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-366b2b45-e17b-4bbd-b93f-8d4cd38aeabf tempest-CreateVolumesFromSnapshotTest-2024832147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:55:04 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-366b2b45-e17b-4bbd-b93f-8d4cd38aeabf tempest-CreateVolumesFromSnapshotTest-2024832147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:55:04 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-366b2b45-e17b-4bbd-b93f-8d4cd38aeabf tempest-CreateVolumesFromSnapshotTest-2024832147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:55:04 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-366b2b45-e17b-4bbd-b93f-8d4cd38aeabf tempest-CreateVolumesFromSnapshotTest-2024832147 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 15:55:04 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-366b2b45-e17b-4bbd-b93f-8d4cd38aeabf tempest-CreateVolumesFromSnapshotTest-2024832147 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 15:55:04 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-366b2b45-e17b-4bbd-b93f-8d4cd38aeabf tempest-CreateVolumesFromSnapshotTest-2024832147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-902b693d-3fab-4da6-9f50-db652bd8c924 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:04 devstack sudo[99855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-902b693d-3fab-4da6-9f50-db652bd8c924 1073741824
Jun 15 15:55:04 devstack sudo[99855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:04 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8985614f-d0ef-495e-bd53-3cdc5c2094c1 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ad21056-c03b-4e9b-a6cb-b23270928bb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7df8d58-9fd3-4316-9efd-eb84ca10ac6b', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:55:04 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8985614f-d0ef-495e-bd53-3cdc5c2094c1 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef019e4a-9e27-4ff5-8d0f-0fabb209d641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:55:04 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-8985614f-d0ef-495e-bd53-3cdc5c2094c1 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Volume volume-f7df8d58-9fd3-4316-9efd-eb84ca10ac6b (f7df8d58-9fd3-4316-9efd-eb84ca10ac6b): created successfully
Jun 15 15:55:04 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8985614f-d0ef-495e-bd53-3cdc5c2094c1 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef019e4a-9e27-4ff5-8d0f-0fabb209d641) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:55:04 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8985614f-d0ef-495e-bd53-3cdc5c2094c1 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Flow 'volume_create_manager' (1308c351-7dc6-42e7-a8b7-cebae8963b8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:55:04 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-8985614f-d0ef-495e-bd53-3cdc5c2094c1 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Created volume successfully.
Jun 15 15:55:05 devstack sudo[99855]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:05 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-366b2b45-e17b-4bbd-b93f-8d4cd38aeabf tempest-CreateVolumesFromSnapshotTest-2024832147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-902b693d-3fab-4da6-9f50-db652bd8c924 1073741824" returned: 0 in 0.951s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:05 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-366b2b45-e17b-4bbd-b93f-8d4cd38aeabf tempest-CreateVolumesFromSnapshotTest-2024832147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-902b693d-3fab-4da6-9f50-db652bd8c924 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:05 devstack sudo[99861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-902b693d-3fab-4da6-9f50-db652bd8c924
Jun 15 15:55:05 devstack sudo[99861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:06 devstack sudo[99861]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:06 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-366b2b45-e17b-4bbd-b93f-8d4cd38aeabf tempest-CreateVolumesFromSnapshotTest-2024832147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-902b693d-3fab-4da6-9f50-db652bd8c924" returned: 0 in 0.759s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:06 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-366b2b45-e17b-4bbd-b93f-8d4cd38aeabf tempest-CreateVolumesFromSnapshotTest-2024832147 None] <== create_volume: return (1799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 15:55:06 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-366b2b45-e17b-4bbd-b93f-8d4cd38aeabf tempest-CreateVolumesFromSnapshotTest-2024832147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.802s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:55:06 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-d530575d-c538-47c2-bab3-e0fbfa1b8a97 tempest-SnapshotsActionsTest-1914407753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.728s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:55:06 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-d530575d-c538-47c2-bab3-e0fbfa1b8a97 tempest-SnapshotsActionsTest-1914407753 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:55:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-85739247',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a338138-ed36-447f-bf04-1f3e19ab34b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='741b6d8e4c3d4940a03cb6fa488e041d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:55:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:55:01Z,use_quota=True,user_id='b621b5094b00490f88aa7aee2922502f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 15:55:06 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-d530575d-c538-47c2-bab3-e0fbfa1b8a97 tempest-SnapshotsActionsTest-1914407753 None] Creating volume 2a338138-ed36-447f-bf04-1f3e19ab34b9 {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 15:55:06 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-d530575d-c538-47c2-bab3-e0fbfa1b8a97 tempest-SnapshotsActionsTest-1914407753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:55:06 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-d530575d-c538-47c2-bab3-e0fbfa1b8a97 tempest-SnapshotsActionsTest-1914407753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:55:06 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-d530575d-c538-47c2-bab3-e0fbfa1b8a97 tempest-SnapshotsActionsTest-1914407753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:55:06 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-d530575d-c538-47c2-bab3-e0fbfa1b8a97 tempest-SnapshotsActionsTest-1914407753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:55:06 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-d530575d-c538-47c2-bab3-e0fbfa1b8a97 tempest-SnapshotsActionsTest-1914407753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:55:06 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-d530575d-c538-47c2-bab3-e0fbfa1b8a97 tempest-SnapshotsActionsTest-1914407753 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 15:55:06 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-d530575d-c538-47c2-bab3-e0fbfa1b8a97 tempest-SnapshotsActionsTest-1914407753 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 15:55:06 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-d530575d-c538-47c2-bab3-e0fbfa1b8a97 tempest-SnapshotsActionsTest-1914407753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:06 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-366b2b45-e17b-4bbd-b93f-8d4cd38aeabf tempest-CreateVolumesFromSnapshotTest-2024832147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99e65051-5428-4e30-8543-58affae07985) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-902b693d-3fab-4da6-9f50-db652bd8c924', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:55:06 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-366b2b45-e17b-4bbd-b93f-8d4cd38aeabf tempest-CreateVolumesFromSnapshotTest-2024832147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50b2f3ed-c1fd-4f5a-a78a-52b3d361c7c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:55:06 devstack sudo[99864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9 1073741824
Jun 15 15:55:06 devstack sudo[99864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:06 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-366b2b45-e17b-4bbd-b93f-8d4cd38aeabf tempest-CreateVolumesFromSnapshotTest-2024832147 None] Volume volume-902b693d-3fab-4da6-9f50-db652bd8c924 (902b693d-3fab-4da6-9f50-db652bd8c924): created successfully
Jun 15 15:55:06 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-366b2b45-e17b-4bbd-b93f-8d4cd38aeabf tempest-CreateVolumesFromSnapshotTest-2024832147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50b2f3ed-c1fd-4f5a-a78a-52b3d361c7c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:55:06 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-366b2b45-e17b-4bbd-b93f-8d4cd38aeabf tempest-CreateVolumesFromSnapshotTest-2024832147 None] Flow 'volume_create_manager' (73aebfd7-8950-4144-9364-23f445d6deca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:55:06 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-366b2b45-e17b-4bbd-b93f-8d4cd38aeabf tempest-CreateVolumesFromSnapshotTest-2024832147 None] Created volume successfully.
Jun 15 15:55:07 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-971a36c2-7ecb-4dd3-9ce2-380b69351c87 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Acquiring lock "cinder-902b693d-3fab-4da6-9f50-db652bd8c924-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:55:07 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-971a36c2-7ecb-4dd3-9ce2-380b69351c87 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Lock "cinder-902b693d-3fab-4da6-9f50-db652bd8c924-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:55:07 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-971a36c2-7ecb-4dd3-9ce2-380b69351c87 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Acquiring lock "cinder-quobyte-902b693d-3fab-4da6-9f50-db652bd8c924" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:55:07 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-971a36c2-7ecb-4dd3-9ce2-380b69351c87 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Lock "cinder-quobyte-902b693d-3fab-4da6-9f50-db652bd8c924" acquired by "delete_volume" :: waited 0.020s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:55:07 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f65c37-8424-4e6f-8a4b-cea66950ca91]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:55:07 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-971a36c2-7ecb-4dd3-9ce2-380b69351c87 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-902b693d-3fab-4da6-9f50-db652bd8c924 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:07 devstack sudo[99903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-902b693d-3fab-4da6-9f50-db652bd8c924
Jun 15 15:55:07 devstack sudo[99903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:07 devstack sudo[99864]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:07 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-d530575d-c538-47c2-bab3-e0fbfa1b8a97 tempest-SnapshotsActionsTest-1914407753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9 1073741824" returned: 0 in 1.150s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:07 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-d530575d-c538-47c2-bab3-e0fbfa1b8a97 tempest-SnapshotsActionsTest-1914407753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:07 devstack sudo[99909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9
Jun 15 15:55:07 devstack sudo[99909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:08 devstack sudo[99903]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:08 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-971a36c2-7ecb-4dd3-9ce2-380b69351c87 tempest-CreateVolumesFromSnapshotTest-2024832147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-902b693d-3fab-4da6-9f50-db652bd8c924" returned: 0 in 0.872s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:08 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-971a36c2-7ecb-4dd3-9ce2-380b69351c87 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-902b693d-3fab-4da6-9f50-db652bd8c924 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:08 devstack sudo[99915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-902b693d-3fab-4da6-9f50-db652bd8c924
Jun 15 15:55:08 devstack sudo[99915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:08 devstack sudo[99909]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:08 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-d530575d-c538-47c2-bab3-e0fbfa1b8a97 tempest-SnapshotsActionsTest-1914407753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9" returned: 0 in 0.701s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:08 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-d530575d-c538-47c2-bab3-e0fbfa1b8a97 tempest-SnapshotsActionsTest-1914407753 None] <== create_volume: return (1897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 15:55:08 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-d530575d-c538-47c2-bab3-e0fbfa1b8a97 tempest-SnapshotsActionsTest-1914407753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.901s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:55:08 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-d530575d-c538-47c2-bab3-e0fbfa1b8a97 tempest-SnapshotsActionsTest-1914407753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a92aaa2c-ea6f-49b3-84b5-2f712ae20052) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a338138-ed36-447f-bf04-1f3e19ab34b9', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:55:08 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-d530575d-c538-47c2-bab3-e0fbfa1b8a97 tempest-SnapshotsActionsTest-1914407753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eda7c46-07a3-4061-bcba-703b8b402fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:55:08 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-d530575d-c538-47c2-bab3-e0fbfa1b8a97 tempest-SnapshotsActionsTest-1914407753 None] Volume volume-2a338138-ed36-447f-bf04-1f3e19ab34b9 (2a338138-ed36-447f-bf04-1f3e19ab34b9): created successfully
Jun 15 15:55:08 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-d530575d-c538-47c2-bab3-e0fbfa1b8a97 tempest-SnapshotsActionsTest-1914407753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eda7c46-07a3-4061-bcba-703b8b402fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:55:08 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-d530575d-c538-47c2-bab3-e0fbfa1b8a97 tempest-SnapshotsActionsTest-1914407753 None] Flow 'volume_create_manager' (02a3addc-44d9-4951-b8dc-1376eef205af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:55:08 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-d530575d-c538-47c2-bab3-e0fbfa1b8a97 tempest-SnapshotsActionsTest-1914407753 None] Created volume successfully.
Jun 15 15:55:08 devstack sudo[99915]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:08 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-971a36c2-7ecb-4dd3-9ce2-380b69351c87 tempest-CreateVolumesFromSnapshotTest-2024832147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-902b693d-3fab-4da6-9f50-db652bd8c924" returned: 0 in 0.784s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:08 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-971a36c2-7ecb-4dd3-9ce2-380b69351c87 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Lock "cinder-quobyte-902b693d-3fab-4da6-9f50-db652bd8c924" released by "delete_volume" :: held 1.702s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:55:08 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-971a36c2-7ecb-4dd3-9ce2-380b69351c87 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Created reservations ['33780dd9-258c-45d7-957e-13e082bc3596', '92347819-d4ba-4432-ada2-5ca6d864dbbd', 'cf813333-5b73-4497-9a91-5917d50a4432', '86064cb2-e743-4c55-819e-863495f751c0'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:55:09 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-971a36c2-7ecb-4dd3-9ce2-380b69351c87 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:55:09 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-971a36c2-7ecb-4dd3-9ce2-380b69351c87 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:55:09 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-971a36c2-7ecb-4dd3-9ce2-380b69351c87 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:55:09 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-971a36c2-7ecb-4dd3-9ce2-380b69351c87 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:55:09 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-971a36c2-7ecb-4dd3-9ce2-380b69351c87 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:55:09 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-971a36c2-7ecb-4dd3-9ce2-380b69351c87 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:09 devstack sudo[99919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:55:09 devstack sudo[99919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:09 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-8190bf05-1695-4d5e-a675-6fb642f67c7b tempest-CreateVolumesFromSnapshotTest-2024832147 None] Acquiring lock "cinder-f7df8d58-9fd3-4316-9efd-eb84ca10ac6b-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:55:09 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-8190bf05-1695-4d5e-a675-6fb642f67c7b tempest-CreateVolumesFromSnapshotTest-2024832147 None] Lock "cinder-f7df8d58-9fd3-4316-9efd-eb84ca10ac6b-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:55:09 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-8190bf05-1695-4d5e-a675-6fb642f67c7b tempest-CreateVolumesFromSnapshotTest-2024832147 None] Acquiring lock "cinder-quobyte-f7df8d58-9fd3-4316-9efd-eb84ca10ac6b" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:55:09 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-8190bf05-1695-4d5e-a675-6fb642f67c7b tempest-CreateVolumesFromSnapshotTest-2024832147 None] Lock "cinder-quobyte-f7df8d58-9fd3-4316-9efd-eb84ca10ac6b" acquired by "delete_volume" :: waited 0.031s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:55:09 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e917c9c8-b314-467e-b951-c216847c7072]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:55:09 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-8190bf05-1695-4d5e-a675-6fb642f67c7b tempest-CreateVolumesFromSnapshotTest-2024832147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-f7df8d58-9fd3-4316-9efd-eb84ca10ac6b {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:09 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-e0c9998e-2d59-40ac-88f4-08d65b216d1e tempest-SnapshotsActionsTest-1914407753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:55:09 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-e0c9998e-2d59-40ac-88f4-08d65b216d1e tempest-SnapshotsActionsTest-1914407753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:55:09 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-e0c9998e-2d59-40ac-88f4-08d65b216d1e tempest-SnapshotsActionsTest-1914407753 None] Creating offline snapshot 97ddfd74-8d22-4d02-a38b-3bec2ba976bd of volume 2a338138-ed36-447f-bf04-1f3e19ab34b9 {{(pid=91863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 15 15:55:09 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c2fd1d0-7883-4e96-8d4f-582ddcf621a8]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:55:09 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-e0c9998e-2d59-40ac-88f4-08d65b216d1e tempest-SnapshotsActionsTest-1914407753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:09 devstack sudo[99922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-f7df8d58-9fd3-4316-9efd-eb84ca10ac6b
Jun 15 15:55:09 devstack sudo[99922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:09 devstack sudo[99919]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:09 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-971a36c2-7ecb-4dd3-9ce2-380b69351c87 tempest-CreateVolumesFromSnapshotTest-2024832147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.817s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:09 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-971a36c2-7ecb-4dd3-9ce2-380b69351c87 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:55:09 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-971a36c2-7ecb-4dd3-9ce2-380b69351c87 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Deleted volume successfully.
Jun 15 15:55:09 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-971a36c2-7ecb-4dd3-9ce2-380b69351c87 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Lock "cinder-902b693d-3fab-4da6-9f50-db652bd8c924-delete_volume" released by "delete_volume" :: held 2.773s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:55:09 devstack sudo[99924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9
Jun 15 15:55:09 devstack sudo[99924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:10 devstack sudo[99922]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:10 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-8190bf05-1695-4d5e-a675-6fb642f67c7b tempest-CreateVolumesFromSnapshotTest-2024832147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-f7df8d58-9fd3-4316-9efd-eb84ca10ac6b" returned: 0 in 0.820s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:10 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-8190bf05-1695-4d5e-a675-6fb642f67c7b tempest-CreateVolumesFromSnapshotTest-2024832147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-f7df8d58-9fd3-4316-9efd-eb84ca10ac6b {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:10 devstack sudo[99934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-f7df8d58-9fd3-4316-9efd-eb84ca10ac6b
Jun 15 15:55:10 devstack sudo[99934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:10 devstack sudo[99924]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:10 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-e0c9998e-2d59-40ac-88f4-08d65b216d1e tempest-SnapshotsActionsTest-1914407753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9" returned: 0 in 0.834s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:10 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-e0c9998e-2d59-40ac-88f4-08d65b216d1e tempest-SnapshotsActionsTest-1914407753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.97ddfd74-8d22-4d02-a38b-3bec2ba976bd 1G {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:10 devstack sudo[99936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.97ddfd74-8d22-4d02-a38b-3bec2ba976bd 1G
Jun 15 15:55:10 devstack sudo[99936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:11 devstack sudo[99934]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:11 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-8190bf05-1695-4d5e-a675-6fb642f67c7b tempest-CreateVolumesFromSnapshotTest-2024832147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-f7df8d58-9fd3-4316-9efd-eb84ca10ac6b" returned: 0 in 0.681s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:11 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-8190bf05-1695-4d5e-a675-6fb642f67c7b tempest-CreateVolumesFromSnapshotTest-2024832147 None] Lock "cinder-quobyte-f7df8d58-9fd3-4316-9efd-eb84ca10ac6b" released by "delete_volume" :: held 1.554s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:55:11 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-8190bf05-1695-4d5e-a675-6fb642f67c7b tempest-CreateVolumesFromSnapshotTest-2024832147 None] Created reservations ['e99f4b38-e248-4702-8165-bfba15ea16a0', 'd0672b13-0d47-4405-b409-8cf8c897bcf1', 'de8bb8a9-3096-4377-ab9f-4599ebf09d2d', '477db778-ab25-4319-9ceb-7b84ce14fea6'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:55:11 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-8190bf05-1695-4d5e-a675-6fb642f67c7b tempest-CreateVolumesFromSnapshotTest-2024832147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:55:11 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-8190bf05-1695-4d5e-a675-6fb642f67c7b tempest-CreateVolumesFromSnapshotTest-2024832147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:55:11 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-8190bf05-1695-4d5e-a675-6fb642f67c7b tempest-CreateVolumesFromSnapshotTest-2024832147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:55:11 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-8190bf05-1695-4d5e-a675-6fb642f67c7b tempest-CreateVolumesFromSnapshotTest-2024832147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:55:11 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-8190bf05-1695-4d5e-a675-6fb642f67c7b tempest-CreateVolumesFromSnapshotTest-2024832147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:55:11 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-8190bf05-1695-4d5e-a675-6fb642f67c7b tempest-CreateVolumesFromSnapshotTest-2024832147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:11 devstack sudo[99944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:55:11 devstack sudo[99944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:11 devstack sudo[99936]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:11 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-e0c9998e-2d59-40ac-88f4-08d65b216d1e tempest-SnapshotsActionsTest-1914407753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.97ddfd74-8d22-4d02-a38b-3bec2ba976bd 1G" returned: 0 in 0.932s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:11 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-e0c9998e-2d59-40ac-88f4-08d65b216d1e tempest-SnapshotsActionsTest-1914407753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a338138-ed36-447f-bf04-1f3e19ab34b9 -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.97ddfd74-8d22-4d02-a38b-3bec2ba976bd {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:11 devstack sudo[99946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a338138-ed36-447f-bf04-1f3e19ab34b9 -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.97ddfd74-8d22-4d02-a38b-3bec2ba976bd
Jun 15 15:55:11 devstack sudo[99946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:11 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-446e056b-a4e4-4d73-88fc-2f5d3b27dcb4 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Acquiring lock "cinder-9798e563-cd4c-4e20-b2f9-fb459fcdad5d-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:55:11 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-446e056b-a4e4-4d73-88fc-2f5d3b27dcb4 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Lock "cinder-9798e563-cd4c-4e20-b2f9-fb459fcdad5d-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:55:12 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-446e056b-a4e4-4d73-88fc-2f5d3b27dcb4 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Acquiring lock "cinder-quobyte-9798e563-cd4c-4e20-b2f9-fb459fcdad5d" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:55:12 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-446e056b-a4e4-4d73-88fc-2f5d3b27dcb4 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Lock "cinder-quobyte-9798e563-cd4c-4e20-b2f9-fb459fcdad5d" acquired by "delete_volume" :: waited 0.019s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:55:12 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[6943ef67-d467-44a2-bcd8-17b1627f4146]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:55:12 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-446e056b-a4e4-4d73-88fc-2f5d3b27dcb4 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-9798e563-cd4c-4e20-b2f9-fb459fcdad5d {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:12 devstack sudo[99944]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:12 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-8190bf05-1695-4d5e-a675-6fb642f67c7b tempest-CreateVolumesFromSnapshotTest-2024832147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.820s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:12 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-8190bf05-1695-4d5e-a675-6fb642f67c7b tempest-CreateVolumesFromSnapshotTest-2024832147 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:55:12 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-8190bf05-1695-4d5e-a675-6fb642f67c7b tempest-CreateVolumesFromSnapshotTest-2024832147 None] Deleted volume successfully.
Jun 15 15:55:12 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-8190bf05-1695-4d5e-a675-6fb642f67c7b tempest-CreateVolumesFromSnapshotTest-2024832147 None] Lock "cinder-f7df8d58-9fd3-4316-9efd-eb84ca10ac6b-delete_volume" released by "delete_volume" :: held 2.676s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:55:12 devstack sudo[99950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-9798e563-cd4c-4e20-b2f9-fb459fcdad5d
Jun 15 15:55:12 devstack sudo[99950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:12 devstack sudo[99946]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:12 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-e0c9998e-2d59-40ac-88f4-08d65b216d1e tempest-SnapshotsActionsTest-1914407753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a338138-ed36-447f-bf04-1f3e19ab34b9 -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.97ddfd74-8d22-4d02-a38b-3bec2ba976bd" returned: 0 in 0.844s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:12 devstack cinder-volume[91863]: WARNING cinder.volume.drivers.remotefs [None req-e0c9998e-2d59-40ac-88f4-08d65b216d1e tempest-SnapshotsActionsTest-1914407753 None] /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.97ddfd74-8d22-4d02-a38b-3bec2ba976bd is being set with open permissions: ugo+rw
Jun 15 15:55:12 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-e0c9998e-2d59-40ac-88f4-08d65b216d1e tempest-SnapshotsActionsTest-1914407753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.97ddfd74-8d22-4d02-a38b-3bec2ba976bd {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:12 devstack sudo[99955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.97ddfd74-8d22-4d02-a38b-3bec2ba976bd
Jun 15 15:55:12 devstack sudo[99955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:12 devstack sudo[99950]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:12 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-446e056b-a4e4-4d73-88fc-2f5d3b27dcb4 tempest-CreateVolumesFromSnapshotTest-2024832147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-9798e563-cd4c-4e20-b2f9-fb459fcdad5d" returned: 0 in 0.753s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:12 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-446e056b-a4e4-4d73-88fc-2f5d3b27dcb4 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-9798e563-cd4c-4e20-b2f9-fb459fcdad5d {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:12 devstack sudo[99960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-9798e563-cd4c-4e20-b2f9-fb459fcdad5d
Jun 15 15:55:12 devstack sudo[99960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:13 devstack sudo[99955]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-e0c9998e-2d59-40ac-88f4-08d65b216d1e tempest-SnapshotsActionsTest-1914407753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.97ddfd74-8d22-4d02-a38b-3bec2ba976bd" returned: 0 in 0.687s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-e0c9998e-2d59-40ac-88f4-08d65b216d1e tempest-SnapshotsActionsTest-1914407753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.info {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:13 devstack sudo[99963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.info
Jun 15 15:55:13 devstack sudo[99963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:13 devstack sudo[99960]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-446e056b-a4e4-4d73-88fc-2f5d3b27dcb4 tempest-CreateVolumesFromSnapshotTest-2024832147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-9798e563-cd4c-4e20-b2f9-fb459fcdad5d" returned: 0 in 0.666s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:13 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-446e056b-a4e4-4d73-88fc-2f5d3b27dcb4 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Lock "cinder-quobyte-9798e563-cd4c-4e20-b2f9-fb459fcdad5d" released by "delete_volume" :: held 1.478s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:55:13 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-446e056b-a4e4-4d73-88fc-2f5d3b27dcb4 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Created reservations ['7d5c9b46-d31b-4784-be4a-3a52f953c6bc', '09989805-7e65-4ffb-a3f5-9898f0d976ff', '682aacee-5c1c-44b8-bfb9-eb395f23c7c2', '41be47e1-9f59-4df7-aaeb-9047a730fa8f'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:55:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-446e056b-a4e4-4d73-88fc-2f5d3b27dcb4 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:55:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-446e056b-a4e4-4d73-88fc-2f5d3b27dcb4 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:55:13 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-446e056b-a4e4-4d73-88fc-2f5d3b27dcb4 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:55:13 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-446e056b-a4e4-4d73-88fc-2f5d3b27dcb4 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:55:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-446e056b-a4e4-4d73-88fc-2f5d3b27dcb4 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:55:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-446e056b-a4e4-4d73-88fc-2f5d3b27dcb4 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:13 devstack sudo[99966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:55:13 devstack sudo[99966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:13 devstack sudo[99963]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-e0c9998e-2d59-40ac-88f4-08d65b216d1e tempest-SnapshotsActionsTest-1914407753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.info" returned: 0 in 0.769s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:13 devstack cinder-volume[91863]: WARNING cinder.volume.drivers.remotefs [None req-e0c9998e-2d59-40ac-88f4-08d65b216d1e tempest-SnapshotsActionsTest-1914407753 None] /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.info is being set with open permissions: ugo+rw
Jun 15 15:55:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-e0c9998e-2d59-40ac-88f4-08d65b216d1e tempest-SnapshotsActionsTest-1914407753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.info {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:13 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-3fe761e1-5861-4050-a85c-84ff50abef2d tempest-AttachVolumeNegativeTest-1849283913 None] Acquiring lock "cinder-61afa8b6-adb7-49da-905b-587d2f9d9743-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:55:13 devstack sudo[99969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.info
Jun 15 15:55:13 devstack sudo[99969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:13 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-3fe761e1-5861-4050-a85c-84ff50abef2d tempest-AttachVolumeNegativeTest-1849283913 None] Lock "cinder-61afa8b6-adb7-49da-905b-587d2f9d9743-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:55:13 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-3fe761e1-5861-4050-a85c-84ff50abef2d tempest-AttachVolumeNegativeTest-1849283913 None] Acquiring lock "cinder-quobyte-61afa8b6-adb7-49da-905b-587d2f9d9743" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:55:14 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-3fe761e1-5861-4050-a85c-84ff50abef2d tempest-AttachVolumeNegativeTest-1849283913 None] Lock "cinder-quobyte-61afa8b6-adb7-49da-905b-587d2f9d9743" acquired by "delete_volume" :: waited 0.016s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:55:14 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b54c24-246d-4325-95f3-310e45f3d116]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:55:14 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3fe761e1-5861-4050-a85c-84ff50abef2d tempest-AttachVolumeNegativeTest-1849283913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-61afa8b6-adb7-49da-905b-587d2f9d9743 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:14 devstack sudo[99971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-61afa8b6-adb7-49da-905b-587d2f9d9743
Jun 15 15:55:14 devstack sudo[99971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:14 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-2f3de185-cbe7-4998-9473-0d1f3d5a9ac3 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Acquiring lock "cinder-ab092b55-a0ba-41a7-a609-dcb597274873-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:55:14 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-2f3de185-cbe7-4998-9473-0d1f3d5a9ac3 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Lock "cinder-ab092b55-a0ba-41a7-a609-dcb597274873-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:55:14 devstack sudo[99966]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:14 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-446e056b-a4e4-4d73-88fc-2f5d3b27dcb4 tempest-CreateVolumesFromSnapshotTest-2024832147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.719s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:14 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-446e056b-a4e4-4d73-88fc-2f5d3b27dcb4 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:55:14 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-446e056b-a4e4-4d73-88fc-2f5d3b27dcb4 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Deleted volume successfully.
Jun 15 15:55:14 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-2f3de185-cbe7-4998-9473-0d1f3d5a9ac3 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Acquiring lock "cinder-quobyte-ab092b55-a0ba-41a7-a609-dcb597274873" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:55:14 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-2f3de185-cbe7-4998-9473-0d1f3d5a9ac3 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Lock "cinder-quobyte-ab092b55-a0ba-41a7-a609-dcb597274873" acquired by "delete_volume" :: waited 0.025s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:55:14 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-446e056b-a4e4-4d73-88fc-2f5d3b27dcb4 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Lock "cinder-9798e563-cd4c-4e20-b2f9-fb459fcdad5d-delete_volume" released by "delete_volume" :: held 2.527s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:55:14 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[17084141-a071-4afc-a6f7-908a34717aab]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:55:14 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-2f3de185-cbe7-4998-9473-0d1f3d5a9ac3 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-ab092b55-a0ba-41a7-a609-dcb597274873 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:14 devstack sudo[100061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-ab092b55-a0ba-41a7-a609-dcb597274873
Jun 15 15:55:14 devstack sudo[100061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:14 devstack sudo[99969]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:14 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-e0c9998e-2d59-40ac-88f4-08d65b216d1e tempest-SnapshotsActionsTest-1914407753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.info" returned: 0 in 0.819s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:14 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-e0c9998e-2d59-40ac-88f4-08d65b216d1e tempest-SnapshotsActionsTest-1914407753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.016s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:55:14 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-e0c9998e-2d59-40ac-88f4-08d65b216d1e tempest-SnapshotsActionsTest-1914407753 None] Create snapshot completed successfully
Jun 15 15:55:14 devstack sudo[99971]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:14 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3fe761e1-5861-4050-a85c-84ff50abef2d tempest-AttachVolumeNegativeTest-1849283913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-61afa8b6-adb7-49da-905b-587d2f9d9743" returned: 0 in 0.898s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:14 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3fe761e1-5861-4050-a85c-84ff50abef2d tempest-AttachVolumeNegativeTest-1849283913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-61afa8b6-adb7-49da-905b-587d2f9d9743 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:14 devstack sudo[100068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-61afa8b6-adb7-49da-905b-587d2f9d9743
Jun 15 15:55:14 devstack sudo[100068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:15 devstack sudo[100061]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:15 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-2f3de185-cbe7-4998-9473-0d1f3d5a9ac3 tempest-CreateVolumesFromSnapshotTest-2024832147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-ab092b55-a0ba-41a7-a609-dcb597274873" returned: 0 in 0.752s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:15 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-2f3de185-cbe7-4998-9473-0d1f3d5a9ac3 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-ab092b55-a0ba-41a7-a609-dcb597274873 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:15 devstack sudo[100073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-ab092b55-a0ba-41a7-a609-dcb597274873
Jun 15 15:55:15 devstack sudo[100073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:15 devstack sudo[100068]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:15 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3fe761e1-5861-4050-a85c-84ff50abef2d tempest-AttachVolumeNegativeTest-1849283913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-61afa8b6-adb7-49da-905b-587d2f9d9743" returned: 0 in 0.656s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:15 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-3fe761e1-5861-4050-a85c-84ff50abef2d tempest-AttachVolumeNegativeTest-1849283913 None] Lock "cinder-quobyte-61afa8b6-adb7-49da-905b-587d2f9d9743" released by "delete_volume" :: held 1.600s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:55:15 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-bdb5e9dc-7563-4004-bdf6-e3f423cac5ec tempest-SnapshotsActionsTest-1914407753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:55:15 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-bdb5e9dc-7563-4004-bdf6-e3f423cac5ec tempest-SnapshotsActionsTest-1914407753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:55:15 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-bdb5e9dc-7563-4004-bdf6-e3f423cac5ec tempest-SnapshotsActionsTest-1914407753 None] Creating offline snapshot 97a519db-50a9-4eb9-a968-69ca71f327fb of volume 2a338138-ed36-447f-bf04-1f3e19ab34b9 {{(pid=91863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 15 15:55:15 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[51247696-a127-4ef4-8f87-f4548c86e8b5]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:55:15 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-bdb5e9dc-7563-4004-bdf6-e3f423cac5ec tempest-SnapshotsActionsTest-1914407753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.97ddfd74-8d22-4d02-a38b-3bec2ba976bd {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:15 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-3fe761e1-5861-4050-a85c-84ff50abef2d tempest-AttachVolumeNegativeTest-1849283913 None] Created reservations ['98a65fcd-45de-4095-abf4-9c0757a6f476', '1f268139-f0af-4ff7-946b-dcffe01c8491', '603c8419-03b1-4418-a943-438609e5c86e', 'efc3c8e9-59b2-4f26-9341-04c209c74d4c'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:55:15 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-3fe761e1-5861-4050-a85c-84ff50abef2d tempest-AttachVolumeNegativeTest-1849283913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:55:15 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-3fe761e1-5861-4050-a85c-84ff50abef2d tempest-AttachVolumeNegativeTest-1849283913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:55:15 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-3fe761e1-5861-4050-a85c-84ff50abef2d tempest-AttachVolumeNegativeTest-1849283913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:55:15 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-3fe761e1-5861-4050-a85c-84ff50abef2d tempest-AttachVolumeNegativeTest-1849283913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:55:15 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-3fe761e1-5861-4050-a85c-84ff50abef2d tempest-AttachVolumeNegativeTest-1849283913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:55:15 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3fe761e1-5861-4050-a85c-84ff50abef2d tempest-AttachVolumeNegativeTest-1849283913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:15 devstack sudo[100078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:55:15 devstack sudo[100078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:15 devstack sudo[100076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.97ddfd74-8d22-4d02-a38b-3bec2ba976bd
Jun 15 15:55:15 devstack sudo[100076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:15 devstack sudo[100073]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:15 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-2f3de185-cbe7-4998-9473-0d1f3d5a9ac3 tempest-CreateVolumesFromSnapshotTest-2024832147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-ab092b55-a0ba-41a7-a609-dcb597274873" returned: 0 in 0.693s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:15 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-2f3de185-cbe7-4998-9473-0d1f3d5a9ac3 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Lock "cinder-quobyte-ab092b55-a0ba-41a7-a609-dcb597274873" released by "delete_volume" :: held 1.498s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:55:16 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-2f3de185-cbe7-4998-9473-0d1f3d5a9ac3 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Created reservations ['ba7194c5-c60c-4331-9dc9-62fae3f5c041', '77241666-825b-48ef-ab00-0dfc28452e45', '21af8518-02ff-463b-ad5d-9d1fb20760cb', 'd4bd7552-a1ec-4587-b01e-5a1dfdfff274'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:55:16 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-2f3de185-cbe7-4998-9473-0d1f3d5a9ac3 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:55:16 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-2f3de185-cbe7-4998-9473-0d1f3d5a9ac3 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:55:16 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-2f3de185-cbe7-4998-9473-0d1f3d5a9ac3 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:55:16 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-2f3de185-cbe7-4998-9473-0d1f3d5a9ac3 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:55:16 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-2f3de185-cbe7-4998-9473-0d1f3d5a9ac3 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:55:16 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-2f3de185-cbe7-4998-9473-0d1f3d5a9ac3 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:16 devstack sudo[100081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:55:16 devstack sudo[100081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:16 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-648d6a04-04e2-436b-96a1-9faf58768f41 tempest-AttachVolumeNegativeTest-1849283913 None] Acquiring lock "cinder-8a9c0a20-63c6-46eb-9e6f-acab6da750fa-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:55:16 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-648d6a04-04e2-436b-96a1-9faf58768f41 tempest-AttachVolumeNegativeTest-1849283913 None] Lock "cinder-8a9c0a20-63c6-46eb-9e6f-acab6da750fa-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:55:16 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-648d6a04-04e2-436b-96a1-9faf58768f41 tempest-AttachVolumeNegativeTest-1849283913 None] Acquiring lock "cinder-quobyte-8a9c0a20-63c6-46eb-9e6f-acab6da750fa" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:55:16 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-648d6a04-04e2-436b-96a1-9faf58768f41 tempest-AttachVolumeNegativeTest-1849283913 None] Lock "cinder-quobyte-8a9c0a20-63c6-46eb-9e6f-acab6da750fa" acquired by "delete_volume" :: waited 0.027s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:55:16 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb11058-3e97-4f7b-8334-850ea32dd9cc]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:55:16 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-648d6a04-04e2-436b-96a1-9faf58768f41 tempest-AttachVolumeNegativeTest-1849283913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8a9c0a20-63c6-46eb-9e6f-acab6da750fa {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:16 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-ee162917-abc7-4c17-8d38-3dd027c06035 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Acquiring lock "cinder-98025975-34c6-4562-b689-7119a58c970e-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:55:16 devstack sudo[100078]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:16 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3fe761e1-5861-4050-a85c-84ff50abef2d tempest-AttachVolumeNegativeTest-1849283913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.923s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:16 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-3fe761e1-5861-4050-a85c-84ff50abef2d tempest-AttachVolumeNegativeTest-1849283913 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:55:16 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-ee162917-abc7-4c17-8d38-3dd027c06035 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Lock "cinder-98025975-34c6-4562-b689-7119a58c970e-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:55:16 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-3fe761e1-5861-4050-a85c-84ff50abef2d tempest-AttachVolumeNegativeTest-1849283913 None] Deleted volume successfully.
Jun 15 15:55:16 devstack sudo[100084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8a9c0a20-63c6-46eb-9e6f-acab6da750fa
Jun 15 15:55:16 devstack sudo[100084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:16 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-3fe761e1-5861-4050-a85c-84ff50abef2d tempest-AttachVolumeNegativeTest-1849283913 None] Lock "cinder-61afa8b6-adb7-49da-905b-587d2f9d9743-delete_volume" released by "delete_volume" :: held 2.895s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:55:16 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-ee162917-abc7-4c17-8d38-3dd027c06035 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Acquiring lock "cinder-quobyte-98025975-34c6-4562-b689-7119a58c970e" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:55:16 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-ee162917-abc7-4c17-8d38-3dd027c06035 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Lock "cinder-quobyte-98025975-34c6-4562-b689-7119a58c970e" acquired by "delete_volume" :: waited 0.021s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:55:16 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d332ff0-68bd-4ecf-a711-a6c1742c2083]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:55:16 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ee162917-abc7-4c17-8d38-3dd027c06035 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-98025975-34c6-4562-b689-7119a58c970e {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:16 devstack sudo[100076]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:16 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-bdb5e9dc-7563-4004-bdf6-e3f423cac5ec tempest-SnapshotsActionsTest-1914407753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.97ddfd74-8d22-4d02-a38b-3bec2ba976bd" returned: 0 in 1.232s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:16 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-bdb5e9dc-7563-4004-bdf6-e3f423cac5ec tempest-SnapshotsActionsTest-1914407753 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a338138-ed36-447f-bf04-1f3e19ab34b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 15:55:16 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-bdb5e9dc-7563-4004-bdf6-e3f423cac5ec tempest-SnapshotsActionsTest-1914407753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.97ddfd74-8d22-4d02-a38b-3bec2ba976bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.97a519db-50a9-4eb9-a968-69ca71f327fb 1G {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:17 devstack sudo[100091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.97ddfd74-8d22-4d02-a38b-3bec2ba976bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.97a519db-50a9-4eb9-a968-69ca71f327fb 1G
Jun 15 15:55:17 devstack sudo[100091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:17 devstack sudo[100090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-98025975-34c6-4562-b689-7119a58c970e
Jun 15 15:55:17 devstack sudo[100090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:17 devstack sudo[100081]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:17 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-2f3de185-cbe7-4998-9473-0d1f3d5a9ac3 tempest-CreateVolumesFromSnapshotTest-2024832147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 1.274s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:17 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-2f3de185-cbe7-4998-9473-0d1f3d5a9ac3 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:55:17 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-2f3de185-cbe7-4998-9473-0d1f3d5a9ac3 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Deleted volume successfully.
Jun 15 15:55:17 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-2f3de185-cbe7-4998-9473-0d1f3d5a9ac3 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Lock "cinder-ab092b55-a0ba-41a7-a609-dcb597274873-delete_volume" released by "delete_volume" :: held 3.144s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:55:17 devstack sudo[100084]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:17 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-648d6a04-04e2-436b-96a1-9faf58768f41 tempest-AttachVolumeNegativeTest-1849283913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8a9c0a20-63c6-46eb-9e6f-acab6da750fa" returned: 0 in 1.313s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:17 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-648d6a04-04e2-436b-96a1-9faf58768f41 tempest-AttachVolumeNegativeTest-1849283913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8a9c0a20-63c6-46eb-9e6f-acab6da750fa {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:17 devstack sudo[100105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8a9c0a20-63c6-46eb-9e6f-acab6da750fa
Jun 15 15:55:17 devstack sudo[100105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:18 devstack sudo[100090]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:18 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ee162917-abc7-4c17-8d38-3dd027c06035 tempest-CreateVolumesFromSnapshotTest-2024832147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-98025975-34c6-4562-b689-7119a58c970e" returned: 0 in 1.209s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:18 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ee162917-abc7-4c17-8d38-3dd027c06035 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-98025975-34c6-4562-b689-7119a58c970e {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:18 devstack sudo[100091]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:18 devstack sudo[100109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-98025975-34c6-4562-b689-7119a58c970e
Jun 15 15:55:18 devstack sudo[100109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:18 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-bdb5e9dc-7563-4004-bdf6-e3f423cac5ec tempest-SnapshotsActionsTest-1914407753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.97ddfd74-8d22-4d02-a38b-3bec2ba976bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.97a519db-50a9-4eb9-a968-69ca71f327fb 1G" returned: 0 in 1.216s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:18 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-bdb5e9dc-7563-4004-bdf6-e3f423cac5ec tempest-SnapshotsActionsTest-1914407753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.97ddfd74-8d22-4d02-a38b-3bec2ba976bd -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.97a519db-50a9-4eb9-a968-69ca71f327fb {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:18 devstack sudo[100111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.97ddfd74-8d22-4d02-a38b-3bec2ba976bd -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.97a519db-50a9-4eb9-a968-69ca71f327fb
Jun 15 15:55:18 devstack sudo[100111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:18 devstack sudo[100105]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:18 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-648d6a04-04e2-436b-96a1-9faf58768f41 tempest-AttachVolumeNegativeTest-1849283913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8a9c0a20-63c6-46eb-9e6f-acab6da750fa" returned: 0 in 0.848s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:18 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-648d6a04-04e2-436b-96a1-9faf58768f41 tempest-AttachVolumeNegativeTest-1849283913 None] Lock "cinder-quobyte-8a9c0a20-63c6-46eb-9e6f-acab6da750fa" released by "delete_volume" :: held 2.226s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:55:18 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-648d6a04-04e2-436b-96a1-9faf58768f41 tempest-AttachVolumeNegativeTest-1849283913 None] Created reservations ['0d25311b-3d3d-4bc6-a04b-3571b7830b47', 'd04788f7-9e43-44dd-b27c-34714e4b8466', 'ab2f30e4-f0db-471f-b187-eb2e8e5adc6e', '515857ff-323e-43e8-bec7-a852416aee25'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:55:18 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-648d6a04-04e2-436b-96a1-9faf58768f41 tempest-AttachVolumeNegativeTest-1849283913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:55:18 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-648d6a04-04e2-436b-96a1-9faf58768f41 tempest-AttachVolumeNegativeTest-1849283913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:55:18 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-648d6a04-04e2-436b-96a1-9faf58768f41 tempest-AttachVolumeNegativeTest-1849283913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:55:18 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-648d6a04-04e2-436b-96a1-9faf58768f41 tempest-AttachVolumeNegativeTest-1849283913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:55:18 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-648d6a04-04e2-436b-96a1-9faf58768f41 tempest-AttachVolumeNegativeTest-1849283913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:55:18 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-648d6a04-04e2-436b-96a1-9faf58768f41 tempest-AttachVolumeNegativeTest-1849283913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:18 devstack sudo[100136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:55:18 devstack sudo[100136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:19 devstack sudo[100109]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:19 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ee162917-abc7-4c17-8d38-3dd027c06035 tempest-CreateVolumesFromSnapshotTest-2024832147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-98025975-34c6-4562-b689-7119a58c970e" returned: 0 in 0.964s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:19 devstack sudo[100111]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:19 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-ee162917-abc7-4c17-8d38-3dd027c06035 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Lock "cinder-quobyte-98025975-34c6-4562-b689-7119a58c970e" released by "delete_volume" :: held 2.228s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:55:19 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-bdb5e9dc-7563-4004-bdf6-e3f423cac5ec tempest-SnapshotsActionsTest-1914407753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.97ddfd74-8d22-4d02-a38b-3bec2ba976bd -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.97a519db-50a9-4eb9-a968-69ca71f327fb" returned: 0 in 0.934s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:19 devstack cinder-volume[91863]: WARNING cinder.volume.drivers.remotefs [None req-bdb5e9dc-7563-4004-bdf6-e3f423cac5ec tempest-SnapshotsActionsTest-1914407753 None] /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.97a519db-50a9-4eb9-a968-69ca71f327fb is being set with open permissions: ugo+rw
Jun 15 15:55:19 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-bdb5e9dc-7563-4004-bdf6-e3f423cac5ec tempest-SnapshotsActionsTest-1914407753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.97a519db-50a9-4eb9-a968-69ca71f327fb {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:19 devstack sudo[100138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.97a519db-50a9-4eb9-a968-69ca71f327fb
Jun 15 15:55:19 devstack sudo[100138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:19 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-ee162917-abc7-4c17-8d38-3dd027c06035 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Created reservations ['1b397560-1456-4175-8211-724ff03584ab', 'aaf80930-f97b-49b6-ac0e-84fc46a09811', '2f942176-8ce1-4274-be48-6e45925ffbe9', '12abb820-49cf-46e9-9961-dfdd51fa4ed5'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:55:19 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-ee162917-abc7-4c17-8d38-3dd027c06035 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:55:19 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-ee162917-abc7-4c17-8d38-3dd027c06035 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:55:19 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-ee162917-abc7-4c17-8d38-3dd027c06035 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:55:19 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-ee162917-abc7-4c17-8d38-3dd027c06035 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:55:19 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-ee162917-abc7-4c17-8d38-3dd027c06035 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:55:19 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ee162917-abc7-4c17-8d38-3dd027c06035 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:19 devstack sudo[100140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:55:19 devstack sudo[100140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:19 devstack sudo[100136]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:19 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-648d6a04-04e2-436b-96a1-9faf58768f41 tempest-AttachVolumeNegativeTest-1849283913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.713s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:19 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-648d6a04-04e2-436b-96a1-9faf58768f41 tempest-AttachVolumeNegativeTest-1849283913 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:55:19 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-648d6a04-04e2-436b-96a1-9faf58768f41 tempest-AttachVolumeNegativeTest-1849283913 None] Deleted volume successfully.
Jun 15 15:55:19 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-648d6a04-04e2-436b-96a1-9faf58768f41 tempest-AttachVolumeNegativeTest-1849283913 None] Lock "cinder-8a9c0a20-63c6-46eb-9e6f-acab6da750fa-delete_volume" released by "delete_volume" :: held 3.292s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:55:19 devstack sudo[100138]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:19 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-bdb5e9dc-7563-4004-bdf6-e3f423cac5ec tempest-SnapshotsActionsTest-1914407753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.97a519db-50a9-4eb9-a968-69ca71f327fb" returned: 0 in 0.765s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:19 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-bdb5e9dc-7563-4004-bdf6-e3f423cac5ec tempest-SnapshotsActionsTest-1914407753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.253s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:55:19 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-bdb5e9dc-7563-4004-bdf6-e3f423cac5ec tempest-SnapshotsActionsTest-1914407753 None] Create snapshot completed successfully
Jun 15 15:55:20 devstack sudo[100140]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:20 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ee162917-abc7-4c17-8d38-3dd027c06035 tempest-CreateVolumesFromSnapshotTest-2024832147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.757s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:20 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-ee162917-abc7-4c17-8d38-3dd027c06035 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:55:20 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-ee162917-abc7-4c17-8d38-3dd027c06035 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Deleted volume successfully.
Jun 15 15:55:20 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-6e8a149b-b6e2-4b61-8bd5-61dafa0da87a tempest-AttachVolumeNegativeTest-1849283913 None] Acquiring lock "cinder-3e035bf0-f3e8-49ce-879b-cb9e64577e3f-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:55:20 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-6e8a149b-b6e2-4b61-8bd5-61dafa0da87a tempest-AttachVolumeNegativeTest-1849283913 None] Lock "cinder-3e035bf0-f3e8-49ce-879b-cb9e64577e3f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:55:20 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-ee162917-abc7-4c17-8d38-3dd027c06035 tempest-CreateVolumesFromSnapshotTest-2024832147 None] Lock "cinder-98025975-34c6-4562-b689-7119a58c970e-delete_volume" released by "delete_volume" :: held 3.334s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:55:20 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-0e642c22-5a86-4b77-8612-e4b9882adeab tempest-CreateVolumesFromSnapshotTest-2024832147 None] Acquiring lock "cinder-487e6706-9a09-42be-8194-07061803f676-delete_snapshot" by "delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:55:20 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-6e8a149b-b6e2-4b61-8bd5-61dafa0da87a tempest-AttachVolumeNegativeTest-1849283913 None] Acquiring lock "cinder-quobyte-3e035bf0-f3e8-49ce-879b-cb9e64577e3f" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:55:20 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-0e642c22-5a86-4b77-8612-e4b9882adeab tempest-CreateVolumesFromSnapshotTest-2024832147 None] Lock "cinder-487e6706-9a09-42be-8194-07061803f676-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:55:20 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-0e642c22-5a86-4b77-8612-e4b9882adeab tempest-CreateVolumesFromSnapshotTest-2024832147 None] Acquiring lock "cinder-quobyte-4cb29941-8cb1-4790-85ab-369cb1352144" by "delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:55:20 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-6e8a149b-b6e2-4b61-8bd5-61dafa0da87a tempest-AttachVolumeNegativeTest-1849283913 None] Lock "cinder-quobyte-3e035bf0-f3e8-49ce-879b-cb9e64577e3f" acquired by "delete_volume" :: waited 0.067s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:55:20 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-0e642c22-5a86-4b77-8612-e4b9882adeab tempest-CreateVolumesFromSnapshotTest-2024832147 None] Lock "cinder-quobyte-4cb29941-8cb1-4790-85ab-369cb1352144" acquired by "delete_snapshot" :: waited 0.065s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:55:20 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-0e642c22-5a86-4b77-8612-e4b9882adeab tempest-CreateVolumesFromSnapshotTest-2024832147 None] Acquiring lock "cinder-quobyte-487e6706-9a09-42be-8194-07061803f676" by "_delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:55:20 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4bacef9-c0e0-4421-be13-1c871e721f1f]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:55:20 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6e8a149b-b6e2-4b61-8bd5-61dafa0da87a tempest-AttachVolumeNegativeTest-1849283913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3e035bf0-f3e8-49ce-879b-cb9e64577e3f {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:20 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-0e642c22-5a86-4b77-8612-e4b9882adeab tempest-CreateVolumesFromSnapshotTest-2024832147 None] Lock "cinder-quobyte-487e6706-9a09-42be-8194-07061803f676" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:55:20 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-0e642c22-5a86-4b77-8612-e4b9882adeab tempest-CreateVolumesFromSnapshotTest-2024832147 None] Deleting offline snapshot 487e6706-9a09-42be-8194-07061803f676 of volume 4cb29941-8cb1-4790-85ab-369cb1352144 {{(pid=91863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 15 15:55:20 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-0e642c22-5a86-4b77-8612-e4b9882adeab tempest-CreateVolumesFromSnapshotTest-2024832147 None] snapshot_file for this snap is: volume-4cb29941-8cb1-4790-85ab-369cb1352144.487e6706-9a09-42be-8194-07061803f676 {{(pid=91863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 15 15:55:20 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3520114-baf3-4ccc-bc2c-de7585440f47]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:55:20 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-0e642c22-5a86-4b77-8612-e4b9882adeab tempest-CreateVolumesFromSnapshotTest-2024832147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4cb29941-8cb1-4790-85ab-369cb1352144.487e6706-9a09-42be-8194-07061803f676 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:20 devstack sudo[100146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3e035bf0-f3e8-49ce-879b-cb9e64577e3f
Jun 15 15:55:20 devstack sudo[100146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:20 devstack sudo[100147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4cb29941-8cb1-4790-85ab-369cb1352144.487e6706-9a09-42be-8194-07061803f676
Jun 15 15:55:20 devstack sudo[100147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:20 devstack sudo[100146]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:20 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6e8a149b-b6e2-4b61-8bd5-61dafa0da87a tempest-AttachVolumeNegativeTest-1849283913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3e035bf0-f3e8-49ce-879b-cb9e64577e3f" returned: 0 in 0.744s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:20 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6e8a149b-b6e2-4b61-8bd5-61dafa0da87a tempest-AttachVolumeNegativeTest-1849283913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3e035bf0-f3e8-49ce-879b-cb9e64577e3f {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:21 devstack sudo[100158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3e035bf0-f3e8-49ce-879b-cb9e64577e3f
Jun 15 15:55:21 devstack sudo[100158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:21 devstack sudo[100147]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-0e642c22-5a86-4b77-8612-e4b9882adeab tempest-CreateVolumesFromSnapshotTest-2024832147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4cb29941-8cb1-4790-85ab-369cb1352144.487e6706-9a09-42be-8194-07061803f676" returned: 0 in 0.765s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:21 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-0e642c22-5a86-4b77-8612-e4b9882adeab tempest-CreateVolumesFromSnapshotTest-2024832147 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4cb29941-8cb1-4790-85ab-369cb1352144(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 15:55:21 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-6e6da1de-a094-4a4b-8be1-7d8af0310e87 tempest-SnapshotsActionsTest-579875573 None] Acquiring lock "cinder-97a519db-50a9-4eb9-a968-69ca71f327fb-delete_snapshot" by "delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:55:21 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5646f598-acd2-4774-9c30-3764c496cdc1]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:55:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-0e642c22-5a86-4b77-8612-e4b9882adeab tempest-CreateVolumesFromSnapshotTest-2024832147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4cb29941-8cb1-4790-85ab-369cb1352144 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:21 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-6e6da1de-a094-4a4b-8be1-7d8af0310e87 tempest-SnapshotsActionsTest-579875573 None] Lock "cinder-97a519db-50a9-4eb9-a968-69ca71f327fb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:55:21 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-6e6da1de-a094-4a4b-8be1-7d8af0310e87 tempest-SnapshotsActionsTest-579875573 None] Acquiring lock "cinder-quobyte-2a338138-ed36-447f-bf04-1f3e19ab34b9" by "delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:55:21 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-6e6da1de-a094-4a4b-8be1-7d8af0310e87 tempest-SnapshotsActionsTest-579875573 None] Lock "cinder-quobyte-2a338138-ed36-447f-bf04-1f3e19ab34b9" acquired by "delete_snapshot" :: waited 0.014s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:55:21 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-6e6da1de-a094-4a4b-8be1-7d8af0310e87 tempest-SnapshotsActionsTest-579875573 None] Acquiring lock "cinder-quobyte-97a519db-50a9-4eb9-a968-69ca71f327fb" by "_delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:55:21 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-6e6da1de-a094-4a4b-8be1-7d8af0310e87 tempest-SnapshotsActionsTest-579875573 None] Lock "cinder-quobyte-97a519db-50a9-4eb9-a968-69ca71f327fb" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:55:21 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-6e6da1de-a094-4a4b-8be1-7d8af0310e87 tempest-SnapshotsActionsTest-579875573 None] Deleting offline snapshot 97a519db-50a9-4eb9-a968-69ca71f327fb of volume 2a338138-ed36-447f-bf04-1f3e19ab34b9 {{(pid=91863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 15 15:55:21 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-6e6da1de-a094-4a4b-8be1-7d8af0310e87 tempest-SnapshotsActionsTest-579875573 None] snapshot_file for this snap is: volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.97a519db-50a9-4eb9-a968-69ca71f327fb {{(pid=91863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 15 15:55:21 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2394611-a27d-4500-8fd7-aea15caca3c8]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:55:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6e6da1de-a094-4a4b-8be1-7d8af0310e87 tempest-SnapshotsActionsTest-579875573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.97a519db-50a9-4eb9-a968-69ca71f327fb {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:21 devstack sudo[100160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4cb29941-8cb1-4790-85ab-369cb1352144
Jun 15 15:55:21 devstack sudo[100160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:21 devstack sudo[100161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.97a519db-50a9-4eb9-a968-69ca71f327fb
Jun 15 15:55:21 devstack sudo[100161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:21 devstack sudo[100158]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6e8a149b-b6e2-4b61-8bd5-61dafa0da87a tempest-AttachVolumeNegativeTest-1849283913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3e035bf0-f3e8-49ce-879b-cb9e64577e3f" returned: 0 in 0.778s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:21 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-6e8a149b-b6e2-4b61-8bd5-61dafa0da87a tempest-AttachVolumeNegativeTest-1849283913 None] Lock "cinder-quobyte-3e035bf0-f3e8-49ce-879b-cb9e64577e3f" released by "delete_volume" :: held 1.574s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:55:21 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-6e8a149b-b6e2-4b61-8bd5-61dafa0da87a tempest-AttachVolumeNegativeTest-1849283913 None] Created reservations ['4929d9d3-eeaa-4abb-bacd-787a86104b9c', '690b6993-7625-4afb-826f-9d55153469e7', 'df9ba68b-222d-4e4d-8f06-ca986109a4b3', '70acec0e-8660-41d1-aacc-c77b5e8b8225'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:55:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6e8a149b-b6e2-4b61-8bd5-61dafa0da87a tempest-AttachVolumeNegativeTest-1849283913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:55:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6e8a149b-b6e2-4b61-8bd5-61dafa0da87a tempest-AttachVolumeNegativeTest-1849283913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:55:21 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6e8a149b-b6e2-4b61-8bd5-61dafa0da87a tempest-AttachVolumeNegativeTest-1849283913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:55:21 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6e8a149b-b6e2-4b61-8bd5-61dafa0da87a tempest-AttachVolumeNegativeTest-1849283913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:55:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6e8a149b-b6e2-4b61-8bd5-61dafa0da87a tempest-AttachVolumeNegativeTest-1849283913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:55:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6e8a149b-b6e2-4b61-8bd5-61dafa0da87a tempest-AttachVolumeNegativeTest-1849283913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:21 devstack sudo[100160]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-0e642c22-5a86-4b77-8612-e4b9882adeab tempest-CreateVolumesFromSnapshotTest-2024832147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4cb29941-8cb1-4790-85ab-369cb1352144" returned: 0 in 0.811s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-0e642c22-5a86-4b77-8612-e4b9882adeab tempest-CreateVolumesFromSnapshotTest-2024832147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4cb29941-8cb1-4790-85ab-369cb1352144.487e6706-9a09-42be-8194-07061803f676 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:21 devstack sudo[100171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:55:21 devstack sudo[100171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:21 devstack sudo[100172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4cb29941-8cb1-4790-85ab-369cb1352144.487e6706-9a09-42be-8194-07061803f676
Jun 15 15:55:21 devstack sudo[100172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:22 devstack sudo[100161]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:22 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6e6da1de-a094-4a4b-8be1-7d8af0310e87 tempest-SnapshotsActionsTest-579875573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.97a519db-50a9-4eb9-a968-69ca71f327fb" returned: 0 in 0.784s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:22 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-6e6da1de-a094-4a4b-8be1-7d8af0310e87 tempest-SnapshotsActionsTest-579875573 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a338138-ed36-447f-bf04-1f3e19ab34b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 15:55:22 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdeec10c-2df3-4854-a365-77659ad91706]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:55:22 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6e6da1de-a094-4a4b-8be1-7d8af0310e87 tempest-SnapshotsActionsTest-579875573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.97ddfd74-8d22-4d02-a38b-3bec2ba976bd {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:22 devstack sudo[100175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.97ddfd74-8d22-4d02-a38b-3bec2ba976bd
Jun 15 15:55:22 devstack sudo[100175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:22 devstack sudo[100171]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:22 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6e8a149b-b6e2-4b61-8bd5-61dafa0da87a tempest-AttachVolumeNegativeTest-1849283913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.710s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:22 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-6e8a149b-b6e2-4b61-8bd5-61dafa0da87a tempest-AttachVolumeNegativeTest-1849283913 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:55:22 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-6e8a149b-b6e2-4b61-8bd5-61dafa0da87a tempest-AttachVolumeNegativeTest-1849283913 None] Deleted volume successfully.
Jun 15 15:55:22 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-6e8a149b-b6e2-4b61-8bd5-61dafa0da87a tempest-AttachVolumeNegativeTest-1849283913 None] Lock "cinder-3e035bf0-f3e8-49ce-879b-cb9e64577e3f-delete_volume" released by "delete_volume" :: held 2.580s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:55:22 devstack sudo[100172]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:22 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-0e642c22-5a86-4b77-8612-e4b9882adeab tempest-CreateVolumesFromSnapshotTest-2024832147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4cb29941-8cb1-4790-85ab-369cb1352144.487e6706-9a09-42be-8194-07061803f676" returned: 0 in 0.820s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:22 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-0e642c22-5a86-4b77-8612-e4b9882adeab tempest-CreateVolumesFromSnapshotTest-2024832147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4cb29941-8cb1-4790-85ab-369cb1352144.487e6706-9a09-42be-8194-07061803f676 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:22 devstack sudo[100185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4cb29941-8cb1-4790-85ab-369cb1352144.487e6706-9a09-42be-8194-07061803f676
Jun 15 15:55:22 devstack sudo[100185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:22 devstack sudo[100175]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:22 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6e6da1de-a094-4a4b-8be1-7d8af0310e87 tempest-SnapshotsActionsTest-579875573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.97ddfd74-8d22-4d02-a38b-3bec2ba976bd" returned: 0 in 0.931s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:22 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-6e6da1de-a094-4a4b-8be1-7d8af0310e87 tempest-SnapshotsActionsTest-579875573 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a338138-ed36-447f-bf04-1f3e19ab34b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 15:55:22 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6e6da1de-a094-4a4b-8be1-7d8af0310e87 tempest-SnapshotsActionsTest-579875573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.97a519db-50a9-4eb9-a968-69ca71f327fb {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:22 devstack sudo[100197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.97a519db-50a9-4eb9-a968-69ca71f327fb
Jun 15 15:55:23 devstack sudo[100197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:23 devstack sudo[100185]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:23 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-0e642c22-5a86-4b77-8612-e4b9882adeab tempest-CreateVolumesFromSnapshotTest-2024832147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4cb29941-8cb1-4790-85ab-369cb1352144.487e6706-9a09-42be-8194-07061803f676" returned: 0 in 0.660s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:23 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-0e642c22-5a86-4b77-8612-e4b9882adeab tempest-CreateVolumesFromSnapshotTest-2024832147 None] Lock "cinder-quobyte-487e6706-9a09-42be-8194-07061803f676" released by "_delete_snapshot" :: held 3.205s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:55:23 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-0e642c22-5a86-4b77-8612-e4b9882adeab tempest-CreateVolumesFromSnapshotTest-2024832147 None] Lock "cinder-quobyte-4cb29941-8cb1-4790-85ab-369cb1352144" released by "delete_snapshot" :: held 3.239s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:55:23 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-0e642c22-5a86-4b77-8612-e4b9882adeab tempest-CreateVolumesFromSnapshotTest-2024832147 None] Created reservations ['cb90ed84-d406-4017-bf78-ff4db396bffe', '8aca88ca-23c3-4d7c-8e51-6da181687116', 'a22e6e76-5eb8-4633-8f9a-25b239ba6770', 'd3eec805-2b28-4cd0-ba86-b51f40ac96a2'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:55:23 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-0e642c22-5a86-4b77-8612-e4b9882adeab tempest-CreateVolumesFromSnapshotTest-2024832147 None] Delete snapshot completed successfully.
Jun 15 15:55:23 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-0e642c22-5a86-4b77-8612-e4b9882adeab tempest-CreateVolumesFromSnapshotTest-2024832147 None] Lock "cinder-487e6706-9a09-42be-8194-07061803f676-delete_snapshot" released by "delete_snapshot" :: held 3.443s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:55:23 devstack sudo[100197]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:23 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6e6da1de-a094-4a4b-8be1-7d8af0310e87 tempest-SnapshotsActionsTest-579875573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.97a519db-50a9-4eb9-a968-69ca71f327fb" returned: 0 in 0.913s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:23 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6e6da1de-a094-4a4b-8be1-7d8af0310e87 tempest-SnapshotsActionsTest-579875573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.97a519db-50a9-4eb9-a968-69ca71f327fb {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:23 devstack sudo[100205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.97a519db-50a9-4eb9-a968-69ca71f327fb
Jun 15 15:55:23 devstack sudo[100205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:24 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-2aad9a34-c251-4090-becd-285c923557ca tempest-CreateVolumesFromSnapshotTest-2024832147 None] Acquiring lock "cinder-4cb29941-8cb1-4790-85ab-369cb1352144-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:55:24 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-2aad9a34-c251-4090-becd-285c923557ca tempest-CreateVolumesFromSnapshotTest-2024832147 None] Lock "cinder-4cb29941-8cb1-4790-85ab-369cb1352144-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:55:24 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-2aad9a34-c251-4090-becd-285c923557ca tempest-CreateVolumesFromSnapshotTest-2024832147 None] Acquiring lock "cinder-quobyte-4cb29941-8cb1-4790-85ab-369cb1352144" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:55:24 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-2aad9a34-c251-4090-becd-285c923557ca tempest-CreateVolumesFromSnapshotTest-2024832147 None] Lock "cinder-quobyte-4cb29941-8cb1-4790-85ab-369cb1352144" acquired by "delete_volume" :: waited 0.067s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:55:24 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[35116048-c9ad-4315-9384-048f6291b096]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:55:24 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-2aad9a34-c251-4090-becd-285c923557ca tempest-CreateVolumesFromSnapshotTest-2024832147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4cb29941-8cb1-4790-85ab-369cb1352144 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:24 devstack sudo[100205]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:24 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6e6da1de-a094-4a4b-8be1-7d8af0310e87 tempest-SnapshotsActionsTest-579875573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.97a519db-50a9-4eb9-a968-69ca71f327fb" returned: 0 in 0.845s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:24 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-6e6da1de-a094-4a4b-8be1-7d8af0310e87 tempest-SnapshotsActionsTest-579875573 None] Lock "cinder-quobyte-97a519db-50a9-4eb9-a968-69ca71f327fb" released by "_delete_snapshot" :: held 3.667s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:55:24 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-6e6da1de-a094-4a4b-8be1-7d8af0310e87 tempest-SnapshotsActionsTest-579875573 None] Lock "cinder-quobyte-2a338138-ed36-447f-bf04-1f3e19ab34b9" released by "delete_snapshot" :: held 3.706s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:55:24 devstack sudo[100233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4cb29941-8cb1-4790-85ab-369cb1352144
Jun 15 15:55:24 devstack sudo[100233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:25 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-6e6da1de-a094-4a4b-8be1-7d8af0310e87 tempest-SnapshotsActionsTest-579875573 None] Created reservations ['6e779436-5c11-4edb-921a-4e0a68662b0d', '357c29bf-1fef-46ec-9abe-ab963e8ce773', '88466e63-c733-41d2-b0f6-38c10d90b39e', '014b88ce-4cee-493c-bf16-5c84861b3ec1'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:55:25 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-6e6da1de-a094-4a4b-8be1-7d8af0310e87 tempest-SnapshotsActionsTest-579875573 None] Delete snapshot completed successfully.
Jun 15 15:55:25 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-6e6da1de-a094-4a4b-8be1-7d8af0310e87 tempest-SnapshotsActionsTest-579875573 None] Lock "cinder-97a519db-50a9-4eb9-a968-69ca71f327fb-delete_snapshot" released by "delete_snapshot" :: held 4.058s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:55:26 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-88075e30-2d46-4f38-9964-a99e7473d255 tempest-SnapshotsActionsTest-1914407753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:55:26 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-88075e30-2d46-4f38-9964-a99e7473d255 tempest-SnapshotsActionsTest-1914407753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:55:26 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-88075e30-2d46-4f38-9964-a99e7473d255 tempest-SnapshotsActionsTest-1914407753 None] Creating offline snapshot caf3ad7b-2562-46ac-b5aa-4082c360d299 of volume 2a338138-ed36-447f-bf04-1f3e19ab34b9 {{(pid=91863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 15 15:55:26 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a9336c-1e7a-406f-b88d-41863504ab17]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:55:26 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-88075e30-2d46-4f38-9964-a99e7473d255 tempest-SnapshotsActionsTest-1914407753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.97ddfd74-8d22-4d02-a38b-3bec2ba976bd {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:26 devstack sudo[100277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.97ddfd74-8d22-4d02-a38b-3bec2ba976bd
Jun 15 15:55:26 devstack sudo[100277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:26 devstack sudo[100233]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:26 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-2aad9a34-c251-4090-becd-285c923557ca tempest-CreateVolumesFromSnapshotTest-2024832147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4cb29941-8cb1-4790-85ab-369cb1352144" returned: 0 in 1.789s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:26 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-2aad9a34-c251-4090-becd-285c923557ca tempest-CreateVolumesFromSnapshotTest-2024832147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4cb29941-8cb1-4790-85ab-369cb1352144 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:26 devstack sudo[100280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4cb29941-8cb1-4790-85ab-369cb1352144
Jun 15 15:55:26 devstack sudo[100280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:27 devstack sudo[100280]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:27 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-2aad9a34-c251-4090-becd-285c923557ca tempest-CreateVolumesFromSnapshotTest-2024832147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4cb29941-8cb1-4790-85ab-369cb1352144" returned: 0 in 1.019s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:27 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-2aad9a34-c251-4090-becd-285c923557ca tempest-CreateVolumesFromSnapshotTest-2024832147 None] Lock "cinder-quobyte-4cb29941-8cb1-4790-85ab-369cb1352144" released by "delete_volume" :: held 2.955s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:55:27 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-2aad9a34-c251-4090-becd-285c923557ca tempest-CreateVolumesFromSnapshotTest-2024832147 None] Created reservations ['65d1e188-19c4-4d50-9221-3fe1ed98a01f', '5a869db5-30a3-46a2-80ad-c47a6a121c50', '4317fd87-dc09-4e62-95c6-fe3bb8076239', '3655e01e-c4fd-4826-bbd0-4be2d87eebd8'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:55:27 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-2aad9a34-c251-4090-becd-285c923557ca tempest-CreateVolumesFromSnapshotTest-2024832147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:55:27 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-2aad9a34-c251-4090-becd-285c923557ca tempest-CreateVolumesFromSnapshotTest-2024832147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:55:27 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-2aad9a34-c251-4090-becd-285c923557ca tempest-CreateVolumesFromSnapshotTest-2024832147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:55:27 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-2aad9a34-c251-4090-becd-285c923557ca tempest-CreateVolumesFromSnapshotTest-2024832147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:55:27 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-2aad9a34-c251-4090-becd-285c923557ca tempest-CreateVolumesFromSnapshotTest-2024832147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:55:27 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-2aad9a34-c251-4090-becd-285c923557ca tempest-CreateVolumesFromSnapshotTest-2024832147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:27 devstack sudo[100287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:55:27 devstack sudo[100287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:27 devstack sudo[100277]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:27 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-88075e30-2d46-4f38-9964-a99e7473d255 tempest-SnapshotsActionsTest-1914407753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.97ddfd74-8d22-4d02-a38b-3bec2ba976bd" returned: 0 in 1.567s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:27 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-88075e30-2d46-4f38-9964-a99e7473d255 tempest-SnapshotsActionsTest-1914407753 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a338138-ed36-447f-bf04-1f3e19ab34b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 15:55:27 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-88075e30-2d46-4f38-9964-a99e7473d255 tempest-SnapshotsActionsTest-1914407753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.97ddfd74-8d22-4d02-a38b-3bec2ba976bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.caf3ad7b-2562-46ac-b5aa-4082c360d299 1G {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:27 devstack sudo[100289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.97ddfd74-8d22-4d02-a38b-3bec2ba976bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.caf3ad7b-2562-46ac-b5aa-4082c360d299 1G
Jun 15 15:55:27 devstack sudo[100289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:28 devstack sudo[100287]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:28 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-2aad9a34-c251-4090-becd-285c923557ca tempest-CreateVolumesFromSnapshotTest-2024832147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 1.181s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:28 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-2aad9a34-c251-4090-becd-285c923557ca tempest-CreateVolumesFromSnapshotTest-2024832147 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:55:28 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-2aad9a34-c251-4090-becd-285c923557ca tempest-CreateVolumesFromSnapshotTest-2024832147 None] Deleted volume successfully.
Jun 15 15:55:29 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-2aad9a34-c251-4090-becd-285c923557ca tempest-CreateVolumesFromSnapshotTest-2024832147 None] Lock "cinder-4cb29941-8cb1-4790-85ab-369cb1352144-delete_volume" released by "delete_volume" :: held 4.563s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:55:29 devstack sudo[100289]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:29 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-88075e30-2d46-4f38-9964-a99e7473d255 tempest-SnapshotsActionsTest-1914407753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.97ddfd74-8d22-4d02-a38b-3bec2ba976bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.caf3ad7b-2562-46ac-b5aa-4082c360d299 1G" returned: 0 in 1.508s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:29 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-88075e30-2d46-4f38-9964-a99e7473d255 tempest-SnapshotsActionsTest-1914407753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.97ddfd74-8d22-4d02-a38b-3bec2ba976bd -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.caf3ad7b-2562-46ac-b5aa-4082c360d299 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:29 devstack sudo[100297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.97ddfd74-8d22-4d02-a38b-3bec2ba976bd -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.caf3ad7b-2562-46ac-b5aa-4082c360d299
Jun 15 15:55:29 devstack sudo[100297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:30 devstack sudo[100297]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:30 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-88075e30-2d46-4f38-9964-a99e7473d255 tempest-SnapshotsActionsTest-1914407753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.97ddfd74-8d22-4d02-a38b-3bec2ba976bd -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.caf3ad7b-2562-46ac-b5aa-4082c360d299" returned: 0 in 1.315s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:30 devstack cinder-volume[91863]: WARNING cinder.volume.drivers.remotefs [None req-88075e30-2d46-4f38-9964-a99e7473d255 tempest-SnapshotsActionsTest-1914407753 None] /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.caf3ad7b-2562-46ac-b5aa-4082c360d299 is being set with open permissions: ugo+rw
Jun 15 15:55:30 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-88075e30-2d46-4f38-9964-a99e7473d255 tempest-SnapshotsActionsTest-1914407753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.caf3ad7b-2562-46ac-b5aa-4082c360d299 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:30 devstack sudo[100339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.caf3ad7b-2562-46ac-b5aa-4082c360d299
Jun 15 15:55:30 devstack sudo[100339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:31 devstack cinder-volume[91863]: DEBUG oslo_service.periodic_task [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 15:55:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:55:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:55:31 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:55:31 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:55:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:55:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:31 devstack sudo[100342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:55:31 devstack sudo[100342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:31 devstack sudo[100339]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-88075e30-2d46-4f38-9964-a99e7473d255 tempest-SnapshotsActionsTest-1914407753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.caf3ad7b-2562-46ac-b5aa-4082c360d299" returned: 0 in 0.973s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-88075e30-2d46-4f38-9964-a99e7473d255 tempest-SnapshotsActionsTest-1914407753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.510s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:55:31 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-88075e30-2d46-4f38-9964-a99e7473d255 tempest-SnapshotsActionsTest-1914407753 None] Create snapshot completed successfully
Jun 15 15:55:31 devstack sudo[100342]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.743s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:31 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:55:31 devstack cinder-volume[91863]: DEBUG oslo_service.periodic_task [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Running periodic task VolumeManager._thread_info {{(pid=91863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 15:55:31 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] thread count: 28 {{(pid=91863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 15 15:55:31 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] thread info: [<_MainThread(MainThread, started 131088232640640)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131088122704576)>, <Thread(Thread-3 (stat_writer), started daemon 131088123058112)>, <Thread(Rabbit-heartbeat, started daemon 131088121268864)>, <Thread(Thread-5 (_runner), started daemon 131088121904192)>, <Thread(Thread-7 (_runner), started daemon 131088122037248)>, <Thread(fd_logger, started daemon 131088119630784)>, <Thread(privsep_reader, started daemon 131088119781440)>, <Thread(tpool_thread_0, started daemon 131088111617728)>, <Thread(tpool_thread_1, started daemon 131088103225024)>, <Thread(tpool_thread_2, started daemon 131088094832320)>, <Thread(tpool_thread_3, started daemon 131088086439616)>, <Thread(tpool_thread_4, started daemon 131088078046912)>, <Thread(tpool_thread_5, started daemon 131088069654208)>, <Thread(tpool_thread_6, started daemon 131088061261504)>, <Thread(tpool_thread_7, started daemon 131088052868800)>, <Thread(tpool_thread_8, started daemon 131088044476096)>, <Thread(tpool_thread_9, started daemon 131088036083392)>, <Thread(tpool_thread_10, started daemon 131088027690688)>, <Thread(tpool_thread_11, started daemon 131088019297984)>, <Thread(tpool_thread_12, started daemon 131088010905280)>, <Thread(tpool_thread_13, started daemon 131088002512576)>, <Thread(tpool_thread_14, started daemon 131087994119872)>, <Thread(tpool_thread_15, started daemon 131087985727168)>, <Thread(tpool_thread_16, started daemon 131087977334464)>, <Thread(tpool_thread_17, started daemon 131087968941760)>, <Thread(tpool_thread_18, started daemon 131087960549056)>, <Thread(tpool_thread_19, started daemon 131087952156352)>] {{(pid=91863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 15 15:55:32 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-332dad89-e380-46c0-9a81-ccc15ae478ec tempest-SnapshotsActionsTest-579875573 None] Acquiring lock "cinder-caf3ad7b-2562-46ac-b5aa-4082c360d299-delete_snapshot" by "delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:55:32 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-332dad89-e380-46c0-9a81-ccc15ae478ec tempest-SnapshotsActionsTest-579875573 None] Lock "cinder-caf3ad7b-2562-46ac-b5aa-4082c360d299-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:55:32 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-332dad89-e380-46c0-9a81-ccc15ae478ec tempest-SnapshotsActionsTest-579875573 None] Acquiring lock "cinder-quobyte-2a338138-ed36-447f-bf04-1f3e19ab34b9" by "delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:55:32 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-332dad89-e380-46c0-9a81-ccc15ae478ec tempest-SnapshotsActionsTest-579875573 None] Lock "cinder-quobyte-2a338138-ed36-447f-bf04-1f3e19ab34b9" acquired by "delete_snapshot" :: waited 0.023s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:55:32 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-332dad89-e380-46c0-9a81-ccc15ae478ec tempest-SnapshotsActionsTest-579875573 None] Acquiring lock "cinder-quobyte-caf3ad7b-2562-46ac-b5aa-4082c360d299" by "_delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:55:32 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-332dad89-e380-46c0-9a81-ccc15ae478ec tempest-SnapshotsActionsTest-579875573 None] Lock "cinder-quobyte-caf3ad7b-2562-46ac-b5aa-4082c360d299" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:55:32 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-332dad89-e380-46c0-9a81-ccc15ae478ec tempest-SnapshotsActionsTest-579875573 None] Deleting offline snapshot caf3ad7b-2562-46ac-b5aa-4082c360d299 of volume 2a338138-ed36-447f-bf04-1f3e19ab34b9 {{(pid=91863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 15 15:55:32 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-332dad89-e380-46c0-9a81-ccc15ae478ec tempest-SnapshotsActionsTest-579875573 None] snapshot_file for this snap is: volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.caf3ad7b-2562-46ac-b5aa-4082c360d299 {{(pid=91863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 15 15:55:32 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e463ce-0215-4bdc-b428-34ffffa1a343]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:55:32 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-332dad89-e380-46c0-9a81-ccc15ae478ec tempest-SnapshotsActionsTest-579875573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.caf3ad7b-2562-46ac-b5aa-4082c360d299 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:32 devstack sudo[100346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.caf3ad7b-2562-46ac-b5aa-4082c360d299
Jun 15 15:55:32 devstack sudo[100346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:33 devstack sudo[100346]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:33 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-332dad89-e380-46c0-9a81-ccc15ae478ec tempest-SnapshotsActionsTest-579875573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.caf3ad7b-2562-46ac-b5aa-4082c360d299" returned: 0 in 0.735s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:33 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-332dad89-e380-46c0-9a81-ccc15ae478ec tempest-SnapshotsActionsTest-579875573 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a338138-ed36-447f-bf04-1f3e19ab34b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 15:55:33 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[96eea20e-509c-4506-9664-84add8700e9b]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:55:33 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-332dad89-e380-46c0-9a81-ccc15ae478ec tempest-SnapshotsActionsTest-579875573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.97ddfd74-8d22-4d02-a38b-3bec2ba976bd {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:33 devstack sudo[100351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.97ddfd74-8d22-4d02-a38b-3bec2ba976bd
Jun 15 15:55:33 devstack sudo[100351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:34 devstack sudo[100351]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:34 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-332dad89-e380-46c0-9a81-ccc15ae478ec tempest-SnapshotsActionsTest-579875573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.97ddfd74-8d22-4d02-a38b-3bec2ba976bd" returned: 0 in 0.774s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:34 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-332dad89-e380-46c0-9a81-ccc15ae478ec tempest-SnapshotsActionsTest-579875573 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a338138-ed36-447f-bf04-1f3e19ab34b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 15:55:34 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-332dad89-e380-46c0-9a81-ccc15ae478ec tempest-SnapshotsActionsTest-579875573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.caf3ad7b-2562-46ac-b5aa-4082c360d299 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:34 devstack sudo[100357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.caf3ad7b-2562-46ac-b5aa-4082c360d299
Jun 15 15:55:34 devstack sudo[100357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:35 devstack sudo[100357]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:35 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-332dad89-e380-46c0-9a81-ccc15ae478ec tempest-SnapshotsActionsTest-579875573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.caf3ad7b-2562-46ac-b5aa-4082c360d299" returned: 0 in 0.883s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:35 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-332dad89-e380-46c0-9a81-ccc15ae478ec tempest-SnapshotsActionsTest-579875573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.caf3ad7b-2562-46ac-b5aa-4082c360d299 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:35 devstack sudo[100363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.caf3ad7b-2562-46ac-b5aa-4082c360d299
Jun 15 15:55:35 devstack sudo[100363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:35 devstack sudo[100363]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:35 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-332dad89-e380-46c0-9a81-ccc15ae478ec tempest-SnapshotsActionsTest-579875573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.caf3ad7b-2562-46ac-b5aa-4082c360d299" returned: 0 in 0.608s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:35 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-332dad89-e380-46c0-9a81-ccc15ae478ec tempest-SnapshotsActionsTest-579875573 None] Lock "cinder-quobyte-caf3ad7b-2562-46ac-b5aa-4082c360d299" released by "_delete_snapshot" :: held 3.124s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:55:35 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-332dad89-e380-46c0-9a81-ccc15ae478ec tempest-SnapshotsActionsTest-579875573 None] Lock "cinder-quobyte-2a338138-ed36-447f-bf04-1f3e19ab34b9" released by "delete_snapshot" :: held 3.150s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:55:36 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-332dad89-e380-46c0-9a81-ccc15ae478ec tempest-SnapshotsActionsTest-579875573 None] Created reservations ['5243fb67-7a13-48d4-bb4a-f0cbae3a0437', 'a26ac5d7-fe10-4715-87a7-0586e1eb882f', '9efac121-6c50-4aff-9261-c91fde17fa44', '1c8f0022-f9ba-4a7b-92df-b9db0eb918d8'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:55:36 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-332dad89-e380-46c0-9a81-ccc15ae478ec tempest-SnapshotsActionsTest-579875573 None] Delete snapshot completed successfully.
Jun 15 15:55:36 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-332dad89-e380-46c0-9a81-ccc15ae478ec tempest-SnapshotsActionsTest-579875573 None] Lock "cinder-caf3ad7b-2562-46ac-b5aa-4082c360d299-delete_snapshot" released by "delete_snapshot" :: held 3.319s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:55:37 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-57835fde-c915-4a28-899d-d73168b0f985 tempest-SnapshotsActionsTest-1914407753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:55:37 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-57835fde-c915-4a28-899d-d73168b0f985 tempest-SnapshotsActionsTest-1914407753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:55:37 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-57835fde-c915-4a28-899d-d73168b0f985 tempest-SnapshotsActionsTest-1914407753 None] Creating offline snapshot 69cc5c7b-78e0-45ac-9731-95ec68832fed of volume 2a338138-ed36-447f-bf04-1f3e19ab34b9 {{(pid=91863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 15 15:55:37 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5113585e-61f9-4cc6-b5fa-f586da9fd82f]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:55:37 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-57835fde-c915-4a28-899d-d73168b0f985 tempest-SnapshotsActionsTest-1914407753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.97ddfd74-8d22-4d02-a38b-3bec2ba976bd {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:37 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-2b37f73c-e9bc-4dc3-955b-c43f4e836e96 tempest-GroupSnapshotsTest-902971916 None] Group tempest-GroupSnapshotsTest-Group-1182724106: creating
Jun 15 15:55:37 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-2b37f73c-e9bc-4dc3-955b-c43f4e836e96 tempest-GroupSnapshotsTest-902971916 None] Group tempest-GroupSnapshotsTest-Group-1182724106: created successfully
Jun 15 15:55:37 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-2b37f73c-e9bc-4dc3-955b-c43f4e836e96 tempest-GroupSnapshotsTest-902971916 None] Create group completed successfully.
Jun 15 15:55:37 devstack sudo[100366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.97ddfd74-8d22-4d02-a38b-3bec2ba976bd
Jun 15 15:55:37 devstack sudo[100366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:38 devstack sudo[100366]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:38 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-57835fde-c915-4a28-899d-d73168b0f985 tempest-SnapshotsActionsTest-1914407753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.97ddfd74-8d22-4d02-a38b-3bec2ba976bd" returned: 0 in 0.697s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:38 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-57835fde-c915-4a28-899d-d73168b0f985 tempest-SnapshotsActionsTest-1914407753 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a338138-ed36-447f-bf04-1f3e19ab34b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 15:55:38 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-57835fde-c915-4a28-899d-d73168b0f985 tempest-SnapshotsActionsTest-1914407753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.97ddfd74-8d22-4d02-a38b-3bec2ba976bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.69cc5c7b-78e0-45ac-9731-95ec68832fed 1G {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:38 devstack sudo[100371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.97ddfd74-8d22-4d02-a38b-3bec2ba976bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.69cc5c7b-78e0-45ac-9731-95ec68832fed 1G
Jun 15 15:55:38 devstack sudo[100371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:38 devstack sudo[100371]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:38 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-57835fde-c915-4a28-899d-d73168b0f985 tempest-SnapshotsActionsTest-1914407753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.97ddfd74-8d22-4d02-a38b-3bec2ba976bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.69cc5c7b-78e0-45ac-9731-95ec68832fed 1G" returned: 0 in 0.836s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:38 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-57835fde-c915-4a28-899d-d73168b0f985 tempest-SnapshotsActionsTest-1914407753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.97ddfd74-8d22-4d02-a38b-3bec2ba976bd -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.69cc5c7b-78e0-45ac-9731-95ec68832fed {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:38 devstack sudo[100396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.97ddfd74-8d22-4d02-a38b-3bec2ba976bd -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.69cc5c7b-78e0-45ac-9731-95ec68832fed
Jun 15 15:55:38 devstack sudo[100396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:39 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e2e8297-88f7-418e-a581-967caabc3001 tempest-GroupSnapshotsTest-902971916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 15:55:39 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-9e2e8297-88f7-418e-a581-967caabc3001 tempest-GroupSnapshotsTest-902971916 None] Flow 'volume_create_manager' (05e5eddb-545e-4b23-9ec4-b54c7d3b3f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:55:39 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-9e2e8297-88f7-418e-a581-967caabc3001 tempest-GroupSnapshotsTest-902971916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2ec2354-9c90-4afc-87d5-bd2407879f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:55:39 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-9e2e8297-88f7-418e-a581-967caabc3001 tempest-GroupSnapshotsTest-902971916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2ec2354-9c90-4afc-87d5-bd2407879f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:55:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-564155945',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=2dbe70af-0afb-49ea-b203-e5b4578f6ebe,host='devstack@QuobyteHD#QuobyteHD',id=a4ae41db-f57a-4d1b-a058-748187651771,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aecd64c182d14ad0a5778916a7fba8bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:55:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:55:39Z,use_quota=True,user_id='ea09cc6a961546b2be44de9f24f3dbd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(afd35db8-2a34-448f-93f2-952b38694400),volume_type_id=afd35db8-2a34-448f-93f2-952b38694400)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:55:39 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-9e2e8297-88f7-418e-a581-967caabc3001 tempest-GroupSnapshotsTest-902971916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5005a23-6fd5-4bce-adbc-300bb139515a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:55:39 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-9e2e8297-88f7-418e-a581-967caabc3001 tempest-GroupSnapshotsTest-902971916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5005a23-6fd5-4bce-adbc-300bb139515a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:55:39 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-9e2e8297-88f7-418e-a581-967caabc3001 tempest-GroupSnapshotsTest-902971916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6de057bb-0d3a-4630-b5b9-f96b1a092592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:55:39 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-9e2e8297-88f7-418e-a581-967caabc3001 tempest-GroupSnapshotsTest-902971916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6de057bb-0d3a-4630-b5b9-f96b1a092592) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4ae41db-f57a-4d1b-a058-748187651771', 'volume_name': 'volume-a4ae41db-f57a-4d1b-a058-748187651771', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:55:39 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-9e2e8297-88f7-418e-a581-967caabc3001 tempest-GroupSnapshotsTest-902971916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b9ea099-4e07-4aa5-8aa8-f1797ac97bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:55:39 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-9e2e8297-88f7-418e-a581-967caabc3001 tempest-GroupSnapshotsTest-902971916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b9ea099-4e07-4aa5-8aa8-f1797ac97bb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:55:39 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-9e2e8297-88f7-418e-a581-967caabc3001 tempest-GroupSnapshotsTest-902971916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9eb69645-ad49-4417-92cd-f703117a84cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:55:39 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-9e2e8297-88f7-418e-a581-967caabc3001 tempest-GroupSnapshotsTest-902971916 None] Volume a4ae41db-f57a-4d1b-a058-748187651771: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4ae41db-f57a-4d1b-a058-748187651771', 'volume_size': 1}
Jun 15 15:55:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-9e2e8297-88f7-418e-a581-967caabc3001 tempest-GroupSnapshotsTest-902971916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:55:39 devstack sudo[100396]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-57835fde-c915-4a28-899d-d73168b0f985 tempest-SnapshotsActionsTest-1914407753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.97ddfd74-8d22-4d02-a38b-3bec2ba976bd -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.69cc5c7b-78e0-45ac-9731-95ec68832fed" returned: 0 in 0.676s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:39 devstack cinder-volume[91863]: WARNING cinder.volume.drivers.remotefs [None req-57835fde-c915-4a28-899d-d73168b0f985 tempest-SnapshotsActionsTest-1914407753 None] /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.69cc5c7b-78e0-45ac-9731-95ec68832fed is being set with open permissions: ugo+rw
Jun 15 15:55:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-57835fde-c915-4a28-899d-d73168b0f985 tempest-SnapshotsActionsTest-1914407753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.69cc5c7b-78e0-45ac-9731-95ec68832fed {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:39 devstack sudo[100401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.69cc5c7b-78e0-45ac-9731-95ec68832fed
Jun 15 15:55:39 devstack sudo[100401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:40 devstack sudo[100401]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:40 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-57835fde-c915-4a28-899d-d73168b0f985 tempest-SnapshotsActionsTest-1914407753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.69cc5c7b-78e0-45ac-9731-95ec68832fed" returned: 0 in 0.573s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:40 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-57835fde-c915-4a28-899d-d73168b0f985 tempest-SnapshotsActionsTest-1914407753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.902s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:55:40 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-9e2e8297-88f7-418e-a581-967caabc3001 tempest-GroupSnapshotsTest-902971916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.069s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:55:40 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-9e2e8297-88f7-418e-a581-967caabc3001 tempest-GroupSnapshotsTest-902971916 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=2dbe70af-0afb-49ea-b203-e5b4578f6ebe,created_at=2026-06-15T13:55:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-564155945',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=2dbe70af-0afb-49ea-b203-e5b4578f6ebe,host='devstack@QuobyteHD#QuobyteHD',id=a4ae41db-f57a-4d1b-a058-748187651771,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aecd64c182d14ad0a5778916a7fba8bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:55:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:55:39Z,use_quota=True,user_id='ea09cc6a961546b2be44de9f24f3dbd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(afd35db8-2a34-448f-93f2-952b38694400),volume_type_id=afd35db8-2a34-448f-93f2-952b38694400)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 15:55:40 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-9e2e8297-88f7-418e-a581-967caabc3001 tempest-GroupSnapshotsTest-902971916 None] Creating volume a4ae41db-f57a-4d1b-a058-748187651771 {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 15:55:40 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-9e2e8297-88f7-418e-a581-967caabc3001 tempest-GroupSnapshotsTest-902971916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:55:40 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-9e2e8297-88f7-418e-a581-967caabc3001 tempest-GroupSnapshotsTest-902971916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:55:40 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-9e2e8297-88f7-418e-a581-967caabc3001 tempest-GroupSnapshotsTest-902971916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:55:40 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-9e2e8297-88f7-418e-a581-967caabc3001 tempest-GroupSnapshotsTest-902971916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:55:40 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-9e2e8297-88f7-418e-a581-967caabc3001 tempest-GroupSnapshotsTest-902971916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:55:40 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-9e2e8297-88f7-418e-a581-967caabc3001 tempest-GroupSnapshotsTest-902971916 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 15:55:40 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-9e2e8297-88f7-418e-a581-967caabc3001 tempest-GroupSnapshotsTest-902971916 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 15:55:40 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-9e2e8297-88f7-418e-a581-967caabc3001 tempest-GroupSnapshotsTest-902971916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a4ae41db-f57a-4d1b-a058-748187651771 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:40 devstack sudo[100404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a4ae41db-f57a-4d1b-a058-748187651771 1073741824
Jun 15 15:55:40 devstack sudo[100404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:40 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-57835fde-c915-4a28-899d-d73168b0f985 tempest-SnapshotsActionsTest-1914407753 None] Create snapshot completed successfully
Jun 15 15:55:40 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-1a0c76a7-2c26-4b56-8569-2823617f47ae tempest-SnapshotsActionsTest-579875573 None] Acquiring lock "cinder-69cc5c7b-78e0-45ac-9731-95ec68832fed-delete_snapshot" by "delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:55:40 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-1a0c76a7-2c26-4b56-8569-2823617f47ae tempest-SnapshotsActionsTest-579875573 None] Lock "cinder-69cc5c7b-78e0-45ac-9731-95ec68832fed-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:55:40 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-1a0c76a7-2c26-4b56-8569-2823617f47ae tempest-SnapshotsActionsTest-579875573 None] Acquiring lock "cinder-quobyte-2a338138-ed36-447f-bf04-1f3e19ab34b9" by "delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:55:40 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-1a0c76a7-2c26-4b56-8569-2823617f47ae tempest-SnapshotsActionsTest-579875573 None] Lock "cinder-quobyte-2a338138-ed36-447f-bf04-1f3e19ab34b9" acquired by "delete_snapshot" :: waited 0.018s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:55:40 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-1a0c76a7-2c26-4b56-8569-2823617f47ae tempest-SnapshotsActionsTest-579875573 None] Acquiring lock "cinder-quobyte-69cc5c7b-78e0-45ac-9731-95ec68832fed" by "_delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:55:40 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-1a0c76a7-2c26-4b56-8569-2823617f47ae tempest-SnapshotsActionsTest-579875573 None] Lock "cinder-quobyte-69cc5c7b-78e0-45ac-9731-95ec68832fed" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:55:40 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-1a0c76a7-2c26-4b56-8569-2823617f47ae tempest-SnapshotsActionsTest-579875573 None] Deleting offline snapshot 69cc5c7b-78e0-45ac-9731-95ec68832fed of volume 2a338138-ed36-447f-bf04-1f3e19ab34b9 {{(pid=91863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 15 15:55:40 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-1a0c76a7-2c26-4b56-8569-2823617f47ae tempest-SnapshotsActionsTest-579875573 None] snapshot_file for this snap is: volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.69cc5c7b-78e0-45ac-9731-95ec68832fed {{(pid=91863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 15 15:55:40 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[59fba6dd-38e0-4a59-941e-559ec0803bdb]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:55:40 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-1a0c76a7-2c26-4b56-8569-2823617f47ae tempest-SnapshotsActionsTest-579875573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.69cc5c7b-78e0-45ac-9731-95ec68832fed {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:40 devstack sudo[100406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.69cc5c7b-78e0-45ac-9731-95ec68832fed
Jun 15 15:55:40 devstack sudo[100406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:40 devstack sudo[100404]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:41 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-9e2e8297-88f7-418e-a581-967caabc3001 tempest-GroupSnapshotsTest-902971916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a4ae41db-f57a-4d1b-a058-748187651771 1073741824" returned: 0 in 0.761s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:41 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-9e2e8297-88f7-418e-a581-967caabc3001 tempest-GroupSnapshotsTest-902971916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a4ae41db-f57a-4d1b-a058-748187651771 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:41 devstack sudo[100411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a4ae41db-f57a-4d1b-a058-748187651771
Jun 15 15:55:41 devstack sudo[100411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:41 devstack sudo[100406]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:41 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-1a0c76a7-2c26-4b56-8569-2823617f47ae tempest-SnapshotsActionsTest-579875573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.69cc5c7b-78e0-45ac-9731-95ec68832fed" returned: 0 in 0.757s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:41 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-1a0c76a7-2c26-4b56-8569-2823617f47ae tempest-SnapshotsActionsTest-579875573 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a338138-ed36-447f-bf04-1f3e19ab34b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 15:55:41 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[678f76f7-6c37-4da6-8dfc-800072fd2354]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:55:41 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-1a0c76a7-2c26-4b56-8569-2823617f47ae tempest-SnapshotsActionsTest-579875573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.97ddfd74-8d22-4d02-a38b-3bec2ba976bd {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:41 devstack sudo[100416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.97ddfd74-8d22-4d02-a38b-3bec2ba976bd
Jun 15 15:55:41 devstack sudo[100416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:41 devstack sudo[100411]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:41 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-9e2e8297-88f7-418e-a581-967caabc3001 tempest-GroupSnapshotsTest-902971916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a4ae41db-f57a-4d1b-a058-748187651771" returned: 0 in 0.605s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:41 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-9e2e8297-88f7-418e-a581-967caabc3001 tempest-GroupSnapshotsTest-902971916 None] <== create_volume: return (1406ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 15:55:41 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-9e2e8297-88f7-418e-a581-967caabc3001 tempest-GroupSnapshotsTest-902971916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.409s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:55:41 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-9e2e8297-88f7-418e-a581-967caabc3001 tempest-GroupSnapshotsTest-902971916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9eb69645-ad49-4417-92cd-f703117a84cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4ae41db-f57a-4d1b-a058-748187651771', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:55:41 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-9e2e8297-88f7-418e-a581-967caabc3001 tempest-GroupSnapshotsTest-902971916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b03eb967-8723-4b4a-b1a9-5012999cb49d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:55:41 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-9e2e8297-88f7-418e-a581-967caabc3001 tempest-GroupSnapshotsTest-902971916 None] Volume volume-a4ae41db-f57a-4d1b-a058-748187651771 (a4ae41db-f57a-4d1b-a058-748187651771): created successfully
Jun 15 15:55:41 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-9e2e8297-88f7-418e-a581-967caabc3001 tempest-GroupSnapshotsTest-902971916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b03eb967-8723-4b4a-b1a9-5012999cb49d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:55:41 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-9e2e8297-88f7-418e-a581-967caabc3001 tempest-GroupSnapshotsTest-902971916 None] Flow 'volume_create_manager' (05e5eddb-545e-4b23-9ec4-b54c7d3b3f2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:55:41 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-9e2e8297-88f7-418e-a581-967caabc3001 tempest-GroupSnapshotsTest-902971916 None] Created volume successfully.
Jun 15 15:55:42 devstack sudo[100416]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:42 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-1a0c76a7-2c26-4b56-8569-2823617f47ae tempest-SnapshotsActionsTest-579875573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.97ddfd74-8d22-4d02-a38b-3bec2ba976bd" returned: 0 in 0.707s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:42 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-1a0c76a7-2c26-4b56-8569-2823617f47ae tempest-SnapshotsActionsTest-579875573 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a338138-ed36-447f-bf04-1f3e19ab34b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 15:55:42 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-1a0c76a7-2c26-4b56-8569-2823617f47ae tempest-SnapshotsActionsTest-579875573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.69cc5c7b-78e0-45ac-9731-95ec68832fed {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:42 devstack sudo[100422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.69cc5c7b-78e0-45ac-9731-95ec68832fed
Jun 15 15:55:42 devstack sudo[100422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:42 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-9ba9ac6e-8bb2-4ca3-aa3f-80538a79ae86 tempest-GroupSnapshotsTest-902971916 None] GroupSnapshot 6381c283-79ae-439d-93d7-4eb4d7e17814: creating.
Jun 15 15:55:42 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-9ba9ac6e-8bb2-4ca3-aa3f-80538a79ae86 tempest-GroupSnapshotsTest-902971916 None] Group snapshot 6381c283-79ae-439d-93d7-4eb4d7e17814: creating. {{(pid=91863) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jun 15 15:55:42 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-9ba9ac6e-8bb2-4ca3-aa3f-80538a79ae86 tempest-GroupSnapshotsTest-902971916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:55:42 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-9ba9ac6e-8bb2-4ca3-aa3f-80538a79ae86 tempest-GroupSnapshotsTest-902971916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:55:42 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-9ba9ac6e-8bb2-4ca3-aa3f-80538a79ae86 tempest-GroupSnapshotsTest-902971916 None] Creating offline snapshot 00c1626f-71e1-4956-892a-8d22dda8d076 of volume a4ae41db-f57a-4d1b-a058-748187651771 {{(pid=91863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 15 15:55:42 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[12028e04-673e-42f9-902e-016ee75496da]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:55:42 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-9ba9ac6e-8bb2-4ca3-aa3f-80538a79ae86 tempest-GroupSnapshotsTest-902971916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a4ae41db-f57a-4d1b-a058-748187651771 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:42 devstack sudo[100427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a4ae41db-f57a-4d1b-a058-748187651771
Jun 15 15:55:42 devstack sudo[100427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:42 devstack sudo[100422]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:42 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-1a0c76a7-2c26-4b56-8569-2823617f47ae tempest-SnapshotsActionsTest-579875573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.69cc5c7b-78e0-45ac-9731-95ec68832fed" returned: 0 in 0.753s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:42 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-1a0c76a7-2c26-4b56-8569-2823617f47ae tempest-SnapshotsActionsTest-579875573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.69cc5c7b-78e0-45ac-9731-95ec68832fed {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:42 devstack sudo[100429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.69cc5c7b-78e0-45ac-9731-95ec68832fed
Jun 15 15:55:42 devstack sudo[100429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:43 devstack sudo[100427]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:43 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-9ba9ac6e-8bb2-4ca3-aa3f-80538a79ae86 tempest-GroupSnapshotsTest-902971916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a4ae41db-f57a-4d1b-a058-748187651771" returned: 0 in 0.724s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:43 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-9ba9ac6e-8bb2-4ca3-aa3f-80538a79ae86 tempest-GroupSnapshotsTest-902971916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a4ae41db-f57a-4d1b-a058-748187651771,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a4ae41db-f57a-4d1b-a058-748187651771.00c1626f-71e1-4956-892a-8d22dda8d076 1G {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:43 devstack sudo[100435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a4ae41db-f57a-4d1b-a058-748187651771,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a4ae41db-f57a-4d1b-a058-748187651771.00c1626f-71e1-4956-892a-8d22dda8d076 1G
Jun 15 15:55:43 devstack sudo[100435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:43 devstack sudo[100429]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:43 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-1a0c76a7-2c26-4b56-8569-2823617f47ae tempest-SnapshotsActionsTest-579875573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.69cc5c7b-78e0-45ac-9731-95ec68832fed" returned: 0 in 0.594s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:43 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-1a0c76a7-2c26-4b56-8569-2823617f47ae tempest-SnapshotsActionsTest-579875573 None] Lock "cinder-quobyte-69cc5c7b-78e0-45ac-9731-95ec68832fed" released by "_delete_snapshot" :: held 2.898s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:55:43 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-1a0c76a7-2c26-4b56-8569-2823617f47ae tempest-SnapshotsActionsTest-579875573 None] Lock "cinder-quobyte-2a338138-ed36-447f-bf04-1f3e19ab34b9" released by "delete_snapshot" :: held 2.923s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:55:43 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-1a0c76a7-2c26-4b56-8569-2823617f47ae tempest-SnapshotsActionsTest-579875573 None] Created reservations ['b8dc1208-9ec8-46ec-9b9c-8be7b095bdf6', 'ee7665ee-5246-4f4b-80a1-b8945a4846a1', '19ffb358-15df-47d4-831c-c9d8ce00254f', '7728d3ef-96c7-4973-b0cb-9ddb3d0236f5'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:55:43 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-1a0c76a7-2c26-4b56-8569-2823617f47ae tempest-SnapshotsActionsTest-579875573 None] Delete snapshot completed successfully.
Jun 15 15:55:43 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-1a0c76a7-2c26-4b56-8569-2823617f47ae tempest-SnapshotsActionsTest-579875573 None] Lock "cinder-69cc5c7b-78e0-45ac-9731-95ec68832fed-delete_snapshot" released by "delete_snapshot" :: held 3.065s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:55:44 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-505934d2-88f1-4019-bfa8-539ee9bfeae0 tempest-SnapshotsActionsTest-1914407753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:55:44 devstack sudo[100435]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:44 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-9ba9ac6e-8bb2-4ca3-aa3f-80538a79ae86 tempest-GroupSnapshotsTest-902971916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a4ae41db-f57a-4d1b-a058-748187651771,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a4ae41db-f57a-4d1b-a058-748187651771.00c1626f-71e1-4956-892a-8d22dda8d076 1G" returned: 0 in 0.781s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:44 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-9ba9ac6e-8bb2-4ca3-aa3f-80538a79ae86 tempest-GroupSnapshotsTest-902971916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4ae41db-f57a-4d1b-a058-748187651771 -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a4ae41db-f57a-4d1b-a058-748187651771.00c1626f-71e1-4956-892a-8d22dda8d076 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:44 devstack sudo[100440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4ae41db-f57a-4d1b-a058-748187651771 -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a4ae41db-f57a-4d1b-a058-748187651771.00c1626f-71e1-4956-892a-8d22dda8d076
Jun 15 15:55:44 devstack sudo[100440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:44 devstack sudo[100440]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:44 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-9ba9ac6e-8bb2-4ca3-aa3f-80538a79ae86 tempest-GroupSnapshotsTest-902971916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4ae41db-f57a-4d1b-a058-748187651771 -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a4ae41db-f57a-4d1b-a058-748187651771.00c1626f-71e1-4956-892a-8d22dda8d076" returned: 0 in 0.717s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:44 devstack cinder-volume[91863]: WARNING cinder.volume.drivers.remotefs [None req-9ba9ac6e-8bb2-4ca3-aa3f-80538a79ae86 tempest-GroupSnapshotsTest-902971916 None] /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a4ae41db-f57a-4d1b-a058-748187651771.00c1626f-71e1-4956-892a-8d22dda8d076 is being set with open permissions: ugo+rw: NotImplementedError
Jun 15 15:55:44 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-9ba9ac6e-8bb2-4ca3-aa3f-80538a79ae86 tempest-GroupSnapshotsTest-902971916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a4ae41db-f57a-4d1b-a058-748187651771.00c1626f-71e1-4956-892a-8d22dda8d076 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:44 devstack sudo[100446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a4ae41db-f57a-4d1b-a058-748187651771.00c1626f-71e1-4956-892a-8d22dda8d076
Jun 15 15:55:44 devstack sudo[100446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:45 devstack sudo[100446]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:45 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-9ba9ac6e-8bb2-4ca3-aa3f-80538a79ae86 tempest-GroupSnapshotsTest-902971916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a4ae41db-f57a-4d1b-a058-748187651771.00c1626f-71e1-4956-892a-8d22dda8d076" returned: 0 in 0.575s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:45 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-9ba9ac6e-8bb2-4ca3-aa3f-80538a79ae86 tempest-GroupSnapshotsTest-902971916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a4ae41db-f57a-4d1b-a058-748187651771.info {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:45 devstack sudo[100449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a4ae41db-f57a-4d1b-a058-748187651771.info
Jun 15 15:55:45 devstack sudo[100449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:46 devstack sudo[100449]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:46 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-9ba9ac6e-8bb2-4ca3-aa3f-80538a79ae86 tempest-GroupSnapshotsTest-902971916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a4ae41db-f57a-4d1b-a058-748187651771.info" returned: 0 in 0.683s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:46 devstack cinder-volume[91863]: WARNING cinder.volume.drivers.remotefs [None req-9ba9ac6e-8bb2-4ca3-aa3f-80538a79ae86 tempest-GroupSnapshotsTest-902971916 None] /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a4ae41db-f57a-4d1b-a058-748187651771.info is being set with open permissions: ugo+rw: NotImplementedError
Jun 15 15:55:46 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-9ba9ac6e-8bb2-4ca3-aa3f-80538a79ae86 tempest-GroupSnapshotsTest-902971916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a4ae41db-f57a-4d1b-a058-748187651771.info {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:46 devstack sudo[100452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a4ae41db-f57a-4d1b-a058-748187651771.info
Jun 15 15:55:46 devstack sudo[100452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:46 devstack sudo[100452]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:46 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-9ba9ac6e-8bb2-4ca3-aa3f-80538a79ae86 tempest-GroupSnapshotsTest-902971916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a4ae41db-f57a-4d1b-a058-748187651771.info" returned: 0 in 0.551s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:46 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-9ba9ac6e-8bb2-4ca3-aa3f-80538a79ae86 tempest-GroupSnapshotsTest-902971916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.116s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:55:46 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-505934d2-88f1-4019-bfa8-539ee9bfeae0 tempest-SnapshotsActionsTest-1914407753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.757s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:55:46 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-505934d2-88f1-4019-bfa8-539ee9bfeae0 tempest-SnapshotsActionsTest-1914407753 None] Creating offline snapshot 8d97ba2f-ea1d-4e20-a5c7-d0992a967f69 of volume 2a338138-ed36-447f-bf04-1f3e19ab34b9 {{(pid=91863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 15 15:55:46 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b0b3888-13ed-4641-a68f-c0b83c23a40e]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:55:46 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-505934d2-88f1-4019-bfa8-539ee9bfeae0 tempest-SnapshotsActionsTest-1914407753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.97ddfd74-8d22-4d02-a38b-3bec2ba976bd {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:46 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-9ba9ac6e-8bb2-4ca3-aa3f-80538a79ae86 tempest-GroupSnapshotsTest-902971916 None] group_snapshot 6381c283-79ae-439d-93d7-4eb4d7e17814: created successfully
Jun 15 15:55:46 devstack sudo[100455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.97ddfd74-8d22-4d02-a38b-3bec2ba976bd
Jun 15 15:55:46 devstack sudo[100455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:47 devstack sudo[100455]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:47 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-505934d2-88f1-4019-bfa8-539ee9bfeae0 tempest-SnapshotsActionsTest-1914407753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.97ddfd74-8d22-4d02-a38b-3bec2ba976bd" returned: 0 in 0.718s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:47 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-505934d2-88f1-4019-bfa8-539ee9bfeae0 tempest-SnapshotsActionsTest-1914407753 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a338138-ed36-447f-bf04-1f3e19ab34b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 15:55:47 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-505934d2-88f1-4019-bfa8-539ee9bfeae0 tempest-SnapshotsActionsTest-1914407753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.97ddfd74-8d22-4d02-a38b-3bec2ba976bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.8d97ba2f-ea1d-4e20-a5c7-d0992a967f69 1G {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:47 devstack sudo[100461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.97ddfd74-8d22-4d02-a38b-3bec2ba976bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.8d97ba2f-ea1d-4e20-a5c7-d0992a967f69 1G
Jun 15 15:55:47 devstack sudo[100461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:48 devstack sudo[100461]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:48 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-505934d2-88f1-4019-bfa8-539ee9bfeae0 tempest-SnapshotsActionsTest-1914407753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.97ddfd74-8d22-4d02-a38b-3bec2ba976bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.8d97ba2f-ea1d-4e20-a5c7-d0992a967f69 1G" returned: 0 in 0.756s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:48 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-505934d2-88f1-4019-bfa8-539ee9bfeae0 tempest-SnapshotsActionsTest-1914407753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.97ddfd74-8d22-4d02-a38b-3bec2ba976bd -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.8d97ba2f-ea1d-4e20-a5c7-d0992a967f69 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:48 devstack sudo[100467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.97ddfd74-8d22-4d02-a38b-3bec2ba976bd -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.8d97ba2f-ea1d-4e20-a5c7-d0992a967f69
Jun 15 15:55:48 devstack sudo[100467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:48 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-4660a34f-bae9-477b-af08-cc8cfc9b3686 tempest-GroupSnapshotsTest-902971916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:55:49 devstack sudo[100467]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:49 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-505934d2-88f1-4019-bfa8-539ee9bfeae0 tempest-SnapshotsActionsTest-1914407753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.97ddfd74-8d22-4d02-a38b-3bec2ba976bd -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.8d97ba2f-ea1d-4e20-a5c7-d0992a967f69" returned: 0 in 0.681s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:49 devstack cinder-volume[91863]: WARNING cinder.volume.drivers.remotefs [None req-505934d2-88f1-4019-bfa8-539ee9bfeae0 tempest-SnapshotsActionsTest-1914407753 None] /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.8d97ba2f-ea1d-4e20-a5c7-d0992a967f69 is being set with open permissions: ugo+rw
Jun 15 15:55:49 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-505934d2-88f1-4019-bfa8-539ee9bfeae0 tempest-SnapshotsActionsTest-1914407753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.8d97ba2f-ea1d-4e20-a5c7-d0992a967f69 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:49 devstack sudo[100473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.8d97ba2f-ea1d-4e20-a5c7-d0992a967f69
Jun 15 15:55:49 devstack sudo[100473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:49 devstack sudo[100473]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:49 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-505934d2-88f1-4019-bfa8-539ee9bfeae0 tempest-SnapshotsActionsTest-1914407753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.8d97ba2f-ea1d-4e20-a5c7-d0992a967f69" returned: 0 in 0.572s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:49 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-505934d2-88f1-4019-bfa8-539ee9bfeae0 tempest-SnapshotsActionsTest-1914407753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.839s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:55:49 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-4660a34f-bae9-477b-af08-cc8cfc9b3686 tempest-GroupSnapshotsTest-902971916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.667s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:55:49 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-4660a34f-bae9-477b-af08-cc8cfc9b3686 tempest-GroupSnapshotsTest-902971916 None] Acquiring lock "cinder-quobyte-00c1626f-71e1-4956-892a-8d22dda8d076-b01746c1-e9ac-4a82-a323-a8d8a2f3f757" by "_create_volume_from_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:55:49 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-4660a34f-bae9-477b-af08-cc8cfc9b3686 tempest-GroupSnapshotsTest-902971916 None] Lock "cinder-quobyte-00c1626f-71e1-4956-892a-8d22dda8d076-b01746c1-e9ac-4a82-a323-a8d8a2f3f757" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:55:49 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-4660a34f-bae9-477b-af08-cc8cfc9b3686 tempest-GroupSnapshotsTest-902971916 None] Creating volume b01746c1-e9ac-4a82-a323-a8d8a2f3f757 from snapshot 00c1626f-71e1-4956-892a-8d22dda8d076 {{(pid=91863) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 15 15:55:49 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-4660a34f-bae9-477b-af08-cc8cfc9b3686 tempest-GroupSnapshotsTest-902971916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:55:49 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-4660a34f-bae9-477b-af08-cc8cfc9b3686 tempest-GroupSnapshotsTest-902971916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:55:49 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-4660a34f-bae9-477b-af08-cc8cfc9b3686 tempest-GroupSnapshotsTest-902971916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:55:49 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-4660a34f-bae9-477b-af08-cc8cfc9b3686 tempest-GroupSnapshotsTest-902971916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:55:49 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-4660a34f-bae9-477b-af08-cc8cfc9b3686 tempest-GroupSnapshotsTest-902971916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:55:49 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-4660a34f-bae9-477b-af08-cc8cfc9b3686 tempest-GroupSnapshotsTest-902971916 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 15:55:49 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-4660a34f-bae9-477b-af08-cc8cfc9b3686 tempest-GroupSnapshotsTest-902971916 None] Acquiring lock "cinder-quobyte-b01746c1-e9ac-4a82-a323-a8d8a2f3f757" by "_copy_volume_from_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:55:49 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-505934d2-88f1-4019-bfa8-539ee9bfeae0 tempest-SnapshotsActionsTest-1914407753 None] Create snapshot completed successfully
Jun 15 15:55:49 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-4660a34f-bae9-477b-af08-cc8cfc9b3686 tempest-GroupSnapshotsTest-902971916 None] Lock "cinder-quobyte-b01746c1-e9ac-4a82-a323-a8d8a2f3f757" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:55:49 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-4660a34f-bae9-477b-af08-cc8cfc9b3686 tempest-GroupSnapshotsTest-902971916 None] snapshot: 00c1626f-71e1-4956-892a-8d22dda8d076, volume: b01746c1-e9ac-4a82-a323-a8d8a2f3f757,  {{(pid=91863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 15 15:55:49 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-4660a34f-bae9-477b-af08-cc8cfc9b3686 tempest-GroupSnapshotsTest-902971916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:55:49 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-4660a34f-bae9-477b-af08-cc8cfc9b3686 tempest-GroupSnapshotsTest-902971916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:55:49 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-4660a34f-bae9-477b-af08-cc8cfc9b3686 tempest-GroupSnapshotsTest-902971916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:55:49 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-4660a34f-bae9-477b-af08-cc8cfc9b3686 tempest-GroupSnapshotsTest-902971916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:55:49 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-4660a34f-bae9-477b-af08-cc8cfc9b3686 tempest-GroupSnapshotsTest-902971916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:55:49 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c27f0f5-bd02-40e8-b020-cc6ea688e93b]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:55:49 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-4660a34f-bae9-477b-af08-cc8cfc9b3686 tempest-GroupSnapshotsTest-902971916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a4ae41db-f57a-4d1b-a058-748187651771.00c1626f-71e1-4956-892a-8d22dda8d076 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:49 devstack sudo[100476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a4ae41db-f57a-4d1b-a058-748187651771.00c1626f-71e1-4956-892a-8d22dda8d076
Jun 15 15:55:49 devstack sudo[100476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:50 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-81acadc4-0c49-43d2-816e-b756f74bfdb4 tempest-SnapshotsActionsTest-579875573 None] Acquiring lock "cinder-8d97ba2f-ea1d-4e20-a5c7-d0992a967f69-delete_snapshot" by "delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:55:50 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-81acadc4-0c49-43d2-816e-b756f74bfdb4 tempest-SnapshotsActionsTest-579875573 None] Lock "cinder-8d97ba2f-ea1d-4e20-a5c7-d0992a967f69-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:55:50 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-81acadc4-0c49-43d2-816e-b756f74bfdb4 tempest-SnapshotsActionsTest-579875573 None] Acquiring lock "cinder-quobyte-2a338138-ed36-447f-bf04-1f3e19ab34b9" by "delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:55:50 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-81acadc4-0c49-43d2-816e-b756f74bfdb4 tempest-SnapshotsActionsTest-579875573 None] Lock "cinder-quobyte-2a338138-ed36-447f-bf04-1f3e19ab34b9" acquired by "delete_snapshot" :: waited 0.017s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:55:50 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-81acadc4-0c49-43d2-816e-b756f74bfdb4 tempest-SnapshotsActionsTest-579875573 None] Acquiring lock "cinder-quobyte-8d97ba2f-ea1d-4e20-a5c7-d0992a967f69" by "_delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:55:50 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-81acadc4-0c49-43d2-816e-b756f74bfdb4 tempest-SnapshotsActionsTest-579875573 None] Lock "cinder-quobyte-8d97ba2f-ea1d-4e20-a5c7-d0992a967f69" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:55:50 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-81acadc4-0c49-43d2-816e-b756f74bfdb4 tempest-SnapshotsActionsTest-579875573 None] Deleting offline snapshot 8d97ba2f-ea1d-4e20-a5c7-d0992a967f69 of volume 2a338138-ed36-447f-bf04-1f3e19ab34b9 {{(pid=91863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 15 15:55:50 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-81acadc4-0c49-43d2-816e-b756f74bfdb4 tempest-SnapshotsActionsTest-579875573 None] snapshot_file for this snap is: volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.8d97ba2f-ea1d-4e20-a5c7-d0992a967f69 {{(pid=91863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 15 15:55:50 devstack sudo[100476]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:50 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-4660a34f-bae9-477b-af08-cc8cfc9b3686 tempest-GroupSnapshotsTest-902971916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a4ae41db-f57a-4d1b-a058-748187651771.00c1626f-71e1-4956-892a-8d22dda8d076" returned: 0 in 0.749s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:50 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-4660a34f-bae9-477b-af08-cc8cfc9b3686 tempest-GroupSnapshotsTest-902971916 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4ae41db-f57a-4d1b-a058-748187651771(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 15:55:50 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-4660a34f-bae9-477b-af08-cc8cfc9b3686 tempest-GroupSnapshotsTest-902971916 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a4ae41db-f57a-4d1b-a058-748187651771 {{(pid=91863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 15 15:55:50 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-4660a34f-bae9-477b-af08-cc8cfc9b3686 tempest-GroupSnapshotsTest-902971916 None] Creating direct copy from snapshot {{(pid=91863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 15 15:55:50 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c39152-0b9a-496b-bb17-c0d8e220564b]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:55:50 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-81acadc4-0c49-43d2-816e-b756f74bfdb4 tempest-SnapshotsActionsTest-579875573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.8d97ba2f-ea1d-4e20-a5c7-d0992a967f69 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:50 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b49ff0-bb23-43bf-9d65-69635a24747a]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:55:50 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-4660a34f-bae9-477b-af08-cc8cfc9b3686 tempest-GroupSnapshotsTest-902971916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a4ae41db-f57a-4d1b-a058-748187651771 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:50 devstack sudo[100482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.8d97ba2f-ea1d-4e20-a5c7-d0992a967f69
Jun 15 15:55:50 devstack sudo[100482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:50 devstack sudo[100483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a4ae41db-f57a-4d1b-a058-748187651771
Jun 15 15:55:50 devstack sudo[100483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:51 devstack sudo[100482]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:51 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-81acadc4-0c49-43d2-816e-b756f74bfdb4 tempest-SnapshotsActionsTest-579875573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.8d97ba2f-ea1d-4e20-a5c7-d0992a967f69" returned: 0 in 0.757s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:51 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-81acadc4-0c49-43d2-816e-b756f74bfdb4 tempest-SnapshotsActionsTest-579875573 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a338138-ed36-447f-bf04-1f3e19ab34b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 15:55:51 devstack sudo[100483]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:51 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-4660a34f-bae9-477b-af08-cc8cfc9b3686 tempest-GroupSnapshotsTest-902971916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a4ae41db-f57a-4d1b-a058-748187651771" returned: 0 in 0.785s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:51 devstack cinder-volume[91863]: DEBUG cinder.utils [None req-4660a34f-bae9-477b-af08-cc8cfc9b3686 tempest-GroupSnapshotsTest-902971916 None] Path /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b01746c1-e9ac-4a82-a323-a8d8a2f3f757 not found in is_blk_device check {{(pid=91863) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 15 15:55:51 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-4660a34f-bae9-477b-af08-cc8cfc9b3686 tempest-GroupSnapshotsTest-902971916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a4ae41db-f57a-4d1b-a058-748187651771 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b01746c1-e9ac-4a82-a323-a8d8a2f3f757 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:51 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc9334f5-b57d-46f9-bebf-035f4ae8db22]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:55:51 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-81acadc4-0c49-43d2-816e-b756f74bfdb4 tempest-SnapshotsActionsTest-579875573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.97ddfd74-8d22-4d02-a38b-3bec2ba976bd {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:51 devstack sudo[100500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a4ae41db-f57a-4d1b-a058-748187651771 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b01746c1-e9ac-4a82-a323-a8d8a2f3f757
Jun 15 15:55:51 devstack sudo[100500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:51 devstack sudo[100501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.97ddfd74-8d22-4d02-a38b-3bec2ba976bd
Jun 15 15:55:51 devstack sudo[100501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:51 devstack cinder-volume[91863]: DEBUG dbcounter [-] [91863] Writing DB stats cinder:SELECT=115,cinder:INSERT=33,cinder:UPDATE=153,cinder:DELETE=14 {{(pid=91863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 15:55:51 devstack cinder-volume[91863]: DEBUG dbcounter [-] [91863] Writing DB stats cinder:SELECT=128,cinder:INSERT=37,cinder:UPDATE=128,cinder:DELETE=9 {{(pid=91863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 15:55:51 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-7295b2ea-650a-483c-b6cf-74eb21f25609 tempest-AttachVolumeTestJSON-1078769545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 15:55:51 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-7295b2ea-650a-483c-b6cf-74eb21f25609 tempest-AttachVolumeTestJSON-1078769545 None] Flow 'volume_create_manager' (3df97453-bc7f-4dd4-bfa1-0f31d72a9f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:55:51 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-7295b2ea-650a-483c-b6cf-74eb21f25609 tempest-AttachVolumeTestJSON-1078769545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d307d821-97b4-4a12-9857-491bb217dc29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:55:51 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-7295b2ea-650a-483c-b6cf-74eb21f25609 tempest-AttachVolumeTestJSON-1078769545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d307d821-97b4-4a12-9857-491bb217dc29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:55:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-5814426',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1adab084-fb1f-46dc-b4f4-85e870d73f81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74b3ee574a234c568898318f69294baf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:55:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:55:52Z,use_quota=True,user_id='b05c9b2f6f26478da7a8cf339968ec29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:55:51 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-7295b2ea-650a-483c-b6cf-74eb21f25609 tempest-AttachVolumeTestJSON-1078769545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b572e8f-30e7-4cb3-a912-7fc8fa537b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:55:51 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-7295b2ea-650a-483c-b6cf-74eb21f25609 tempest-AttachVolumeTestJSON-1078769545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b572e8f-30e7-4cb3-a912-7fc8fa537b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:55:51 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-7295b2ea-650a-483c-b6cf-74eb21f25609 tempest-AttachVolumeTestJSON-1078769545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72dfb507-08e6-43dd-8966-bbcf683bc2a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:55:51 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-7295b2ea-650a-483c-b6cf-74eb21f25609 tempest-AttachVolumeTestJSON-1078769545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72dfb507-08e6-43dd-8966-bbcf683bc2a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1adab084-fb1f-46dc-b4f4-85e870d73f81', 'volume_name': 'volume-1adab084-fb1f-46dc-b4f4-85e870d73f81', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:55:51 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-7295b2ea-650a-483c-b6cf-74eb21f25609 tempest-AttachVolumeTestJSON-1078769545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57241908-89a3-429d-8888-e60660e4631a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:55:51 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-7295b2ea-650a-483c-b6cf-74eb21f25609 tempest-AttachVolumeTestJSON-1078769545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57241908-89a3-429d-8888-e60660e4631a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:55:51 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-7295b2ea-650a-483c-b6cf-74eb21f25609 tempest-AttachVolumeTestJSON-1078769545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63ab5543-36fd-4be7-825b-eb2e8c8c80ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:55:51 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-7295b2ea-650a-483c-b6cf-74eb21f25609 tempest-AttachVolumeTestJSON-1078769545 None] Volume 1adab084-fb1f-46dc-b4f4-85e870d73f81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1adab084-fb1f-46dc-b4f4-85e870d73f81', 'volume_size': 1}
Jun 15 15:55:51 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-7295b2ea-650a-483c-b6cf-74eb21f25609 tempest-AttachVolumeTestJSON-1078769545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:55:52 devstack sudo[100501]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:52 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-81acadc4-0c49-43d2-816e-b756f74bfdb4 tempest-SnapshotsActionsTest-579875573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.97ddfd74-8d22-4d02-a38b-3bec2ba976bd" returned: 0 in 0.757s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:52 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-81acadc4-0c49-43d2-816e-b756f74bfdb4 tempest-SnapshotsActionsTest-579875573 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a338138-ed36-447f-bf04-1f3e19ab34b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 15:55:52 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-81acadc4-0c49-43d2-816e-b756f74bfdb4 tempest-SnapshotsActionsTest-579875573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.8d97ba2f-ea1d-4e20-a5c7-d0992a967f69 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:52 devstack sudo[100518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.8d97ba2f-ea1d-4e20-a5c7-d0992a967f69
Jun 15 15:55:52 devstack sudo[100518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:53 devstack sudo[100518]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:53 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-81acadc4-0c49-43d2-816e-b756f74bfdb4 tempest-SnapshotsActionsTest-579875573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.8d97ba2f-ea1d-4e20-a5c7-d0992a967f69" returned: 0 in 1.431s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:53 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-81acadc4-0c49-43d2-816e-b756f74bfdb4 tempest-SnapshotsActionsTest-579875573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.8d97ba2f-ea1d-4e20-a5c7-d0992a967f69 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:53 devstack sudo[100537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.8d97ba2f-ea1d-4e20-a5c7-d0992a967f69
Jun 15 15:55:53 devstack sudo[100537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:54 devstack sudo[100537]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:54 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-81acadc4-0c49-43d2-816e-b756f74bfdb4 tempest-SnapshotsActionsTest-579875573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.8d97ba2f-ea1d-4e20-a5c7-d0992a967f69" returned: 0 in 1.131s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:54 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-81acadc4-0c49-43d2-816e-b756f74bfdb4 tempest-SnapshotsActionsTest-579875573 None] Lock "cinder-quobyte-8d97ba2f-ea1d-4e20-a5c7-d0992a967f69" released by "_delete_snapshot" :: held 4.231s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:55:54 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-81acadc4-0c49-43d2-816e-b756f74bfdb4 tempest-SnapshotsActionsTest-579875573 None] Lock "cinder-quobyte-2a338138-ed36-447f-bf04-1f3e19ab34b9" released by "delete_snapshot" :: held 4.266s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:55:54 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-81acadc4-0c49-43d2-816e-b756f74bfdb4 tempest-SnapshotsActionsTest-579875573 None] Created reservations ['68246b2a-a00c-4fed-be5a-de024cd67442', '5476046f-d448-412e-8994-46e971df4805', '3704c47e-6eb5-4e32-98b5-3fc36b1bdd75', '4aac2aa3-829d-47e5-a705-580e8af39773'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:55:54 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-81acadc4-0c49-43d2-816e-b756f74bfdb4 tempest-SnapshotsActionsTest-579875573 None] Delete snapshot completed successfully.
Jun 15 15:55:54 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-81acadc4-0c49-43d2-816e-b756f74bfdb4 tempest-SnapshotsActionsTest-579875573 None] Lock "cinder-8d97ba2f-ea1d-4e20-a5c7-d0992a967f69-delete_snapshot" released by "delete_snapshot" :: held 4.475s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:55:56 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-7e68d919-fb2e-4b99-be0a-93749c7f8f8a tempest-SnapshotsActionsTest-1914407753 None] Acquiring lock "cinder-97ddfd74-8d22-4d02-a38b-3bec2ba976bd-delete_snapshot" by "delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:55:56 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-7e68d919-fb2e-4b99-be0a-93749c7f8f8a tempest-SnapshotsActionsTest-1914407753 None] Lock "cinder-97ddfd74-8d22-4d02-a38b-3bec2ba976bd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:55:56 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-7e68d919-fb2e-4b99-be0a-93749c7f8f8a tempest-SnapshotsActionsTest-1914407753 None] Acquiring lock "cinder-quobyte-2a338138-ed36-447f-bf04-1f3e19ab34b9" by "delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:55:56 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-7e68d919-fb2e-4b99-be0a-93749c7f8f8a tempest-SnapshotsActionsTest-1914407753 None] Lock "cinder-quobyte-2a338138-ed36-447f-bf04-1f3e19ab34b9" acquired by "delete_snapshot" :: waited 0.017s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:55:56 devstack sudo[100500]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:56 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-7e68d919-fb2e-4b99-be0a-93749c7f8f8a tempest-SnapshotsActionsTest-1914407753 None] Acquiring lock "cinder-quobyte-97ddfd74-8d22-4d02-a38b-3bec2ba976bd" by "_delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:55:56 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-4660a34f-bae9-477b-af08-cc8cfc9b3686 tempest-GroupSnapshotsTest-902971916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a4ae41db-f57a-4d1b-a058-748187651771 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b01746c1-e9ac-4a82-a323-a8d8a2f3f757" returned: 0 in 5.211s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:56 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-7e68d919-fb2e-4b99-be0a-93749c7f8f8a tempest-SnapshotsActionsTest-1914407753 None] Lock "cinder-quobyte-97ddfd74-8d22-4d02-a38b-3bec2ba976bd" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:55:56 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-7e68d919-fb2e-4b99-be0a-93749c7f8f8a tempest-SnapshotsActionsTest-1914407753 None] Deleting offline snapshot 97ddfd74-8d22-4d02-a38b-3bec2ba976bd of volume 2a338138-ed36-447f-bf04-1f3e19ab34b9 {{(pid=91863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 15 15:55:56 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-7e68d919-fb2e-4b99-be0a-93749c7f8f8a tempest-SnapshotsActionsTest-1914407753 None] snapshot_file for this snap is: volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.97ddfd74-8d22-4d02-a38b-3bec2ba976bd {{(pid=91863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 15 15:55:56 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3361bdad-47f7-4051-b67f-0ecd776f3088]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:55:56 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-4660a34f-bae9-477b-af08-cc8cfc9b3686 tempest-GroupSnapshotsTest-902971916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a4ae41db-f57a-4d1b-a058-748187651771 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:56 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[de38a72f-ebea-4788-a5a6-037f7b4661f6]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:55:56 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-7e68d919-fb2e-4b99-be0a-93749c7f8f8a tempest-SnapshotsActionsTest-1914407753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.97ddfd74-8d22-4d02-a38b-3bec2ba976bd {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:56 devstack sudo[100542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.97ddfd74-8d22-4d02-a38b-3bec2ba976bd
Jun 15 15:55:56 devstack sudo[100541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a4ae41db-f57a-4d1b-a058-748187651771
Jun 15 15:55:56 devstack sudo[100542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:56 devstack sudo[100541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:57 devstack sudo[100542]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:57 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-7e68d919-fb2e-4b99-be0a-93749c7f8f8a tempest-SnapshotsActionsTest-1914407753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.97ddfd74-8d22-4d02-a38b-3bec2ba976bd" returned: 0 in 0.723s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:57 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-7e68d919-fb2e-4b99-be0a-93749c7f8f8a tempest-SnapshotsActionsTest-1914407753 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a338138-ed36-447f-bf04-1f3e19ab34b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 15:55:57 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e376c7f-4a0a-4274-8bdf-7cb20efa65df]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:55:57 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-7e68d919-fb2e-4b99-be0a-93749c7f8f8a tempest-SnapshotsActionsTest-1914407753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:57 devstack sudo[100550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9
Jun 15 15:55:57 devstack sudo[100550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:57 devstack sudo[100541]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:57 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-4660a34f-bae9-477b-af08-cc8cfc9b3686 tempest-GroupSnapshotsTest-902971916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a4ae41db-f57a-4d1b-a058-748187651771" returned: 0 in 0.895s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:57 devstack cinder-volume[91863]: DEBUG cinder.image.image_utils [None req-4660a34f-bae9-477b-af08-cc8cfc9b3686 tempest-GroupSnapshotsTest-902971916 None] Image conversion details: src /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a4ae41db-f57a-4d1b-a058-748187651771, size 1024.00 MB, duration 5.21 sec, destination /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b01746c1-e9ac-4a82-a323-a8d8a2f3f757 {{(pid=91863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 15 15:55:57 devstack cinder-volume[91863]: INFO cinder.image.image_utils [None req-4660a34f-bae9-477b-af08-cc8cfc9b3686 tempest-GroupSnapshotsTest-902971916 None] Converted 1024.00 MB image at 196.42 MB/s
Jun 15 15:55:57 devstack cinder-volume[91863]: WARNING cinder.volume.drivers.remotefs [None req-4660a34f-bae9-477b-af08-cc8cfc9b3686 tempest-GroupSnapshotsTest-902971916 None] /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b01746c1-e9ac-4a82-a323-a8d8a2f3f757 is being set with open permissions: ugo+rw: NotImplementedError
Jun 15 15:55:57 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-4660a34f-bae9-477b-af08-cc8cfc9b3686 tempest-GroupSnapshotsTest-902971916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b01746c1-e9ac-4a82-a323-a8d8a2f3f757 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:57 devstack sudo[100553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b01746c1-e9ac-4a82-a323-a8d8a2f3f757
Jun 15 15:55:57 devstack sudo[100553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:58 devstack sudo[100553]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:58 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-4660a34f-bae9-477b-af08-cc8cfc9b3686 tempest-GroupSnapshotsTest-902971916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b01746c1-e9ac-4a82-a323-a8d8a2f3f757" returned: 0 in 0.633s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:58 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-4660a34f-bae9-477b-af08-cc8cfc9b3686 tempest-GroupSnapshotsTest-902971916 None] Lock "cinder-quobyte-b01746c1-e9ac-4a82-a323-a8d8a2f3f757" released by "_copy_volume_from_snapshot" :: held 8.390s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:55:58 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-4660a34f-bae9-477b-af08-cc8cfc9b3686 tempest-GroupSnapshotsTest-902971916 None] Lock "cinder-quobyte-00c1626f-71e1-4956-892a-8d22dda8d076-b01746c1-e9ac-4a82-a323-a8d8a2f3f757" released by "_create_volume_from_snapshot" :: held 8.425s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:55:58 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-4660a34f-bae9-477b-af08-cc8cfc9b3686 tempest-GroupSnapshotsTest-902971916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.445s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:55:58 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-7295b2ea-650a-483c-b6cf-74eb21f25609 tempest-AttachVolumeTestJSON-1078769545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.270s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:55:58 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-7295b2ea-650a-483c-b6cf-74eb21f25609 tempest-AttachVolumeTestJSON-1078769545 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:55:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-5814426',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1adab084-fb1f-46dc-b4f4-85e870d73f81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74b3ee574a234c568898318f69294baf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:55:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:55:52Z,use_quota=True,user_id='b05c9b2f6f26478da7a8cf339968ec29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 15:55:58 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-7295b2ea-650a-483c-b6cf-74eb21f25609 tempest-AttachVolumeTestJSON-1078769545 None] Creating volume 1adab084-fb1f-46dc-b4f4-85e870d73f81 {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 15:55:58 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-7295b2ea-650a-483c-b6cf-74eb21f25609 tempest-AttachVolumeTestJSON-1078769545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:55:58 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-7295b2ea-650a-483c-b6cf-74eb21f25609 tempest-AttachVolumeTestJSON-1078769545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:55:58 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-7295b2ea-650a-483c-b6cf-74eb21f25609 tempest-AttachVolumeTestJSON-1078769545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:55:58 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-7295b2ea-650a-483c-b6cf-74eb21f25609 tempest-AttachVolumeTestJSON-1078769545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:55:58 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-7295b2ea-650a-483c-b6cf-74eb21f25609 tempest-AttachVolumeTestJSON-1078769545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:55:58 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-7295b2ea-650a-483c-b6cf-74eb21f25609 tempest-AttachVolumeTestJSON-1078769545 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 15:55:58 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-7295b2ea-650a-483c-b6cf-74eb21f25609 tempest-AttachVolumeTestJSON-1078769545 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 15:55:58 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-7295b2ea-650a-483c-b6cf-74eb21f25609 tempest-AttachVolumeTestJSON-1078769545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1adab084-fb1f-46dc-b4f4-85e870d73f81 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:58 devstack sudo[100559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1adab084-fb1f-46dc-b4f4-85e870d73f81 1073741824
Jun 15 15:55:58 devstack sudo[100559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:58 devstack sudo[100550]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:58 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-7e68d919-fb2e-4b99-be0a-93749c7f8f8a tempest-SnapshotsActionsTest-1914407753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9" returned: 0 in 0.861s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:58 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-7e68d919-fb2e-4b99-be0a-93749c7f8f8a tempest-SnapshotsActionsTest-1914407753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.97ddfd74-8d22-4d02-a38b-3bec2ba976bd {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:58 devstack sudo[100561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.97ddfd74-8d22-4d02-a38b-3bec2ba976bd
Jun 15 15:55:58 devstack sudo[100561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:58 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-4660a34f-bae9-477b-af08-cc8cfc9b3686 tempest-GroupSnapshotsTest-902971916 None] Create group from source-snapshot-6381c283-79ae-439d-93d7-4eb4d7e17814 completed successfully.
Jun 15 15:55:58 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-7d47801c-8196-4923-9e48-3302bdb58ae4 tempest-GroupSnapshotsTest-902971916 None] Acquiring lock "cinder-quobyte-b01746c1-e9ac-4a82-a323-a8d8a2f3f757" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:55:58 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-7d47801c-8196-4923-9e48-3302bdb58ae4 tempest-GroupSnapshotsTest-902971916 None] Lock "cinder-quobyte-b01746c1-e9ac-4a82-a323-a8d8a2f3f757" acquired by "delete_volume" :: waited 0.021s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:55:58 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2360fc95-c683-49fb-b931-fbc1abf71b14]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:55:58 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-7d47801c-8196-4923-9e48-3302bdb58ae4 tempest-GroupSnapshotsTest-902971916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b01746c1-e9ac-4a82-a323-a8d8a2f3f757 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:58 devstack sudo[100569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b01746c1-e9ac-4a82-a323-a8d8a2f3f757
Jun 15 15:55:58 devstack sudo[100569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:58 devstack sudo[100561]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:58 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-7e68d919-fb2e-4b99-be0a-93749c7f8f8a tempest-SnapshotsActionsTest-1914407753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.97ddfd74-8d22-4d02-a38b-3bec2ba976bd" returned: 0 in 0.782s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:58 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-7e68d919-fb2e-4b99-be0a-93749c7f8f8a tempest-SnapshotsActionsTest-1914407753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.97ddfd74-8d22-4d02-a38b-3bec2ba976bd {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:58 devstack sudo[100573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.97ddfd74-8d22-4d02-a38b-3bec2ba976bd
Jun 15 15:55:58 devstack sudo[100573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:58 devstack sudo[100559]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:58 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-7295b2ea-650a-483c-b6cf-74eb21f25609 tempest-AttachVolumeTestJSON-1078769545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1adab084-fb1f-46dc-b4f4-85e870d73f81 1073741824" returned: 0 in 0.878s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:58 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-7295b2ea-650a-483c-b6cf-74eb21f25609 tempest-AttachVolumeTestJSON-1078769545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1adab084-fb1f-46dc-b4f4-85e870d73f81 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:59 devstack sudo[100575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1adab084-fb1f-46dc-b4f4-85e870d73f81
Jun 15 15:55:59 devstack sudo[100575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:59 devstack sudo[100569]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:59 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-7d47801c-8196-4923-9e48-3302bdb58ae4 tempest-GroupSnapshotsTest-902971916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b01746c1-e9ac-4a82-a323-a8d8a2f3f757" returned: 0 in 0.734s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:59 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-7d47801c-8196-4923-9e48-3302bdb58ae4 tempest-GroupSnapshotsTest-902971916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b01746c1-e9ac-4a82-a323-a8d8a2f3f757 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:55:59 devstack sudo[100581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b01746c1-e9ac-4a82-a323-a8d8a2f3f757
Jun 15 15:55:59 devstack sudo[100581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:55:59 devstack sudo[100573]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:59 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-7e68d919-fb2e-4b99-be0a-93749c7f8f8a tempest-SnapshotsActionsTest-1914407753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9.97ddfd74-8d22-4d02-a38b-3bec2ba976bd" returned: 0 in 0.617s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:59 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-7e68d919-fb2e-4b99-be0a-93749c7f8f8a tempest-SnapshotsActionsTest-1914407753 None] Lock "cinder-quobyte-97ddfd74-8d22-4d02-a38b-3bec2ba976bd" released by "_delete_snapshot" :: held 3.100s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:55:59 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-7e68d919-fb2e-4b99-be0a-93749c7f8f8a tempest-SnapshotsActionsTest-1914407753 None] Lock "cinder-quobyte-2a338138-ed36-447f-bf04-1f3e19ab34b9" released by "delete_snapshot" :: held 3.122s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:55:59 devstack sudo[100575]: pam_unix(sudo:session): session closed for user root
Jun 15 15:55:59 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-7295b2ea-650a-483c-b6cf-74eb21f25609 tempest-AttachVolumeTestJSON-1078769545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1adab084-fb1f-46dc-b4f4-85e870d73f81" returned: 0 in 0.625s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:55:59 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-7295b2ea-650a-483c-b6cf-74eb21f25609 tempest-AttachVolumeTestJSON-1078769545 None] <== create_volume: return (1553ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 15:55:59 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-7295b2ea-650a-483c-b6cf-74eb21f25609 tempest-AttachVolumeTestJSON-1078769545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.556s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:55:59 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-7295b2ea-650a-483c-b6cf-74eb21f25609 tempest-AttachVolumeTestJSON-1078769545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63ab5543-36fd-4be7-825b-eb2e8c8c80ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1adab084-fb1f-46dc-b4f4-85e870d73f81', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:55:59 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-7295b2ea-650a-483c-b6cf-74eb21f25609 tempest-AttachVolumeTestJSON-1078769545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75bd462a-f647-4947-8600-06d7efd6c6d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:55:59 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-7295b2ea-650a-483c-b6cf-74eb21f25609 tempest-AttachVolumeTestJSON-1078769545 None] Volume volume-1adab084-fb1f-46dc-b4f4-85e870d73f81 (1adab084-fb1f-46dc-b4f4-85e870d73f81): created successfully
Jun 15 15:55:59 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-7295b2ea-650a-483c-b6cf-74eb21f25609 tempest-AttachVolumeTestJSON-1078769545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75bd462a-f647-4947-8600-06d7efd6c6d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:55:59 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-7295b2ea-650a-483c-b6cf-74eb21f25609 tempest-AttachVolumeTestJSON-1078769545 None] Flow 'volume_create_manager' (3df97453-bc7f-4dd4-bfa1-0f31d72a9f7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:55:59 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-7295b2ea-650a-483c-b6cf-74eb21f25609 tempest-AttachVolumeTestJSON-1078769545 None] Created volume successfully.
Jun 15 15:55:59 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-7e68d919-fb2e-4b99-be0a-93749c7f8f8a tempest-SnapshotsActionsTest-1914407753 None] Created reservations ['f633dc70-e40a-4a18-9c0f-707a50901fe3', '4c0d351d-3da5-453f-aa99-87152a44b574', 'ff3c45e1-fa8b-4d2d-9339-a5614e184d3f', '6218d5aa-5142-4eac-8a93-bfc52bc09ccc'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:55:59 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-7e68d919-fb2e-4b99-be0a-93749c7f8f8a tempest-SnapshotsActionsTest-1914407753 None] Delete snapshot completed successfully.
Jun 15 15:55:59 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-7e68d919-fb2e-4b99-be0a-93749c7f8f8a tempest-SnapshotsActionsTest-1914407753 None] Lock "cinder-97ddfd74-8d22-4d02-a38b-3bec2ba976bd-delete_snapshot" released by "delete_snapshot" :: held 3.306s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:56:00 devstack sudo[100581]: pam_unix(sudo:session): session closed for user root
Jun 15 15:56:00 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-7d47801c-8196-4923-9e48-3302bdb58ae4 tempest-GroupSnapshotsTest-902971916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b01746c1-e9ac-4a82-a323-a8d8a2f3f757" returned: 0 in 0.587s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:56:00 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-7d47801c-8196-4923-9e48-3302bdb58ae4 tempest-GroupSnapshotsTest-902971916 None] Lock "cinder-quobyte-b01746c1-e9ac-4a82-a323-a8d8a2f3f757" released by "delete_volume" :: held 1.369s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:56:00 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-7d47801c-8196-4923-9e48-3302bdb58ae4 tempest-GroupSnapshotsTest-902971916 None] Created reservations ['56933ad1-0cde-42c8-94e5-3ed644f7159c'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:56:00 devstack cinder-volume[91863]: WARNING cinder.quota [None req-7d47801c-8196-4923-9e48-3302bdb58ae4 tempest-GroupSnapshotsTest-902971916 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-174988848 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-174988848, it is now deprecated. Please use the default quota class for default quota.
Jun 15 15:56:00 devstack cinder-volume[91863]: WARNING cinder.quota [None req-7d47801c-8196-4923-9e48-3302bdb58ae4 tempest-GroupSnapshotsTest-902971916 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-174988848 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-174988848, it is now deprecated. Please use the default quota class for default quota.
Jun 15 15:56:00 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-7d47801c-8196-4923-9e48-3302bdb58ae4 tempest-GroupSnapshotsTest-902971916 None] Created reservations ['8cbaee60-648f-4820-8f09-48eb5c928a8f', 'd1dbba20-ee4d-4775-aab3-2d03bfc90e3b', '2d88afe3-8d4b-4f53-b582-886ff1eb5280', '58bdaccd-429c-4afb-9010-f7268843725f'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:56:00 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-7d47801c-8196-4923-9e48-3302bdb58ae4 tempest-GroupSnapshotsTest-902971916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:56:00 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-7d47801c-8196-4923-9e48-3302bdb58ae4 tempest-GroupSnapshotsTest-902971916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:56:00 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-7d47801c-8196-4923-9e48-3302bdb58ae4 tempest-GroupSnapshotsTest-902971916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:56:00 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-7d47801c-8196-4923-9e48-3302bdb58ae4 tempest-GroupSnapshotsTest-902971916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:56:00 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-7d47801c-8196-4923-9e48-3302bdb58ae4 tempest-GroupSnapshotsTest-902971916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:56:00 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-7d47801c-8196-4923-9e48-3302bdb58ae4 tempest-GroupSnapshotsTest-902971916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:56:00 devstack sudo[100585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:56:00 devstack sudo[100585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:56:00 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-b6b6b24e-43d0-499b-9f01-1a08a29b45e7 tempest-SnapshotsActionsTest-1914407753 None] Acquiring lock "cinder-2a338138-ed36-447f-bf04-1f3e19ab34b9-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:56:00 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-b6b6b24e-43d0-499b-9f01-1a08a29b45e7 tempest-SnapshotsActionsTest-1914407753 None] Lock "cinder-2a338138-ed36-447f-bf04-1f3e19ab34b9-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:56:00 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-b6b6b24e-43d0-499b-9f01-1a08a29b45e7 tempest-SnapshotsActionsTest-1914407753 None] Acquiring lock "cinder-quobyte-2a338138-ed36-447f-bf04-1f3e19ab34b9" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:56:00 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-b6b6b24e-43d0-499b-9f01-1a08a29b45e7 tempest-SnapshotsActionsTest-1914407753 None] Lock "cinder-quobyte-2a338138-ed36-447f-bf04-1f3e19ab34b9" acquired by "delete_volume" :: waited 0.016s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:56:00 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[15cf130c-c056-4635-82b8-03ed7311201f]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:56:00 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-b6b6b24e-43d0-499b-9f01-1a08a29b45e7 tempest-SnapshotsActionsTest-1914407753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:56:00 devstack sudo[100585]: pam_unix(sudo:session): session closed for user root
Jun 15 15:56:00 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-7d47801c-8196-4923-9e48-3302bdb58ae4 tempest-GroupSnapshotsTest-902971916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.621s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:56:00 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-7d47801c-8196-4923-9e48-3302bdb58ae4 tempest-GroupSnapshotsTest-902971916 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:56:00 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-7d47801c-8196-4923-9e48-3302bdb58ae4 tempest-GroupSnapshotsTest-902971916 None] Delete group completed successfully.
Jun 15 15:56:00 devstack sudo[100589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9
Jun 15 15:56:00 devstack sudo[100589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:56:01 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-c692ce1a-675a-4bce-8c27-c4a4379ac0cb tempest-GroupSnapshotsTest-902971916 None] group_snapshot 6381c283-79ae-439d-93d7-4eb4d7e17814: deleting
Jun 15 15:56:01 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-c692ce1a-675a-4bce-8c27-c4a4379ac0cb tempest-GroupSnapshotsTest-902971916 None] group_snapshot 6381c283-79ae-439d-93d7-4eb4d7e17814: deleting {{(pid=91863) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jun 15 15:56:01 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-c692ce1a-675a-4bce-8c27-c4a4379ac0cb tempest-GroupSnapshotsTest-902971916 None] Acquiring lock "cinder-quobyte-a4ae41db-f57a-4d1b-a058-748187651771" by "delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:56:01 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-c692ce1a-675a-4bce-8c27-c4a4379ac0cb tempest-GroupSnapshotsTest-902971916 None] Lock "cinder-quobyte-a4ae41db-f57a-4d1b-a058-748187651771" acquired by "delete_snapshot" :: waited 0.019s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:56:01 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-c692ce1a-675a-4bce-8c27-c4a4379ac0cb tempest-GroupSnapshotsTest-902971916 None] Acquiring lock "cinder-quobyte-00c1626f-71e1-4956-892a-8d22dda8d076" by "_delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:56:01 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-c692ce1a-675a-4bce-8c27-c4a4379ac0cb tempest-GroupSnapshotsTest-902971916 None] Lock "cinder-quobyte-00c1626f-71e1-4956-892a-8d22dda8d076" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:56:01 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-c692ce1a-675a-4bce-8c27-c4a4379ac0cb tempest-GroupSnapshotsTest-902971916 None] Deleting offline snapshot 00c1626f-71e1-4956-892a-8d22dda8d076 of volume a4ae41db-f57a-4d1b-a058-748187651771 {{(pid=91863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 15 15:56:01 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-c692ce1a-675a-4bce-8c27-c4a4379ac0cb tempest-GroupSnapshotsTest-902971916 None] snapshot_file for this snap is: volume-a4ae41db-f57a-4d1b-a058-748187651771.00c1626f-71e1-4956-892a-8d22dda8d076 {{(pid=91863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 15 15:56:01 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[85939ba0-ab35-4765-9160-582f3783cf89]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:56:01 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c692ce1a-675a-4bce-8c27-c4a4379ac0cb tempest-GroupSnapshotsTest-902971916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a4ae41db-f57a-4d1b-a058-748187651771.00c1626f-71e1-4956-892a-8d22dda8d076 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:56:01 devstack sudo[100591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a4ae41db-f57a-4d1b-a058-748187651771.00c1626f-71e1-4956-892a-8d22dda8d076
Jun 15 15:56:01 devstack sudo[100591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:56:01 devstack sudo[100589]: pam_unix(sudo:session): session closed for user root
Jun 15 15:56:01 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-b6b6b24e-43d0-499b-9f01-1a08a29b45e7 tempest-SnapshotsActionsTest-1914407753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9" returned: 0 in 0.749s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:56:01 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-b6b6b24e-43d0-499b-9f01-1a08a29b45e7 tempest-SnapshotsActionsTest-1914407753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:56:01 devstack sudo[100596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9
Jun 15 15:56:01 devstack sudo[100596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:56:01 devstack sudo[100591]: pam_unix(sudo:session): session closed for user root
Jun 15 15:56:01 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c692ce1a-675a-4bce-8c27-c4a4379ac0cb tempest-GroupSnapshotsTest-902971916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a4ae41db-f57a-4d1b-a058-748187651771.00c1626f-71e1-4956-892a-8d22dda8d076" returned: 0 in 0.762s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:56:01 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-c692ce1a-675a-4bce-8c27-c4a4379ac0cb tempest-GroupSnapshotsTest-902971916 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4ae41db-f57a-4d1b-a058-748187651771(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 15:56:01 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe058235-dbe6-4a00-a0ae-11806e7abd80]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:56:01 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c692ce1a-675a-4bce-8c27-c4a4379ac0cb tempest-GroupSnapshotsTest-902971916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a4ae41db-f57a-4d1b-a058-748187651771 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:56:02 devstack sudo[100604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a4ae41db-f57a-4d1b-a058-748187651771
Jun 15 15:56:02 devstack sudo[100604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:56:02 devstack sudo[100596]: pam_unix(sudo:session): session closed for user root
Jun 15 15:56:02 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-b6b6b24e-43d0-499b-9f01-1a08a29b45e7 tempest-SnapshotsActionsTest-1914407753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2a338138-ed36-447f-bf04-1f3e19ab34b9" returned: 0 in 0.641s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:56:02 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-b6b6b24e-43d0-499b-9f01-1a08a29b45e7 tempest-SnapshotsActionsTest-1914407753 None] Lock "cinder-quobyte-2a338138-ed36-447f-bf04-1f3e19ab34b9" released by "delete_volume" :: held 1.472s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:56:02 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-b6b6b24e-43d0-499b-9f01-1a08a29b45e7 tempest-SnapshotsActionsTest-1914407753 None] Created reservations ['839aa607-58e9-4c4a-8cf1-2642649dd37e', '0e76dc12-1216-4d68-8d08-5f49f29e0116', 'f1c34e8d-d557-4135-bce9-e1c9ad211d54', 'f44ea414-6b37-4aac-8a3e-f0d89126439c'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:56:02 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-b6b6b24e-43d0-499b-9f01-1a08a29b45e7 tempest-SnapshotsActionsTest-1914407753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:56:02 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-b6b6b24e-43d0-499b-9f01-1a08a29b45e7 tempest-SnapshotsActionsTest-1914407753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:56:02 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-b6b6b24e-43d0-499b-9f01-1a08a29b45e7 tempest-SnapshotsActionsTest-1914407753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:56:02 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-b6b6b24e-43d0-499b-9f01-1a08a29b45e7 tempest-SnapshotsActionsTest-1914407753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:56:02 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-b6b6b24e-43d0-499b-9f01-1a08a29b45e7 tempest-SnapshotsActionsTest-1914407753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:56:02 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-b6b6b24e-43d0-499b-9f01-1a08a29b45e7 tempest-SnapshotsActionsTest-1914407753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:56:02 devstack sudo[100610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:56:02 devstack sudo[100610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:56:02 devstack sudo[100604]: pam_unix(sudo:session): session closed for user root
Jun 15 15:56:02 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c692ce1a-675a-4bce-8c27-c4a4379ac0cb tempest-GroupSnapshotsTest-902971916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a4ae41db-f57a-4d1b-a058-748187651771" returned: 0 in 0.845s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:56:02 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c692ce1a-675a-4bce-8c27-c4a4379ac0cb tempest-GroupSnapshotsTest-902971916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a4ae41db-f57a-4d1b-a058-748187651771.00c1626f-71e1-4956-892a-8d22dda8d076 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:56:02 devstack sudo[100615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a4ae41db-f57a-4d1b-a058-748187651771.00c1626f-71e1-4956-892a-8d22dda8d076
Jun 15 15:56:02 devstack sudo[100615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:56:03 devstack sudo[100610]: pam_unix(sudo:session): session closed for user root
Jun 15 15:56:03 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-b6b6b24e-43d0-499b-9f01-1a08a29b45e7 tempest-SnapshotsActionsTest-1914407753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.729s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:56:03 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-b6b6b24e-43d0-499b-9f01-1a08a29b45e7 tempest-SnapshotsActionsTest-1914407753 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:56:03 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-b6b6b24e-43d0-499b-9f01-1a08a29b45e7 tempest-SnapshotsActionsTest-1914407753 None] Deleted volume successfully.
Jun 15 15:56:03 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-b6b6b24e-43d0-499b-9f01-1a08a29b45e7 tempest-SnapshotsActionsTest-1914407753 None] Lock "cinder-2a338138-ed36-447f-bf04-1f3e19ab34b9-delete_volume" released by "delete_volume" :: held 2.435s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:56:03 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [req-75af3b6d-1c86-4cad-aec5-af3e03c5e99a req-2663d9cf-3dbb-4b13-bdf9-45eaec8471fc tempest-AttachVolumeTestJSON-1078769545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:56:03 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [req-75af3b6d-1c86-4cad-aec5-af3e03c5e99a req-2663d9cf-3dbb-4b13-bdf9-45eaec8471fc tempest-AttachVolumeTestJSON-1078769545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:56:03 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e6245e-4618-4fc4-b1c4-a4af1150547e]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:56:03 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-75af3b6d-1c86-4cad-aec5-af3e03c5e99a req-2663d9cf-3dbb-4b13-bdf9-45eaec8471fc tempest-AttachVolumeTestJSON-1078769545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1adab084-fb1f-46dc-b4f4-85e870d73f81 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:56:03 devstack sudo[100631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1adab084-fb1f-46dc-b4f4-85e870d73f81
Jun 15 15:56:03 devstack sudo[100631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:56:03 devstack sudo[100615]: pam_unix(sudo:session): session closed for user root
Jun 15 15:56:03 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c692ce1a-675a-4bce-8c27-c4a4379ac0cb tempest-GroupSnapshotsTest-902971916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a4ae41db-f57a-4d1b-a058-748187651771.00c1626f-71e1-4956-892a-8d22dda8d076" returned: 0 in 0.838s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:56:03 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c692ce1a-675a-4bce-8c27-c4a4379ac0cb tempest-GroupSnapshotsTest-902971916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a4ae41db-f57a-4d1b-a058-748187651771.00c1626f-71e1-4956-892a-8d22dda8d076 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:56:03 devstack sudo[100633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a4ae41db-f57a-4d1b-a058-748187651771.00c1626f-71e1-4956-892a-8d22dda8d076
Jun 15 15:56:03 devstack sudo[100633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:56:04 devstack sudo[100633]: pam_unix(sudo:session): session closed for user root
Jun 15 15:56:04 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c692ce1a-675a-4bce-8c27-c4a4379ac0cb tempest-GroupSnapshotsTest-902971916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a4ae41db-f57a-4d1b-a058-748187651771.00c1626f-71e1-4956-892a-8d22dda8d076" returned: 0 in 0.734s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:56:04 devstack sudo[100631]: pam_unix(sudo:session): session closed for user root
Jun 15 15:56:04 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-75af3b6d-1c86-4cad-aec5-af3e03c5e99a req-2663d9cf-3dbb-4b13-bdf9-45eaec8471fc tempest-AttachVolumeTestJSON-1078769545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1adab084-fb1f-46dc-b4f4-85e870d73f81" returned: 0 in 0.932s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:56:04 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [req-75af3b6d-1c86-4cad-aec5-af3e03c5e99a req-2663d9cf-3dbb-4b13-bdf9-45eaec8471fc tempest-AttachVolumeTestJSON-1078769545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.950s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:56:04 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-c692ce1a-675a-4bce-8c27-c4a4379ac0cb tempest-GroupSnapshotsTest-902971916 None] Lock "cinder-quobyte-00c1626f-71e1-4956-892a-8d22dda8d076" released by "_delete_snapshot" :: held 3.295s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:56:04 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-c692ce1a-675a-4bce-8c27-c4a4379ac0cb tempest-GroupSnapshotsTest-902971916 None] Lock "cinder-quobyte-a4ae41db-f57a-4d1b-a058-748187651771" released by "delete_snapshot" :: held 3.326s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:56:04 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [req-75af3b6d-1c86-4cad-aec5-af3e03c5e99a req-2663d9cf-3dbb-4b13-bdf9-45eaec8471fc tempest-AttachVolumeTestJSON-1078769545 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc', 'name': 'volume-1adab084-fb1f-46dc-b4f4-85e870d73f81', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '826868bc-c920-4ccb-b1f2-2cab7786c535', 'enforce_multipath': True} {{(pid=91863) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 15 15:56:04 devstack cinder-volume[91863]: WARNING cinder.quota [None req-c692ce1a-675a-4bce-8c27-c4a4379ac0cb tempest-GroupSnapshotsTest-902971916 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-174988848 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-174988848, it is now deprecated. Please use the default quota class for default quota.
Jun 15 15:56:04 devstack cinder-volume[91863]: INFO cinder.volume.manager [req-75af3b6d-1c86-4cad-aec5-af3e03c5e99a req-2663d9cf-3dbb-4b13-bdf9-45eaec8471fc tempest-AttachVolumeTestJSON-1078769545 None] attachment_update completed successfully.
Jun 15 15:56:04 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-c692ce1a-675a-4bce-8c27-c4a4379ac0cb tempest-GroupSnapshotsTest-902971916 None] Created reservations ['50d0c4a9-1ee4-4209-8d2b-3a9c1b47161c', '52174b54-ac06-404f-8474-016a9b431b91', '68d89547-f30d-4e43-9cff-f8cd0eed721d', 'a847dc3c-3c68-4ea5-bcbe-1fe91b4148a8'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:56:04 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-c692ce1a-675a-4bce-8c27-c4a4379ac0cb tempest-GroupSnapshotsTest-902971916 None] group_snapshot 6381c283-79ae-439d-93d7-4eb4d7e17814: deleted successfully
Jun 15 15:56:05 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-de65007d-0d68-4a61-9f1b-42249bf3195e tempest-GroupSnapshotsTest-902971916 None] Acquiring lock "cinder-quobyte-a4ae41db-f57a-4d1b-a058-748187651771" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:56:05 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-de65007d-0d68-4a61-9f1b-42249bf3195e tempest-GroupSnapshotsTest-902971916 None] Lock "cinder-quobyte-a4ae41db-f57a-4d1b-a058-748187651771" acquired by "delete_volume" :: waited 0.024s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:56:05 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f490f60-a3d1-4faa-8b67-2a5620ef6f48]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:56:05 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-de65007d-0d68-4a61-9f1b-42249bf3195e tempest-GroupSnapshotsTest-902971916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a4ae41db-f57a-4d1b-a058-748187651771 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:56:05 devstack sudo[100707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a4ae41db-f57a-4d1b-a058-748187651771
Jun 15 15:56:05 devstack sudo[100707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:56:06 devstack sudo[100707]: pam_unix(sudo:session): session closed for user root
Jun 15 15:56:06 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-de65007d-0d68-4a61-9f1b-42249bf3195e tempest-GroupSnapshotsTest-902971916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a4ae41db-f57a-4d1b-a058-748187651771" returned: 0 in 0.765s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:56:06 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-de65007d-0d68-4a61-9f1b-42249bf3195e tempest-GroupSnapshotsTest-902971916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a4ae41db-f57a-4d1b-a058-748187651771 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:56:06 devstack sudo[101027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a4ae41db-f57a-4d1b-a058-748187651771
Jun 15 15:56:06 devstack sudo[101027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:56:07 devstack sudo[101027]: pam_unix(sudo:session): session closed for user root
Jun 15 15:56:07 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-de65007d-0d68-4a61-9f1b-42249bf3195e tempest-GroupSnapshotsTest-902971916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a4ae41db-f57a-4d1b-a058-748187651771" returned: 0 in 0.605s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:56:07 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-de65007d-0d68-4a61-9f1b-42249bf3195e tempest-GroupSnapshotsTest-902971916 None] Lock "cinder-quobyte-a4ae41db-f57a-4d1b-a058-748187651771" released by "delete_volume" :: held 1.451s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:56:07 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-de65007d-0d68-4a61-9f1b-42249bf3195e tempest-GroupSnapshotsTest-902971916 None] Created reservations ['cc23a4fe-11cb-43e7-aca6-4885e489917a'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:56:07 devstack cinder-volume[91863]: WARNING cinder.db.sqlalchemy.api [None req-de65007d-0d68-4a61-9f1b-42249bf3195e tempest-GroupSnapshotsTest-902971916 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-174988848']
Jun 15 15:56:07 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-de65007d-0d68-4a61-9f1b-42249bf3195e tempest-GroupSnapshotsTest-902971916 None] Created reservations ['d38f915a-1a2b-4c51-a93c-2ff42b2a27ab', '94f4e22c-4b39-4221-8cf8-b2f4b35d11a7', '17369b23-4a07-45cf-b9f7-17274c0fef3c', 'a121a878-4d5e-4ade-b392-95c42cca4e0e'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:56:07 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-de65007d-0d68-4a61-9f1b-42249bf3195e tempest-GroupSnapshotsTest-902971916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:56:07 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-de65007d-0d68-4a61-9f1b-42249bf3195e tempest-GroupSnapshotsTest-902971916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:56:07 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-de65007d-0d68-4a61-9f1b-42249bf3195e tempest-GroupSnapshotsTest-902971916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:56:07 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-de65007d-0d68-4a61-9f1b-42249bf3195e tempest-GroupSnapshotsTest-902971916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:56:07 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-de65007d-0d68-4a61-9f1b-42249bf3195e tempest-GroupSnapshotsTest-902971916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:56:07 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-de65007d-0d68-4a61-9f1b-42249bf3195e tempest-GroupSnapshotsTest-902971916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:56:07 devstack sudo[101030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:56:07 devstack sudo[101030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:56:07 devstack sudo[101030]: pam_unix(sudo:session): session closed for user root
Jun 15 15:56:07 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-de65007d-0d68-4a61-9f1b-42249bf3195e tempest-GroupSnapshotsTest-902971916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.603s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:56:07 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-de65007d-0d68-4a61-9f1b-42249bf3195e tempest-GroupSnapshotsTest-902971916 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:56:07 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-de65007d-0d68-4a61-9f1b-42249bf3195e tempest-GroupSnapshotsTest-902971916 None] Delete group completed successfully.
Jun 15 15:56:08 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-abd9deb2-00cb-4c7f-b5bd-a9289aa067c9 tempest-GroupSnapshotsTest-902971916 None] Group tempest-GroupSnapshotsTest-Group-650848644: creating
Jun 15 15:56:08 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-abd9deb2-00cb-4c7f-b5bd-a9289aa067c9 tempest-GroupSnapshotsTest-902971916 None] Group tempest-GroupSnapshotsTest-Group-650848644: created successfully
Jun 15 15:56:08 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-abd9deb2-00cb-4c7f-b5bd-a9289aa067c9 tempest-GroupSnapshotsTest-902971916 None] Create group completed successfully.
Jun 15 15:56:09 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-70b91f37-4984-4d87-be75-a82f076ca8d8 tempest-GroupSnapshotsTest-902971916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 15:56:09 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-70b91f37-4984-4d87-be75-a82f076ca8d8 tempest-GroupSnapshotsTest-902971916 None] Flow 'volume_create_manager' (b64549c3-65c9-4ef9-a5bf-74938e50fe8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:56:09 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-70b91f37-4984-4d87-be75-a82f076ca8d8 tempest-GroupSnapshotsTest-902971916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2d71931-44e0-4daa-9b62-e1f6ab3a7348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:56:09 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-70b91f37-4984-4d87-be75-a82f076ca8d8 tempest-GroupSnapshotsTest-902971916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2d71931-44e0-4daa-9b62-e1f6ab3a7348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:56:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1667359754',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=753d807f-a177-4940-91ea-ada6c81b0678,host='devstack@QuobyteHD#QuobyteHD',id=ae93e4a6-3ee1-46d0-82a0-b264eae897a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aecd64c182d14ad0a5778916a7fba8bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:56:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:56:10Z,use_quota=True,user_id='ea09cc6a961546b2be44de9f24f3dbd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06afe6ad-6d95-4950-878d-e278253df7c1),volume_type_id=06afe6ad-6d95-4950-878d-e278253df7c1)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:56:09 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-70b91f37-4984-4d87-be75-a82f076ca8d8 tempest-GroupSnapshotsTest-902971916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b034797e-42ac-49ea-bc4d-f42c250db5ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:56:09 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-70b91f37-4984-4d87-be75-a82f076ca8d8 tempest-GroupSnapshotsTest-902971916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b034797e-42ac-49ea-bc4d-f42c250db5ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:56:09 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-70b91f37-4984-4d87-be75-a82f076ca8d8 tempest-GroupSnapshotsTest-902971916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dc06772-bc3a-439b-94a0-239ae4f40458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:56:09 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-70b91f37-4984-4d87-be75-a82f076ca8d8 tempest-GroupSnapshotsTest-902971916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dc06772-bc3a-439b-94a0-239ae4f40458) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae93e4a6-3ee1-46d0-82a0-b264eae897a6', 'volume_name': 'volume-ae93e4a6-3ee1-46d0-82a0-b264eae897a6', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:56:09 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-70b91f37-4984-4d87-be75-a82f076ca8d8 tempest-GroupSnapshotsTest-902971916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cec1234f-4248-45dc-9439-a26c3fe36a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:56:09 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-70b91f37-4984-4d87-be75-a82f076ca8d8 tempest-GroupSnapshotsTest-902971916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cec1234f-4248-45dc-9439-a26c3fe36a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:56:09 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-70b91f37-4984-4d87-be75-a82f076ca8d8 tempest-GroupSnapshotsTest-902971916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c84a97c7-4079-42f1-bd6e-97855eeb9275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:56:09 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-70b91f37-4984-4d87-be75-a82f076ca8d8 tempest-GroupSnapshotsTest-902971916 None] Volume ae93e4a6-3ee1-46d0-82a0-b264eae897a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae93e4a6-3ee1-46d0-82a0-b264eae897a6', 'volume_size': 1}
Jun 15 15:56:09 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-70b91f37-4984-4d87-be75-a82f076ca8d8 tempest-GroupSnapshotsTest-902971916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:56:09 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-70b91f37-4984-4d87-be75-a82f076ca8d8 tempest-GroupSnapshotsTest-902971916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:56:09 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-70b91f37-4984-4d87-be75-a82f076ca8d8 tempest-GroupSnapshotsTest-902971916 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=753d807f-a177-4940-91ea-ada6c81b0678,created_at=2026-06-15T13:56:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1667359754',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=753d807f-a177-4940-91ea-ada6c81b0678,host='devstack@QuobyteHD#QuobyteHD',id=ae93e4a6-3ee1-46d0-82a0-b264eae897a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aecd64c182d14ad0a5778916a7fba8bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:56:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:56:10Z,use_quota=True,user_id='ea09cc6a961546b2be44de9f24f3dbd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06afe6ad-6d95-4950-878d-e278253df7c1),volume_type_id=06afe6ad-6d95-4950-878d-e278253df7c1)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 15:56:09 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-70b91f37-4984-4d87-be75-a82f076ca8d8 tempest-GroupSnapshotsTest-902971916 None] Creating volume ae93e4a6-3ee1-46d0-82a0-b264eae897a6 {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 15:56:09 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-70b91f37-4984-4d87-be75-a82f076ca8d8 tempest-GroupSnapshotsTest-902971916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:56:09 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-70b91f37-4984-4d87-be75-a82f076ca8d8 tempest-GroupSnapshotsTest-902971916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:56:09 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-70b91f37-4984-4d87-be75-a82f076ca8d8 tempest-GroupSnapshotsTest-902971916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:56:10 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-70b91f37-4984-4d87-be75-a82f076ca8d8 tempest-GroupSnapshotsTest-902971916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:56:10 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-70b91f37-4984-4d87-be75-a82f076ca8d8 tempest-GroupSnapshotsTest-902971916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:56:10 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-70b91f37-4984-4d87-be75-a82f076ca8d8 tempest-GroupSnapshotsTest-902971916 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 15:56:10 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-70b91f37-4984-4d87-be75-a82f076ca8d8 tempest-GroupSnapshotsTest-902971916 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 15:56:10 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-70b91f37-4984-4d87-be75-a82f076ca8d8 tempest-GroupSnapshotsTest-902971916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-ae93e4a6-3ee1-46d0-82a0-b264eae897a6 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:56:10 devstack sudo[101033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-ae93e4a6-3ee1-46d0-82a0-b264eae897a6 1073741824
Jun 15 15:56:10 devstack sudo[101033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:56:10 devstack sudo[101033]: pam_unix(sudo:session): session closed for user root
Jun 15 15:56:10 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-70b91f37-4984-4d87-be75-a82f076ca8d8 tempest-GroupSnapshotsTest-902971916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-ae93e4a6-3ee1-46d0-82a0-b264eae897a6 1073741824" returned: 0 in 0.857s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:56:10 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-70b91f37-4984-4d87-be75-a82f076ca8d8 tempest-GroupSnapshotsTest-902971916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-ae93e4a6-3ee1-46d0-82a0-b264eae897a6 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:56:10 devstack sudo[101039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-ae93e4a6-3ee1-46d0-82a0-b264eae897a6
Jun 15 15:56:10 devstack sudo[101039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:56:11 devstack sudo[101039]: pam_unix(sudo:session): session closed for user root
Jun 15 15:56:11 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-70b91f37-4984-4d87-be75-a82f076ca8d8 tempest-GroupSnapshotsTest-902971916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-ae93e4a6-3ee1-46d0-82a0-b264eae897a6" returned: 0 in 0.908s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:56:11 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-70b91f37-4984-4d87-be75-a82f076ca8d8 tempest-GroupSnapshotsTest-902971916 None] <== create_volume: return (1811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 15:56:11 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-70b91f37-4984-4d87-be75-a82f076ca8d8 tempest-GroupSnapshotsTest-902971916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.814s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:56:11 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-70b91f37-4984-4d87-be75-a82f076ca8d8 tempest-GroupSnapshotsTest-902971916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c84a97c7-4079-42f1-bd6e-97855eeb9275) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae93e4a6-3ee1-46d0-82a0-b264eae897a6', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:56:11 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-70b91f37-4984-4d87-be75-a82f076ca8d8 tempest-GroupSnapshotsTest-902971916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7021a2f-3a12-45e0-9391-ba8c1da6e578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:56:11 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-70b91f37-4984-4d87-be75-a82f076ca8d8 tempest-GroupSnapshotsTest-902971916 None] Volume volume-ae93e4a6-3ee1-46d0-82a0-b264eae897a6 (ae93e4a6-3ee1-46d0-82a0-b264eae897a6): created successfully
Jun 15 15:56:11 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-70b91f37-4984-4d87-be75-a82f076ca8d8 tempest-GroupSnapshotsTest-902971916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7021a2f-3a12-45e0-9391-ba8c1da6e578) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:56:11 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-70b91f37-4984-4d87-be75-a82f076ca8d8 tempest-GroupSnapshotsTest-902971916 None] Flow 'volume_create_manager' (b64549c3-65c9-4ef9-a5bf-74938e50fe8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:56:11 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-70b91f37-4984-4d87-be75-a82f076ca8d8 tempest-GroupSnapshotsTest-902971916 None] Created volume successfully.
Jun 15 15:56:12 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-68cf8f26-e48e-48be-b37d-6e6ed7731793 tempest-GroupSnapshotsTest-902971916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 15:56:12 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-68cf8f26-e48e-48be-b37d-6e6ed7731793 tempest-GroupSnapshotsTest-902971916 None] Flow 'volume_create_manager' (c8c510d5-3c94-4e5c-9642-22b862ee5a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:56:12 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-68cf8f26-e48e-48be-b37d-6e6ed7731793 tempest-GroupSnapshotsTest-902971916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c78eb564-9856-4d96-a75b-20316073608e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:56:12 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-68cf8f26-e48e-48be-b37d-6e6ed7731793 tempest-GroupSnapshotsTest-902971916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c78eb564-9856-4d96-a75b-20316073608e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:56:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-982429821',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=753d807f-a177-4940-91ea-ada6c81b0678,host='devstack@QuobyteHD#QuobyteHD',id=662b38f3-7495-4bef-b19f-0671c7e14f49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aecd64c182d14ad0a5778916a7fba8bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:56:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:56:13Z,use_quota=True,user_id='ea09cc6a961546b2be44de9f24f3dbd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06afe6ad-6d95-4950-878d-e278253df7c1),volume_type_id=06afe6ad-6d95-4950-878d-e278253df7c1)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:56:12 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-68cf8f26-e48e-48be-b37d-6e6ed7731793 tempest-GroupSnapshotsTest-902971916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f95e9d23-c1c8-40a6-a46f-a5b41bb1d56a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:56:12 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-68cf8f26-e48e-48be-b37d-6e6ed7731793 tempest-GroupSnapshotsTest-902971916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f95e9d23-c1c8-40a6-a46f-a5b41bb1d56a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:56:12 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-68cf8f26-e48e-48be-b37d-6e6ed7731793 tempest-GroupSnapshotsTest-902971916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9a838c5-70dc-43f7-af27-ef9248dbf694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:56:12 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-68cf8f26-e48e-48be-b37d-6e6ed7731793 tempest-GroupSnapshotsTest-902971916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9a838c5-70dc-43f7-af27-ef9248dbf694) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '662b38f3-7495-4bef-b19f-0671c7e14f49', 'volume_name': 'volume-662b38f3-7495-4bef-b19f-0671c7e14f49', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:56:12 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-68cf8f26-e48e-48be-b37d-6e6ed7731793 tempest-GroupSnapshotsTest-902971916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4705dab0-44d6-44cf-b941-633c3fa525c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:56:12 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-68cf8f26-e48e-48be-b37d-6e6ed7731793 tempest-GroupSnapshotsTest-902971916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4705dab0-44d6-44cf-b941-633c3fa525c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:56:12 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-68cf8f26-e48e-48be-b37d-6e6ed7731793 tempest-GroupSnapshotsTest-902971916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f4df57e-9530-469a-8b26-ebec55fa2a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:56:12 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-68cf8f26-e48e-48be-b37d-6e6ed7731793 tempest-GroupSnapshotsTest-902971916 None] Volume 662b38f3-7495-4bef-b19f-0671c7e14f49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-662b38f3-7495-4bef-b19f-0671c7e14f49', 'volume_size': 1}
Jun 15 15:56:12 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-68cf8f26-e48e-48be-b37d-6e6ed7731793 tempest-GroupSnapshotsTest-902971916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:56:12 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-68cf8f26-e48e-48be-b37d-6e6ed7731793 tempest-GroupSnapshotsTest-902971916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:56:12 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-68cf8f26-e48e-48be-b37d-6e6ed7731793 tempest-GroupSnapshotsTest-902971916 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=753d807f-a177-4940-91ea-ada6c81b0678,created_at=2026-06-15T13:56:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-982429821',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=753d807f-a177-4940-91ea-ada6c81b0678,host='devstack@QuobyteHD#QuobyteHD',id=662b38f3-7495-4bef-b19f-0671c7e14f49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aecd64c182d14ad0a5778916a7fba8bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:56:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:56:13Z,use_quota=True,user_id='ea09cc6a961546b2be44de9f24f3dbd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06afe6ad-6d95-4950-878d-e278253df7c1),volume_type_id=06afe6ad-6d95-4950-878d-e278253df7c1)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 15:56:12 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-68cf8f26-e48e-48be-b37d-6e6ed7731793 tempest-GroupSnapshotsTest-902971916 None] Creating volume 662b38f3-7495-4bef-b19f-0671c7e14f49 {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 15:56:12 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-68cf8f26-e48e-48be-b37d-6e6ed7731793 tempest-GroupSnapshotsTest-902971916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:56:12 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-68cf8f26-e48e-48be-b37d-6e6ed7731793 tempest-GroupSnapshotsTest-902971916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:56:12 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-68cf8f26-e48e-48be-b37d-6e6ed7731793 tempest-GroupSnapshotsTest-902971916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:56:12 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-68cf8f26-e48e-48be-b37d-6e6ed7731793 tempest-GroupSnapshotsTest-902971916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:56:12 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-68cf8f26-e48e-48be-b37d-6e6ed7731793 tempest-GroupSnapshotsTest-902971916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:56:12 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-68cf8f26-e48e-48be-b37d-6e6ed7731793 tempest-GroupSnapshotsTest-902971916 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 15:56:12 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-68cf8f26-e48e-48be-b37d-6e6ed7731793 tempest-GroupSnapshotsTest-902971916 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 15:56:12 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-68cf8f26-e48e-48be-b37d-6e6ed7731793 tempest-GroupSnapshotsTest-902971916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-662b38f3-7495-4bef-b19f-0671c7e14f49 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:56:12 devstack sudo[101081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-662b38f3-7495-4bef-b19f-0671c7e14f49 1073741824
Jun 15 15:56:12 devstack sudo[101081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:56:13 devstack sudo[101081]: pam_unix(sudo:session): session closed for user root
Jun 15 15:56:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-68cf8f26-e48e-48be-b37d-6e6ed7731793 tempest-GroupSnapshotsTest-902971916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-662b38f3-7495-4bef-b19f-0671c7e14f49 1073741824" returned: 0 in 0.983s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:56:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-68cf8f26-e48e-48be-b37d-6e6ed7731793 tempest-GroupSnapshotsTest-902971916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-662b38f3-7495-4bef-b19f-0671c7e14f49 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:56:13 devstack sudo[101090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-662b38f3-7495-4bef-b19f-0671c7e14f49
Jun 15 15:56:13 devstack sudo[101090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:56:13 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-50b8e3df-19fb-45ba-9230-8822abddc560 tempest-VolumeQuotasNegativeTestJSON-1966740659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 15:56:14 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-50b8e3df-19fb-45ba-9230-8822abddc560 tempest-VolumeQuotasNegativeTestJSON-1966740659 None] Flow 'volume_create_manager' (5a3e8fd9-ad85-4c4b-8f65-0ec5abd0a1df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:56:14 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-50b8e3df-19fb-45ba-9230-8822abddc560 tempest-VolumeQuotasNegativeTestJSON-1966740659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffbd946b-da6b-4569-852f-27af57ae74d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:56:14 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-50b8e3df-19fb-45ba-9230-8822abddc560 tempest-VolumeQuotasNegativeTestJSON-1966740659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffbd946b-da6b-4569-852f-27af57ae74d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:56:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-783889841',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b22525c5-6d48-4b2c-943d-d5191a09c941,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40311683544144a7b0db35301eea1891',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:56:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:56:14Z,use_quota=True,user_id='1d2141ab2ec244aab699a9d655d6b448',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:56:14 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-50b8e3df-19fb-45ba-9230-8822abddc560 tempest-VolumeQuotasNegativeTestJSON-1966740659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fbfa7e7-4b4e-4722-87de-02050a46e26f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:56:14 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-50b8e3df-19fb-45ba-9230-8822abddc560 tempest-VolumeQuotasNegativeTestJSON-1966740659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fbfa7e7-4b4e-4722-87de-02050a46e26f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:56:14 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-50b8e3df-19fb-45ba-9230-8822abddc560 tempest-VolumeQuotasNegativeTestJSON-1966740659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (955c33ae-b5fb-45cb-98a2-5b04e90db8a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:56:14 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-50b8e3df-19fb-45ba-9230-8822abddc560 tempest-VolumeQuotasNegativeTestJSON-1966740659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (955c33ae-b5fb-45cb-98a2-5b04e90db8a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b22525c5-6d48-4b2c-943d-d5191a09c941', 'volume_name': 'volume-b22525c5-6d48-4b2c-943d-d5191a09c941', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:56:14 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-50b8e3df-19fb-45ba-9230-8822abddc560 tempest-VolumeQuotasNegativeTestJSON-1966740659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (068e4476-7add-4344-a006-906977ced045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:56:14 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-50b8e3df-19fb-45ba-9230-8822abddc560 tempest-VolumeQuotasNegativeTestJSON-1966740659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (068e4476-7add-4344-a006-906977ced045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:56:14 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-50b8e3df-19fb-45ba-9230-8822abddc560 tempest-VolumeQuotasNegativeTestJSON-1966740659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbe10d05-5d4b-4ece-b9e2-68ff3a588922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:56:14 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-50b8e3df-19fb-45ba-9230-8822abddc560 tempest-VolumeQuotasNegativeTestJSON-1966740659 None] Volume b22525c5-6d48-4b2c-943d-d5191a09c941: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b22525c5-6d48-4b2c-943d-d5191a09c941', 'volume_size': 1}
Jun 15 15:56:14 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-50b8e3df-19fb-45ba-9230-8822abddc560 tempest-VolumeQuotasNegativeTestJSON-1966740659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:56:14 devstack sudo[101090]: pam_unix(sudo:session): session closed for user root
Jun 15 15:56:14 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-68cf8f26-e48e-48be-b37d-6e6ed7731793 tempest-GroupSnapshotsTest-902971916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-662b38f3-7495-4bef-b19f-0671c7e14f49" returned: 0 in 0.588s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:56:14 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-68cf8f26-e48e-48be-b37d-6e6ed7731793 tempest-GroupSnapshotsTest-902971916 None] <== create_volume: return (1627ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 15:56:14 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-68cf8f26-e48e-48be-b37d-6e6ed7731793 tempest-GroupSnapshotsTest-902971916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.629s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:56:14 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-50b8e3df-19fb-45ba-9230-8822abddc560 tempest-VolumeQuotasNegativeTestJSON-1966740659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.413s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:56:14 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-50b8e3df-19fb-45ba-9230-8822abddc560 tempest-VolumeQuotasNegativeTestJSON-1966740659 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:56:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-783889841',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b22525c5-6d48-4b2c-943d-d5191a09c941,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40311683544144a7b0db35301eea1891',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:56:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:56:14Z,use_quota=True,user_id='1d2141ab2ec244aab699a9d655d6b448',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 15:56:14 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-50b8e3df-19fb-45ba-9230-8822abddc560 tempest-VolumeQuotasNegativeTestJSON-1966740659 None] Creating volume b22525c5-6d48-4b2c-943d-d5191a09c941 {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 15:56:14 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-50b8e3df-19fb-45ba-9230-8822abddc560 tempest-VolumeQuotasNegativeTestJSON-1966740659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:56:14 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-50b8e3df-19fb-45ba-9230-8822abddc560 tempest-VolumeQuotasNegativeTestJSON-1966740659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:56:14 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-50b8e3df-19fb-45ba-9230-8822abddc560 tempest-VolumeQuotasNegativeTestJSON-1966740659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:56:14 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-50b8e3df-19fb-45ba-9230-8822abddc560 tempest-VolumeQuotasNegativeTestJSON-1966740659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:56:14 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-50b8e3df-19fb-45ba-9230-8822abddc560 tempest-VolumeQuotasNegativeTestJSON-1966740659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:56:14 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-50b8e3df-19fb-45ba-9230-8822abddc560 tempest-VolumeQuotasNegativeTestJSON-1966740659 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 15:56:14 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-50b8e3df-19fb-45ba-9230-8822abddc560 tempest-VolumeQuotasNegativeTestJSON-1966740659 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 15:56:14 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-50b8e3df-19fb-45ba-9230-8822abddc560 tempest-VolumeQuotasNegativeTestJSON-1966740659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b22525c5-6d48-4b2c-943d-d5191a09c941 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:56:14 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-68cf8f26-e48e-48be-b37d-6e6ed7731793 tempest-GroupSnapshotsTest-902971916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f4df57e-9530-469a-8b26-ebec55fa2a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-662b38f3-7495-4bef-b19f-0671c7e14f49', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:56:14 devstack sudo[101094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b22525c5-6d48-4b2c-943d-d5191a09c941 1073741824
Jun 15 15:56:14 devstack sudo[101094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:56:14 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-68cf8f26-e48e-48be-b37d-6e6ed7731793 tempest-GroupSnapshotsTest-902971916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3c4ef4e-53ae-4a03-9274-0af41f97e20a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:56:14 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-68cf8f26-e48e-48be-b37d-6e6ed7731793 tempest-GroupSnapshotsTest-902971916 None] Volume volume-662b38f3-7495-4bef-b19f-0671c7e14f49 (662b38f3-7495-4bef-b19f-0671c7e14f49): created successfully
Jun 15 15:56:14 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-68cf8f26-e48e-48be-b37d-6e6ed7731793 tempest-GroupSnapshotsTest-902971916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3c4ef4e-53ae-4a03-9274-0af41f97e20a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:56:14 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-68cf8f26-e48e-48be-b37d-6e6ed7731793 tempest-GroupSnapshotsTest-902971916 None] Flow 'volume_create_manager' (c8c510d5-3c94-4e5c-9642-22b862ee5a95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:56:14 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-68cf8f26-e48e-48be-b37d-6e6ed7731793 tempest-GroupSnapshotsTest-902971916 None] Created volume successfully.
Jun 15 15:56:15 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-80d5b33c-e2c1-442a-9c0a-4dddb5ce4889 tempest-GroupSnapshotsTest-902971916 None] Update group completed successfully.
Jun 15 15:56:15 devstack sudo[101094]: pam_unix(sudo:session): session closed for user root
Jun 15 15:56:15 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-50b8e3df-19fb-45ba-9230-8822abddc560 tempest-VolumeQuotasNegativeTestJSON-1966740659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b22525c5-6d48-4b2c-943d-d5191a09c941 1073741824" returned: 0 in 0.773s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:56:15 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-50b8e3df-19fb-45ba-9230-8822abddc560 tempest-VolumeQuotasNegativeTestJSON-1966740659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b22525c5-6d48-4b2c-943d-d5191a09c941 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:56:15 devstack sudo[101099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b22525c5-6d48-4b2c-943d-d5191a09c941
Jun 15 15:56:15 devstack sudo[101099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:56:15 devstack sudo[101099]: pam_unix(sudo:session): session closed for user root
Jun 15 15:56:15 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-50b8e3df-19fb-45ba-9230-8822abddc560 tempest-VolumeQuotasNegativeTestJSON-1966740659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b22525c5-6d48-4b2c-943d-d5191a09c941" returned: 0 in 0.606s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:56:15 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-50b8e3df-19fb-45ba-9230-8822abddc560 tempest-VolumeQuotasNegativeTestJSON-1966740659 None] <== create_volume: return (1418ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 15:56:15 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-50b8e3df-19fb-45ba-9230-8822abddc560 tempest-VolumeQuotasNegativeTestJSON-1966740659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.422s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:56:15 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-50b8e3df-19fb-45ba-9230-8822abddc560 tempest-VolumeQuotasNegativeTestJSON-1966740659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbe10d05-5d4b-4ece-b9e2-68ff3a588922) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b22525c5-6d48-4b2c-943d-d5191a09c941', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:56:15 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-50b8e3df-19fb-45ba-9230-8822abddc560 tempest-VolumeQuotasNegativeTestJSON-1966740659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2043fad9-fe79-4512-823a-287064686d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:56:15 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-50b8e3df-19fb-45ba-9230-8822abddc560 tempest-VolumeQuotasNegativeTestJSON-1966740659 None] Volume volume-b22525c5-6d48-4b2c-943d-d5191a09c941 (b22525c5-6d48-4b2c-943d-d5191a09c941): created successfully
Jun 15 15:56:15 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-50b8e3df-19fb-45ba-9230-8822abddc560 tempest-VolumeQuotasNegativeTestJSON-1966740659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2043fad9-fe79-4512-823a-287064686d84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:56:15 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-50b8e3df-19fb-45ba-9230-8822abddc560 tempest-VolumeQuotasNegativeTestJSON-1966740659 None] Flow 'volume_create_manager' (5a3e8fd9-ad85-4c4b-8f65-0ec5abd0a1df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:56:15 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-50b8e3df-19fb-45ba-9230-8822abddc560 tempest-VolumeQuotasNegativeTestJSON-1966740659 None] Created volume successfully.
Jun 15 15:56:16 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-e64e6fb2-fe39-416c-a07c-5e7d726f34ce tempest-GroupSnapshotsTest-902971916 None] Update group completed successfully.
Jun 15 15:56:17 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-c3039baa-74a8-4826-abea-f9d8772950b0 tempest-VolumeQuotasNegativeTestJSON-1966740659 None] Acquiring lock "cinder-b22525c5-6d48-4b2c-943d-d5191a09c941-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:56:17 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-c3039baa-74a8-4826-abea-f9d8772950b0 tempest-VolumeQuotasNegativeTestJSON-1966740659 None] Lock "cinder-b22525c5-6d48-4b2c-943d-d5191a09c941-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:56:17 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-c3039baa-74a8-4826-abea-f9d8772950b0 tempest-VolumeQuotasNegativeTestJSON-1966740659 None] Acquiring lock "cinder-quobyte-b22525c5-6d48-4b2c-943d-d5191a09c941" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:56:17 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-c3039baa-74a8-4826-abea-f9d8772950b0 tempest-VolumeQuotasNegativeTestJSON-1966740659 None] Lock "cinder-quobyte-b22525c5-6d48-4b2c-943d-d5191a09c941" acquired by "delete_volume" :: waited 0.012s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:56:17 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a249e3c2-b806-4577-ad09-b218a4101a4d]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:56:17 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c3039baa-74a8-4826-abea-f9d8772950b0 tempest-VolumeQuotasNegativeTestJSON-1966740659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b22525c5-6d48-4b2c-943d-d5191a09c941 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:56:17 devstack sudo[101102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b22525c5-6d48-4b2c-943d-d5191a09c941
Jun 15 15:56:17 devstack sudo[101102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:56:17 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-74bea1f6-d33a-4850-81d7-64fde6efce0e tempest-GroupSnapshotsTest-902971916 None] Update group completed successfully.
Jun 15 15:56:17 devstack sudo[101102]: pam_unix(sudo:session): session closed for user root
Jun 15 15:56:17 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c3039baa-74a8-4826-abea-f9d8772950b0 tempest-VolumeQuotasNegativeTestJSON-1966740659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b22525c5-6d48-4b2c-943d-d5191a09c941" returned: 0 in 0.720s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:56:17 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c3039baa-74a8-4826-abea-f9d8772950b0 tempest-VolumeQuotasNegativeTestJSON-1966740659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b22525c5-6d48-4b2c-943d-d5191a09c941 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:56:17 devstack sudo[101107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b22525c5-6d48-4b2c-943d-d5191a09c941
Jun 15 15:56:17 devstack sudo[101107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:56:18 devstack sudo[101107]: pam_unix(sudo:session): session closed for user root
Jun 15 15:56:18 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c3039baa-74a8-4826-abea-f9d8772950b0 tempest-VolumeQuotasNegativeTestJSON-1966740659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b22525c5-6d48-4b2c-943d-d5191a09c941" returned: 0 in 0.666s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:56:18 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-c3039baa-74a8-4826-abea-f9d8772950b0 tempest-VolumeQuotasNegativeTestJSON-1966740659 None] Lock "cinder-quobyte-b22525c5-6d48-4b2c-943d-d5191a09c941" released by "delete_volume" :: held 1.439s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:56:18 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-c3039baa-74a8-4826-abea-f9d8772950b0 tempest-VolumeQuotasNegativeTestJSON-1966740659 None] Created reservations ['683a0aba-6cd1-4d00-b56b-baf840b0fa6e', '7281b393-e0cb-41dd-9681-6d2a83491213', 'b167f0b5-01c8-4c50-b952-147d309ecb3e', '88f80b07-f85b-43d1-8e73-9258732f1698'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:56:18 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-c3039baa-74a8-4826-abea-f9d8772950b0 tempest-VolumeQuotasNegativeTestJSON-1966740659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:56:18 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-c3039baa-74a8-4826-abea-f9d8772950b0 tempest-VolumeQuotasNegativeTestJSON-1966740659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:56:18 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-c3039baa-74a8-4826-abea-f9d8772950b0 tempest-VolumeQuotasNegativeTestJSON-1966740659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:56:18 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-c3039baa-74a8-4826-abea-f9d8772950b0 tempest-VolumeQuotasNegativeTestJSON-1966740659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:56:18 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-c3039baa-74a8-4826-abea-f9d8772950b0 tempest-VolumeQuotasNegativeTestJSON-1966740659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:56:18 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c3039baa-74a8-4826-abea-f9d8772950b0 tempest-VolumeQuotasNegativeTestJSON-1966740659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:56:18 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-6ae55c43-c914-41cc-80ce-33f604096b32 tempest-GroupSnapshotsTest-902971916 None] Update group completed successfully.
Jun 15 15:56:18 devstack sudo[101136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:56:18 devstack sudo[101136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:56:19 devstack sudo[101136]: pam_unix(sudo:session): session closed for user root
Jun 15 15:56:19 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c3039baa-74a8-4826-abea-f9d8772950b0 tempest-VolumeQuotasNegativeTestJSON-1966740659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.610s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:56:19 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-c3039baa-74a8-4826-abea-f9d8772950b0 tempest-VolumeQuotasNegativeTestJSON-1966740659 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:56:19 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-c3039baa-74a8-4826-abea-f9d8772950b0 tempest-VolumeQuotasNegativeTestJSON-1966740659 None] Deleted volume successfully.
Jun 15 15:56:19 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-c3039baa-74a8-4826-abea-f9d8772950b0 tempest-VolumeQuotasNegativeTestJSON-1966740659 None] Lock "cinder-b22525c5-6d48-4b2c-943d-d5191a09c941-delete_volume" released by "delete_volume" :: held 2.281s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:56:20 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-4323a55e-3d7a-4135-b074-15a72ee45276 tempest-GroupSnapshotsTest-902971916 None] GroupSnapshot 6a0b96d8-a7f6-41d2-9db1-3f9217525383: creating.
Jun 15 15:56:20 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-4323a55e-3d7a-4135-b074-15a72ee45276 tempest-GroupSnapshotsTest-902971916 None] Group snapshot 6a0b96d8-a7f6-41d2-9db1-3f9217525383: creating. {{(pid=91863) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jun 15 15:56:20 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-4323a55e-3d7a-4135-b074-15a72ee45276 tempest-GroupSnapshotsTest-902971916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:56:20 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-4323a55e-3d7a-4135-b074-15a72ee45276 tempest-GroupSnapshotsTest-902971916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:56:20 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-4323a55e-3d7a-4135-b074-15a72ee45276 tempest-GroupSnapshotsTest-902971916 None] Creating offline snapshot 045d8d4b-39b3-4c08-a5c2-5c1894bc71cf of volume 662b38f3-7495-4bef-b19f-0671c7e14f49 {{(pid=91863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 15 15:56:20 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[685ef41b-7581-475d-bc5b-2428f298c7b8]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:56:20 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-4323a55e-3d7a-4135-b074-15a72ee45276 tempest-GroupSnapshotsTest-902971916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-662b38f3-7495-4bef-b19f-0671c7e14f49 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:56:20 devstack sudo[101205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-662b38f3-7495-4bef-b19f-0671c7e14f49
Jun 15 15:56:20 devstack sudo[101205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:56:20 devstack sudo[101205]: pam_unix(sudo:session): session closed for user root
Jun 15 15:56:20 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-4323a55e-3d7a-4135-b074-15a72ee45276 tempest-GroupSnapshotsTest-902971916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-662b38f3-7495-4bef-b19f-0671c7e14f49" returned: 0 in 0.771s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:56:20 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-4323a55e-3d7a-4135-b074-15a72ee45276 tempest-GroupSnapshotsTest-902971916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-662b38f3-7495-4bef-b19f-0671c7e14f49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-662b38f3-7495-4bef-b19f-0671c7e14f49.045d8d4b-39b3-4c08-a5c2-5c1894bc71cf 1G {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:56:20 devstack sudo[101217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-662b38f3-7495-4bef-b19f-0671c7e14f49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-662b38f3-7495-4bef-b19f-0671c7e14f49.045d8d4b-39b3-4c08-a5c2-5c1894bc71cf 1G
Jun 15 15:56:20 devstack sudo[101217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:56:21 devstack sudo[101217]: pam_unix(sudo:session): session closed for user root
Jun 15 15:56:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-4323a55e-3d7a-4135-b074-15a72ee45276 tempest-GroupSnapshotsTest-902971916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-662b38f3-7495-4bef-b19f-0671c7e14f49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-662b38f3-7495-4bef-b19f-0671c7e14f49.045d8d4b-39b3-4c08-a5c2-5c1894bc71cf 1G" returned: 0 in 0.935s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:56:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-4323a55e-3d7a-4135-b074-15a72ee45276 tempest-GroupSnapshotsTest-902971916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-662b38f3-7495-4bef-b19f-0671c7e14f49 -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-662b38f3-7495-4bef-b19f-0671c7e14f49.045d8d4b-39b3-4c08-a5c2-5c1894bc71cf {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:56:21 devstack sudo[101236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-662b38f3-7495-4bef-b19f-0671c7e14f49 -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-662b38f3-7495-4bef-b19f-0671c7e14f49.045d8d4b-39b3-4c08-a5c2-5c1894bc71cf
Jun 15 15:56:21 devstack sudo[101236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:56:23 devstack sudo[101236]: pam_unix(sudo:session): session closed for user root
Jun 15 15:56:23 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-4323a55e-3d7a-4135-b074-15a72ee45276 tempest-GroupSnapshotsTest-902971916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-662b38f3-7495-4bef-b19f-0671c7e14f49 -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-662b38f3-7495-4bef-b19f-0671c7e14f49.045d8d4b-39b3-4c08-a5c2-5c1894bc71cf" returned: 0 in 1.271s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:56:23 devstack cinder-volume[91863]: WARNING cinder.volume.drivers.remotefs [None req-4323a55e-3d7a-4135-b074-15a72ee45276 tempest-GroupSnapshotsTest-902971916 None] /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-662b38f3-7495-4bef-b19f-0671c7e14f49.045d8d4b-39b3-4c08-a5c2-5c1894bc71cf is being set with open permissions: ugo+rw: NotImplementedError
Jun 15 15:56:23 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-4323a55e-3d7a-4135-b074-15a72ee45276 tempest-GroupSnapshotsTest-902971916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-662b38f3-7495-4bef-b19f-0671c7e14f49.045d8d4b-39b3-4c08-a5c2-5c1894bc71cf {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:56:23 devstack sudo[101623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-662b38f3-7495-4bef-b19f-0671c7e14f49.045d8d4b-39b3-4c08-a5c2-5c1894bc71cf
Jun 15 15:56:23 devstack sudo[101623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:56:23 devstack sudo[101623]: pam_unix(sudo:session): session closed for user root
Jun 15 15:56:23 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-4323a55e-3d7a-4135-b074-15a72ee45276 tempest-GroupSnapshotsTest-902971916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-662b38f3-7495-4bef-b19f-0671c7e14f49.045d8d4b-39b3-4c08-a5c2-5c1894bc71cf" returned: 0 in 0.690s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:56:23 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-4323a55e-3d7a-4135-b074-15a72ee45276 tempest-GroupSnapshotsTest-902971916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-662b38f3-7495-4bef-b19f-0671c7e14f49.info {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:56:23 devstack sudo[101627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-662b38f3-7495-4bef-b19f-0671c7e14f49.info
Jun 15 15:56:23 devstack sudo[101627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:56:24 devstack sudo[101627]: pam_unix(sudo:session): session closed for user root
Jun 15 15:56:24 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-4323a55e-3d7a-4135-b074-15a72ee45276 tempest-GroupSnapshotsTest-902971916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-662b38f3-7495-4bef-b19f-0671c7e14f49.info" returned: 0 in 0.760s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:56:24 devstack cinder-volume[91863]: WARNING cinder.volume.drivers.remotefs [None req-4323a55e-3d7a-4135-b074-15a72ee45276 tempest-GroupSnapshotsTest-902971916 None] /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-662b38f3-7495-4bef-b19f-0671c7e14f49.info is being set with open permissions: ugo+rw: NotImplementedError
Jun 15 15:56:24 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-4323a55e-3d7a-4135-b074-15a72ee45276 tempest-GroupSnapshotsTest-902971916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-662b38f3-7495-4bef-b19f-0671c7e14f49.info {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:56:24 devstack sudo[101631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-662b38f3-7495-4bef-b19f-0671c7e14f49.info
Jun 15 15:56:24 devstack sudo[101631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:56:25 devstack sudo[101631]: pam_unix(sudo:session): session closed for user root
Jun 15 15:56:25 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-4323a55e-3d7a-4135-b074-15a72ee45276 tempest-GroupSnapshotsTest-902971916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-662b38f3-7495-4bef-b19f-0671c7e14f49.info" returned: 0 in 0.649s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:56:25 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-4323a55e-3d7a-4135-b074-15a72ee45276 tempest-GroupSnapshotsTest-902971916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.178s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:56:25 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-4323a55e-3d7a-4135-b074-15a72ee45276 tempest-GroupSnapshotsTest-902971916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:56:25 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-4323a55e-3d7a-4135-b074-15a72ee45276 tempest-GroupSnapshotsTest-902971916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:56:25 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-4323a55e-3d7a-4135-b074-15a72ee45276 tempest-GroupSnapshotsTest-902971916 None] Creating offline snapshot 31ef0ccf-09ea-4f0a-92db-552cfaa03e45 of volume ae93e4a6-3ee1-46d0-82a0-b264eae897a6 {{(pid=91863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 15 15:56:25 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c76cc32-7f9a-4661-9afd-bf6d0c94e5c3]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:56:25 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-4323a55e-3d7a-4135-b074-15a72ee45276 tempest-GroupSnapshotsTest-902971916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-ae93e4a6-3ee1-46d0-82a0-b264eae897a6 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:56:25 devstack sudo[101634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-ae93e4a6-3ee1-46d0-82a0-b264eae897a6
Jun 15 15:56:25 devstack sudo[101634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:56:25 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f7295ff-ae23-4d8d-ab53-143b0239fe95 tempest-VolumeRetypeWithoutMigrationTest-171794950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 15:56:25 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-7f7295ff-ae23-4d8d-ab53-143b0239fe95 tempest-VolumeRetypeWithoutMigrationTest-171794950 None] Flow 'volume_create_manager' (2b2082fe-69cf-4d64-97d0-d246032f4faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:56:25 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-7f7295ff-ae23-4d8d-ab53-143b0239fe95 tempest-VolumeRetypeWithoutMigrationTest-171794950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3802df34-b6e0-4005-8643-72073c7cabd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:56:25 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-7f7295ff-ae23-4d8d-ab53-143b0239fe95 tempest-VolumeRetypeWithoutMigrationTest-171794950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3802df34-b6e0-4005-8643-72073c7cabd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:56:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1810293356',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=309b0b27-f380-48e1-8f64-219888175dfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe8d35b951144389a1962d5bc06d2987',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:56:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:56:26Z,use_quota=True,user_id='382bb9acec874476a25e804c77c00118',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(96ad605d-8496-4477-8b67-88a0a64f817a),volume_type_id=96ad605d-8496-4477-8b67-88a0a64f817a)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:56:25 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-7f7295ff-ae23-4d8d-ab53-143b0239fe95 tempest-VolumeRetypeWithoutMigrationTest-171794950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cd20813-0458-464d-b2f9-b17f9dbe708a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:56:25 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-7f7295ff-ae23-4d8d-ab53-143b0239fe95 tempest-VolumeRetypeWithoutMigrationTest-171794950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cd20813-0458-464d-b2f9-b17f9dbe708a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:56:25 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-7f7295ff-ae23-4d8d-ab53-143b0239fe95 tempest-VolumeRetypeWithoutMigrationTest-171794950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bb88318-2f57-4cf9-80be-d9af20a4e85a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:56:25 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-7f7295ff-ae23-4d8d-ab53-143b0239fe95 tempest-VolumeRetypeWithoutMigrationTest-171794950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bb88318-2f57-4cf9-80be-d9af20a4e85a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '309b0b27-f380-48e1-8f64-219888175dfe', 'volume_name': 'volume-309b0b27-f380-48e1-8f64-219888175dfe', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:56:25 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-7f7295ff-ae23-4d8d-ab53-143b0239fe95 tempest-VolumeRetypeWithoutMigrationTest-171794950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4557048f-713b-4dbc-9e8f-40ee9367dc2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:56:25 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-7f7295ff-ae23-4d8d-ab53-143b0239fe95 tempest-VolumeRetypeWithoutMigrationTest-171794950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4557048f-713b-4dbc-9e8f-40ee9367dc2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:56:25 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-7f7295ff-ae23-4d8d-ab53-143b0239fe95 tempest-VolumeRetypeWithoutMigrationTest-171794950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08de9160-3921-4fc2-ad10-9d434ce42f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:56:25 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-7f7295ff-ae23-4d8d-ab53-143b0239fe95 tempest-VolumeRetypeWithoutMigrationTest-171794950 None] Volume 309b0b27-f380-48e1-8f64-219888175dfe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-309b0b27-f380-48e1-8f64-219888175dfe', 'volume_size': 1}
Jun 15 15:56:25 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-7f7295ff-ae23-4d8d-ab53-143b0239fe95 tempest-VolumeRetypeWithoutMigrationTest-171794950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:56:26 devstack sudo[101634]: pam_unix(sudo:session): session closed for user root
Jun 15 15:56:26 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-4323a55e-3d7a-4135-b074-15a72ee45276 tempest-GroupSnapshotsTest-902971916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-ae93e4a6-3ee1-46d0-82a0-b264eae897a6" returned: 0 in 0.853s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:56:26 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-4323a55e-3d7a-4135-b074-15a72ee45276 tempest-GroupSnapshotsTest-902971916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-ae93e4a6-3ee1-46d0-82a0-b264eae897a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-ae93e4a6-3ee1-46d0-82a0-b264eae897a6.31ef0ccf-09ea-4f0a-92db-552cfaa03e45 1G {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:56:26 devstack sudo[101639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-ae93e4a6-3ee1-46d0-82a0-b264eae897a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-ae93e4a6-3ee1-46d0-82a0-b264eae897a6.31ef0ccf-09ea-4f0a-92db-552cfaa03e45 1G
Jun 15 15:56:26 devstack sudo[101639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:56:27 devstack sudo[101639]: pam_unix(sudo:session): session closed for user root
Jun 15 15:56:27 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-4323a55e-3d7a-4135-b074-15a72ee45276 tempest-GroupSnapshotsTest-902971916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-ae93e4a6-3ee1-46d0-82a0-b264eae897a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-ae93e4a6-3ee1-46d0-82a0-b264eae897a6.31ef0ccf-09ea-4f0a-92db-552cfaa03e45 1G" returned: 0 in 0.842s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:56:27 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-4323a55e-3d7a-4135-b074-15a72ee45276 tempest-GroupSnapshotsTest-902971916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae93e4a6-3ee1-46d0-82a0-b264eae897a6 -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-ae93e4a6-3ee1-46d0-82a0-b264eae897a6.31ef0ccf-09ea-4f0a-92db-552cfaa03e45 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:56:27 devstack sudo[101644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae93e4a6-3ee1-46d0-82a0-b264eae897a6 -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-ae93e4a6-3ee1-46d0-82a0-b264eae897a6.31ef0ccf-09ea-4f0a-92db-552cfaa03e45
Jun 15 15:56:27 devstack sudo[101644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:56:27 devstack sudo[101644]: pam_unix(sudo:session): session closed for user root
Jun 15 15:56:27 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-4323a55e-3d7a-4135-b074-15a72ee45276 tempest-GroupSnapshotsTest-902971916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae93e4a6-3ee1-46d0-82a0-b264eae897a6 -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-ae93e4a6-3ee1-46d0-82a0-b264eae897a6.31ef0ccf-09ea-4f0a-92db-552cfaa03e45" returned: 0 in 0.640s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:56:27 devstack cinder-volume[91863]: WARNING cinder.volume.drivers.remotefs [None req-4323a55e-3d7a-4135-b074-15a72ee45276 tempest-GroupSnapshotsTest-902971916 None] /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-ae93e4a6-3ee1-46d0-82a0-b264eae897a6.31ef0ccf-09ea-4f0a-92db-552cfaa03e45 is being set with open permissions: ugo+rw: NotImplementedError
Jun 15 15:56:27 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-4323a55e-3d7a-4135-b074-15a72ee45276 tempest-GroupSnapshotsTest-902971916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-ae93e4a6-3ee1-46d0-82a0-b264eae897a6.31ef0ccf-09ea-4f0a-92db-552cfaa03e45 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:56:27 devstack sudo[101649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-ae93e4a6-3ee1-46d0-82a0-b264eae897a6.31ef0ccf-09ea-4f0a-92db-552cfaa03e45
Jun 15 15:56:27 devstack sudo[101649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:56:28 devstack sudo[101649]: pam_unix(sudo:session): session closed for user root
Jun 15 15:56:28 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-4323a55e-3d7a-4135-b074-15a72ee45276 tempest-GroupSnapshotsTest-902971916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-ae93e4a6-3ee1-46d0-82a0-b264eae897a6.31ef0ccf-09ea-4f0a-92db-552cfaa03e45" returned: 0 in 0.579s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:56:28 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-4323a55e-3d7a-4135-b074-15a72ee45276 tempest-GroupSnapshotsTest-902971916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-ae93e4a6-3ee1-46d0-82a0-b264eae897a6.info {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:56:28 devstack sudo[101652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-ae93e4a6-3ee1-46d0-82a0-b264eae897a6.info
Jun 15 15:56:28 devstack sudo[101652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:56:28 devstack sudo[101652]: pam_unix(sudo:session): session closed for user root
Jun 15 15:56:28 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-4323a55e-3d7a-4135-b074-15a72ee45276 tempest-GroupSnapshotsTest-902971916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-ae93e4a6-3ee1-46d0-82a0-b264eae897a6.info" returned: 0 in 0.580s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:56:28 devstack cinder-volume[91863]: WARNING cinder.volume.drivers.remotefs [None req-4323a55e-3d7a-4135-b074-15a72ee45276 tempest-GroupSnapshotsTest-902971916 None] /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-ae93e4a6-3ee1-46d0-82a0-b264eae897a6.info is being set with open permissions: ugo+rw: NotImplementedError
Jun 15 15:56:28 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-4323a55e-3d7a-4135-b074-15a72ee45276 tempest-GroupSnapshotsTest-902971916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-ae93e4a6-3ee1-46d0-82a0-b264eae897a6.info {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:56:28 devstack sudo[101655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-ae93e4a6-3ee1-46d0-82a0-b264eae897a6.info
Jun 15 15:56:28 devstack sudo[101655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:56:29 devstack sudo[101655]: pam_unix(sudo:session): session closed for user root
Jun 15 15:56:29 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-4323a55e-3d7a-4135-b074-15a72ee45276 tempest-GroupSnapshotsTest-902971916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-ae93e4a6-3ee1-46d0-82a0-b264eae897a6.info" returned: 0 in 0.584s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:56:29 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-4323a55e-3d7a-4135-b074-15a72ee45276 tempest-GroupSnapshotsTest-902971916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.244s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:56:29 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-7f7295ff-ae23-4d8d-ab53-143b0239fe95 tempest-VolumeRetypeWithoutMigrationTest-171794950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.748s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:56:29 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-7f7295ff-ae23-4d8d-ab53-143b0239fe95 tempest-VolumeRetypeWithoutMigrationTest-171794950 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:56:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1810293356',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=309b0b27-f380-48e1-8f64-219888175dfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe8d35b951144389a1962d5bc06d2987',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:56:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:56:26Z,use_quota=True,user_id='382bb9acec874476a25e804c77c00118',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(96ad605d-8496-4477-8b67-88a0a64f817a),volume_type_id=96ad605d-8496-4477-8b67-88a0a64f817a)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 15:56:29 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-7f7295ff-ae23-4d8d-ab53-143b0239fe95 tempest-VolumeRetypeWithoutMigrationTest-171794950 None] Creating volume 309b0b27-f380-48e1-8f64-219888175dfe {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 15:56:29 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-7f7295ff-ae23-4d8d-ab53-143b0239fe95 tempest-VolumeRetypeWithoutMigrationTest-171794950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:56:29 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-7f7295ff-ae23-4d8d-ab53-143b0239fe95 tempest-VolumeRetypeWithoutMigrationTest-171794950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:56:29 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-7f7295ff-ae23-4d8d-ab53-143b0239fe95 tempest-VolumeRetypeWithoutMigrationTest-171794950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:56:29 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-7f7295ff-ae23-4d8d-ab53-143b0239fe95 tempest-VolumeRetypeWithoutMigrationTest-171794950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:56:29 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-7f7295ff-ae23-4d8d-ab53-143b0239fe95 tempest-VolumeRetypeWithoutMigrationTest-171794950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:56:29 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-7f7295ff-ae23-4d8d-ab53-143b0239fe95 tempest-VolumeRetypeWithoutMigrationTest-171794950 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 15:56:29 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-7f7295ff-ae23-4d8d-ab53-143b0239fe95 tempest-VolumeRetypeWithoutMigrationTest-171794950 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 15:56:29 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-7f7295ff-ae23-4d8d-ab53-143b0239fe95 tempest-VolumeRetypeWithoutMigrationTest-171794950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-309b0b27-f380-48e1-8f64-219888175dfe 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:56:29 devstack sudo[101658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-309b0b27-f380-48e1-8f64-219888175dfe 1073741824
Jun 15 15:56:29 devstack sudo[101658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:56:29 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-4323a55e-3d7a-4135-b074-15a72ee45276 tempest-GroupSnapshotsTest-902971916 None] group_snapshot 6a0b96d8-a7f6-41d2-9db1-3f9217525383: created successfully
Jun 15 15:56:30 devstack sudo[101658]: pam_unix(sudo:session): session closed for user root
Jun 15 15:56:30 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-7f7295ff-ae23-4d8d-ab53-143b0239fe95 tempest-VolumeRetypeWithoutMigrationTest-171794950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-309b0b27-f380-48e1-8f64-219888175dfe 1073741824" returned: 0 in 0.822s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:56:30 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-7f7295ff-ae23-4d8d-ab53-143b0239fe95 tempest-VolumeRetypeWithoutMigrationTest-171794950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-309b0b27-f380-48e1-8f64-219888175dfe {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:56:30 devstack sudo[101663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-309b0b27-f380-48e1-8f64-219888175dfe
Jun 15 15:56:30 devstack sudo[101663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:56:30 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-d290a350-5339-43d0-a39b-2932e4b7110a tempest-GroupSnapshotsTest-902971916 None] group_snapshot 6a0b96d8-a7f6-41d2-9db1-3f9217525383: deleting
Jun 15 15:56:30 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-d290a350-5339-43d0-a39b-2932e4b7110a tempest-GroupSnapshotsTest-902971916 None] group_snapshot 6a0b96d8-a7f6-41d2-9db1-3f9217525383: deleting {{(pid=91863) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jun 15 15:56:30 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-d290a350-5339-43d0-a39b-2932e4b7110a tempest-GroupSnapshotsTest-902971916 None] Acquiring lock "cinder-quobyte-662b38f3-7495-4bef-b19f-0671c7e14f49" by "delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:56:30 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-d290a350-5339-43d0-a39b-2932e4b7110a tempest-GroupSnapshotsTest-902971916 None] Lock "cinder-quobyte-662b38f3-7495-4bef-b19f-0671c7e14f49" acquired by "delete_snapshot" :: waited 0.021s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:56:30 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-d290a350-5339-43d0-a39b-2932e4b7110a tempest-GroupSnapshotsTest-902971916 None] Acquiring lock "cinder-quobyte-045d8d4b-39b3-4c08-a5c2-5c1894bc71cf" by "_delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:56:30 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-d290a350-5339-43d0-a39b-2932e4b7110a tempest-GroupSnapshotsTest-902971916 None] Lock "cinder-quobyte-045d8d4b-39b3-4c08-a5c2-5c1894bc71cf" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:56:30 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-d290a350-5339-43d0-a39b-2932e4b7110a tempest-GroupSnapshotsTest-902971916 None] Deleting offline snapshot 045d8d4b-39b3-4c08-a5c2-5c1894bc71cf of volume 662b38f3-7495-4bef-b19f-0671c7e14f49 {{(pid=91863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 15 15:56:31 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-d290a350-5339-43d0-a39b-2932e4b7110a tempest-GroupSnapshotsTest-902971916 None] snapshot_file for this snap is: volume-662b38f3-7495-4bef-b19f-0671c7e14f49.045d8d4b-39b3-4c08-a5c2-5c1894bc71cf {{(pid=91863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 15 15:56:31 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc5100bb-dd78-4bfe-b169-30fdb9e831af]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:56:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-d290a350-5339-43d0-a39b-2932e4b7110a tempest-GroupSnapshotsTest-902971916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-662b38f3-7495-4bef-b19f-0671c7e14f49.045d8d4b-39b3-4c08-a5c2-5c1894bc71cf {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:56:31 devstack cinder-volume[91863]: DEBUG oslo_service.periodic_task [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 15:56:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:56:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:56:31 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:56:31 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:56:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:56:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:56:31 devstack sudo[101663]: pam_unix(sudo:session): session closed for user root
Jun 15 15:56:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-7f7295ff-ae23-4d8d-ab53-143b0239fe95 tempest-VolumeRetypeWithoutMigrationTest-171794950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-309b0b27-f380-48e1-8f64-219888175dfe" returned: 0 in 0.748s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:56:31 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-7f7295ff-ae23-4d8d-ab53-143b0239fe95 tempest-VolumeRetypeWithoutMigrationTest-171794950 None] <== create_volume: return (1613ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 15:56:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-7f7295ff-ae23-4d8d-ab53-143b0239fe95 tempest-VolumeRetypeWithoutMigrationTest-171794950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.622s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:56:31 devstack sudo[101701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:56:31 devstack sudo[101701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:56:31 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-7f7295ff-ae23-4d8d-ab53-143b0239fe95 tempest-VolumeRetypeWithoutMigrationTest-171794950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08de9160-3921-4fc2-ad10-9d434ce42f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-309b0b27-f380-48e1-8f64-219888175dfe', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:56:31 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-7f7295ff-ae23-4d8d-ab53-143b0239fe95 tempest-VolumeRetypeWithoutMigrationTest-171794950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f283212-6dda-4977-b95d-9757b01b54d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:56:31 devstack sudo[101700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-662b38f3-7495-4bef-b19f-0671c7e14f49.045d8d4b-39b3-4c08-a5c2-5c1894bc71cf
Jun 15 15:56:31 devstack sudo[101700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:56:31 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-7f7295ff-ae23-4d8d-ab53-143b0239fe95 tempest-VolumeRetypeWithoutMigrationTest-171794950 None] Volume volume-309b0b27-f380-48e1-8f64-219888175dfe (309b0b27-f380-48e1-8f64-219888175dfe): created successfully
Jun 15 15:56:31 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-7f7295ff-ae23-4d8d-ab53-143b0239fe95 tempest-VolumeRetypeWithoutMigrationTest-171794950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f283212-6dda-4977-b95d-9757b01b54d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:56:31 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-7f7295ff-ae23-4d8d-ab53-143b0239fe95 tempest-VolumeRetypeWithoutMigrationTest-171794950 None] Flow 'volume_create_manager' (2b2082fe-69cf-4d64-97d0-d246032f4faa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:56:31 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-7f7295ff-ae23-4d8d-ab53-143b0239fe95 tempest-VolumeRetypeWithoutMigrationTest-171794950 None] Created volume successfully.
Jun 15 15:56:31 devstack sudo[101700]: pam_unix(sudo:session): session closed for user root
Jun 15 15:56:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-d290a350-5339-43d0-a39b-2932e4b7110a tempest-GroupSnapshotsTest-902971916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-662b38f3-7495-4bef-b19f-0671c7e14f49.045d8d4b-39b3-4c08-a5c2-5c1894bc71cf" returned: 0 in 0.857s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:56:31 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-d290a350-5339-43d0-a39b-2932e4b7110a tempest-GroupSnapshotsTest-902971916 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-662b38f3-7495-4bef-b19f-0671c7e14f49(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 15:56:31 devstack sudo[101701]: pam_unix(sudo:session): session closed for user root
Jun 15 15:56:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.794s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:56:31 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:56:31 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[786efdb8-74cd-4638-830a-0c843a5b611b]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:56:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-d290a350-5339-43d0-a39b-2932e4b7110a tempest-GroupSnapshotsTest-902971916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-662b38f3-7495-4bef-b19f-0671c7e14f49 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:56:31 devstack cinder-volume[91863]: DEBUG oslo_service.periodic_task [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Running periodic task VolumeManager._thread_info {{(pid=91863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 15:56:31 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] thread count: 28 {{(pid=91863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 15 15:56:31 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] thread info: [<_MainThread(MainThread, started 131088232640640)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131088122704576)>, <Thread(Thread-3 (stat_writer), started daemon 131088123058112)>, <Thread(Rabbit-heartbeat, started daemon 131088121268864)>, <Thread(Thread-5 (_runner), started daemon 131088121904192)>, <Thread(Thread-7 (_runner), started daemon 131088122037248)>, <Thread(fd_logger, started daemon 131088119630784)>, <Thread(privsep_reader, started daemon 131088119781440)>, <Thread(tpool_thread_0, started daemon 131088111617728)>, <Thread(tpool_thread_1, started daemon 131088103225024)>, <Thread(tpool_thread_2, started daemon 131088094832320)>, <Thread(tpool_thread_3, started daemon 131088086439616)>, <Thread(tpool_thread_4, started daemon 131088078046912)>, <Thread(tpool_thread_5, started daemon 131088069654208)>, <Thread(tpool_thread_6, started daemon 131088061261504)>, <Thread(tpool_thread_7, started daemon 131088052868800)>, <Thread(tpool_thread_8, started daemon 131088044476096)>, <Thread(tpool_thread_9, started daemon 131088036083392)>, <Thread(tpool_thread_10, started daemon 131088027690688)>, <Thread(tpool_thread_11, started daemon 131088019297984)>, <Thread(tpool_thread_12, started daemon 131088010905280)>, <Thread(tpool_thread_13, started daemon 131088002512576)>, <Thread(tpool_thread_14, started daemon 131087994119872)>, <Thread(tpool_thread_15, started daemon 131087985727168)>, <Thread(tpool_thread_16, started daemon 131087977334464)>, <Thread(tpool_thread_17, started daemon 131087968941760)>, <Thread(tpool_thread_18, started daemon 131087960549056)>, <Thread(tpool_thread_19, started daemon 131087952156352)>] {{(pid=91863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 15 15:56:32 devstack sudo[101710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-662b38f3-7495-4bef-b19f-0671c7e14f49
Jun 15 15:56:32 devstack sudo[101710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:56:32 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-34810842-ff48-4812-86b5-00fa28aa0ae3 tempest-VolumeRetypeWithoutMigrationTest-171794950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:56:32 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-34810842-ff48-4812-86b5-00fa28aa0ae3 tempest-VolumeRetypeWithoutMigrationTest-171794950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:56:32 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-34810842-ff48-4812-86b5-00fa28aa0ae3 tempest-VolumeRetypeWithoutMigrationTest-171794950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:56:32 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-34810842-ff48-4812-86b5-00fa28aa0ae3 tempest-VolumeRetypeWithoutMigrationTest-171794950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:56:32 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-34810842-ff48-4812-86b5-00fa28aa0ae3 tempest-VolumeRetypeWithoutMigrationTest-171794950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:56:32 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-34810842-ff48-4812-86b5-00fa28aa0ae3 tempest-VolumeRetypeWithoutMigrationTest-171794950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:56:32 devstack sudo[101712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:56:32 devstack sudo[101712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:56:32 devstack sudo[101710]: pam_unix(sudo:session): session closed for user root
Jun 15 15:56:32 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-d290a350-5339-43d0-a39b-2932e4b7110a tempest-GroupSnapshotsTest-902971916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-662b38f3-7495-4bef-b19f-0671c7e14f49" returned: 0 in 0.780s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:56:32 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-d290a350-5339-43d0-a39b-2932e4b7110a tempest-GroupSnapshotsTest-902971916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-662b38f3-7495-4bef-b19f-0671c7e14f49.045d8d4b-39b3-4c08-a5c2-5c1894bc71cf {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:56:32 devstack sudo[101717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-662b38f3-7495-4bef-b19f-0671c7e14f49.045d8d4b-39b3-4c08-a5c2-5c1894bc71cf
Jun 15 15:56:32 devstack sudo[101717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:56:33 devstack sudo[101712]: pam_unix(sudo:session): session closed for user root
Jun 15 15:56:33 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-34810842-ff48-4812-86b5-00fa28aa0ae3 tempest-VolumeRetypeWithoutMigrationTest-171794950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.587s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:56:33 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-34810842-ff48-4812-86b5-00fa28aa0ae3 tempest-VolumeRetypeWithoutMigrationTest-171794950 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:56:33 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-34810842-ff48-4812-86b5-00fa28aa0ae3 tempest-VolumeRetypeWithoutMigrationTest-171794950 None] Retype volume completed successfully.
Jun 15 15:56:33 devstack sudo[101717]: pam_unix(sudo:session): session closed for user root
Jun 15 15:56:33 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-d290a350-5339-43d0-a39b-2932e4b7110a tempest-GroupSnapshotsTest-902971916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-662b38f3-7495-4bef-b19f-0671c7e14f49.045d8d4b-39b3-4c08-a5c2-5c1894bc71cf" returned: 0 in 0.681s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:56:33 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-d290a350-5339-43d0-a39b-2932e4b7110a tempest-GroupSnapshotsTest-902971916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-662b38f3-7495-4bef-b19f-0671c7e14f49.045d8d4b-39b3-4c08-a5c2-5c1894bc71cf {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:56:33 devstack sudo[101723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-662b38f3-7495-4bef-b19f-0671c7e14f49.045d8d4b-39b3-4c08-a5c2-5c1894bc71cf
Jun 15 15:56:33 devstack sudo[101723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:56:33 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-99975e5b-6a1d-4b9e-83be-07b7abff9e09 tempest-VolumeRetypeWithoutMigrationTest-171794950 None] Acquiring lock "cinder-309b0b27-f380-48e1-8f64-219888175dfe-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:56:33 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-99975e5b-6a1d-4b9e-83be-07b7abff9e09 tempest-VolumeRetypeWithoutMigrationTest-171794950 None] Lock "cinder-309b0b27-f380-48e1-8f64-219888175dfe-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:56:33 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-99975e5b-6a1d-4b9e-83be-07b7abff9e09 tempest-VolumeRetypeWithoutMigrationTest-171794950 None] Acquiring lock "cinder-quobyte-309b0b27-f380-48e1-8f64-219888175dfe" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:56:33 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-99975e5b-6a1d-4b9e-83be-07b7abff9e09 tempest-VolumeRetypeWithoutMigrationTest-171794950 None] Lock "cinder-quobyte-309b0b27-f380-48e1-8f64-219888175dfe" acquired by "delete_volume" :: waited 0.021s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:56:33 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a2616b-9701-48c3-8f1b-a1daff90a4d7]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:56:33 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-99975e5b-6a1d-4b9e-83be-07b7abff9e09 tempest-VolumeRetypeWithoutMigrationTest-171794950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-309b0b27-f380-48e1-8f64-219888175dfe {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:56:34 devstack sudo[101725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-309b0b27-f380-48e1-8f64-219888175dfe
Jun 15 15:56:34 devstack sudo[101725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:56:34 devstack sudo[101723]: pam_unix(sudo:session): session closed for user root
Jun 15 15:56:34 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-d290a350-5339-43d0-a39b-2932e4b7110a tempest-GroupSnapshotsTest-902971916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-662b38f3-7495-4bef-b19f-0671c7e14f49.045d8d4b-39b3-4c08-a5c2-5c1894bc71cf" returned: 0 in 0.673s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:56:34 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-d290a350-5339-43d0-a39b-2932e4b7110a tempest-GroupSnapshotsTest-902971916 None] Lock "cinder-quobyte-045d8d4b-39b3-4c08-a5c2-5c1894bc71cf" released by "_delete_snapshot" :: held 3.165s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:56:34 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-d290a350-5339-43d0-a39b-2932e4b7110a tempest-GroupSnapshotsTest-902971916 None] Lock "cinder-quobyte-662b38f3-7495-4bef-b19f-0671c7e14f49" released by "delete_snapshot" :: held 3.195s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:56:34 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-d290a350-5339-43d0-a39b-2932e4b7110a tempest-GroupSnapshotsTest-902971916 None] Acquiring lock "cinder-quobyte-ae93e4a6-3ee1-46d0-82a0-b264eae897a6" by "delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:56:34 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-d290a350-5339-43d0-a39b-2932e4b7110a tempest-GroupSnapshotsTest-902971916 None] Lock "cinder-quobyte-ae93e4a6-3ee1-46d0-82a0-b264eae897a6" acquired by "delete_snapshot" :: waited 0.025s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:56:34 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-d290a350-5339-43d0-a39b-2932e4b7110a tempest-GroupSnapshotsTest-902971916 None] Acquiring lock "cinder-quobyte-31ef0ccf-09ea-4f0a-92db-552cfaa03e45" by "_delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:56:34 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-d290a350-5339-43d0-a39b-2932e4b7110a tempest-GroupSnapshotsTest-902971916 None] Lock "cinder-quobyte-31ef0ccf-09ea-4f0a-92db-552cfaa03e45" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:56:34 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-d290a350-5339-43d0-a39b-2932e4b7110a tempest-GroupSnapshotsTest-902971916 None] Deleting offline snapshot 31ef0ccf-09ea-4f0a-92db-552cfaa03e45 of volume ae93e4a6-3ee1-46d0-82a0-b264eae897a6 {{(pid=91863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 15 15:56:34 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-d290a350-5339-43d0-a39b-2932e4b7110a tempest-GroupSnapshotsTest-902971916 None] snapshot_file for this snap is: volume-ae93e4a6-3ee1-46d0-82a0-b264eae897a6.31ef0ccf-09ea-4f0a-92db-552cfaa03e45 {{(pid=91863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 15 15:56:34 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[daccfddb-ff64-4867-ba52-991f19d1cdef]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:56:34 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-d290a350-5339-43d0-a39b-2932e4b7110a tempest-GroupSnapshotsTest-902971916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-ae93e4a6-3ee1-46d0-82a0-b264eae897a6.31ef0ccf-09ea-4f0a-92db-552cfaa03e45 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:56:34 devstack sudo[101728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-ae93e4a6-3ee1-46d0-82a0-b264eae897a6.31ef0ccf-09ea-4f0a-92db-552cfaa03e45
Jun 15 15:56:34 devstack sudo[101728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:56:34 devstack sudo[101725]: pam_unix(sudo:session): session closed for user root
Jun 15 15:56:34 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-99975e5b-6a1d-4b9e-83be-07b7abff9e09 tempest-VolumeRetypeWithoutMigrationTest-171794950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-309b0b27-f380-48e1-8f64-219888175dfe" returned: 0 in 0.783s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:56:34 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-99975e5b-6a1d-4b9e-83be-07b7abff9e09 tempest-VolumeRetypeWithoutMigrationTest-171794950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-309b0b27-f380-48e1-8f64-219888175dfe {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:56:34 devstack sudo[101734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-309b0b27-f380-48e1-8f64-219888175dfe
Jun 15 15:56:34 devstack sudo[101734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:56:35 devstack sudo[101728]: pam_unix(sudo:session): session closed for user root
Jun 15 15:56:35 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-d290a350-5339-43d0-a39b-2932e4b7110a tempest-GroupSnapshotsTest-902971916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-ae93e4a6-3ee1-46d0-82a0-b264eae897a6.31ef0ccf-09ea-4f0a-92db-552cfaa03e45" returned: 0 in 0.773s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:56:35 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-d290a350-5339-43d0-a39b-2932e4b7110a tempest-GroupSnapshotsTest-902971916 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae93e4a6-3ee1-46d0-82a0-b264eae897a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 15:56:35 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d94f2ce2-7fce-403a-9329-c3d4418496d9]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:56:35 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-d290a350-5339-43d0-a39b-2932e4b7110a tempest-GroupSnapshotsTest-902971916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-ae93e4a6-3ee1-46d0-82a0-b264eae897a6 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:56:35 devstack sudo[101739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-ae93e4a6-3ee1-46d0-82a0-b264eae897a6
Jun 15 15:56:35 devstack sudo[101739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:56:35 devstack sudo[101734]: pam_unix(sudo:session): session closed for user root
Jun 15 15:56:35 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-99975e5b-6a1d-4b9e-83be-07b7abff9e09 tempest-VolumeRetypeWithoutMigrationTest-171794950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-309b0b27-f380-48e1-8f64-219888175dfe" returned: 0 in 0.609s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:56:35 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-99975e5b-6a1d-4b9e-83be-07b7abff9e09 tempest-VolumeRetypeWithoutMigrationTest-171794950 None] Lock "cinder-quobyte-309b0b27-f380-48e1-8f64-219888175dfe" released by "delete_volume" :: held 1.439s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:56:35 devstack cinder-volume[91863]: WARNING cinder.quota [None req-99975e5b-6a1d-4b9e-83be-07b7abff9e09 tempest-VolumeRetypeWithoutMigrationTest-171794950 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Jun 15 15:56:35 devstack cinder-volume[91863]: WARNING cinder.quota [None req-99975e5b-6a1d-4b9e-83be-07b7abff9e09 tempest-VolumeRetypeWithoutMigrationTest-171794950 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Jun 15 15:56:35 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-99975e5b-6a1d-4b9e-83be-07b7abff9e09 tempest-VolumeRetypeWithoutMigrationTest-171794950 None] Created reservations ['c8b7006e-54cb-420a-b0a5-a30f6a484127', '7a5a302e-1115-4acd-b5e5-10d81d697fda', '3467791b-f897-4854-89e5-484245ea6693', '4b211465-47aa-4e94-864a-c1b25388a77c'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:56:35 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-99975e5b-6a1d-4b9e-83be-07b7abff9e09 tempest-VolumeRetypeWithoutMigrationTest-171794950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:56:35 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-99975e5b-6a1d-4b9e-83be-07b7abff9e09 tempest-VolumeRetypeWithoutMigrationTest-171794950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:56:35 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-99975e5b-6a1d-4b9e-83be-07b7abff9e09 tempest-VolumeRetypeWithoutMigrationTest-171794950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:56:35 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-99975e5b-6a1d-4b9e-83be-07b7abff9e09 tempest-VolumeRetypeWithoutMigrationTest-171794950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:56:35 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-99975e5b-6a1d-4b9e-83be-07b7abff9e09 tempest-VolumeRetypeWithoutMigrationTest-171794950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:56:35 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-99975e5b-6a1d-4b9e-83be-07b7abff9e09 tempest-VolumeRetypeWithoutMigrationTest-171794950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:56:35 devstack sudo[101745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:56:35 devstack sudo[101745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:56:35 devstack sudo[101739]: pam_unix(sudo:session): session closed for user root
Jun 15 15:56:35 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-d290a350-5339-43d0-a39b-2932e4b7110a tempest-GroupSnapshotsTest-902971916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-ae93e4a6-3ee1-46d0-82a0-b264eae897a6" returned: 0 in 0.747s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:56:35 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-d290a350-5339-43d0-a39b-2932e4b7110a tempest-GroupSnapshotsTest-902971916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-ae93e4a6-3ee1-46d0-82a0-b264eae897a6.31ef0ccf-09ea-4f0a-92db-552cfaa03e45 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:56:35 devstack sudo[101754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-ae93e4a6-3ee1-46d0-82a0-b264eae897a6.31ef0ccf-09ea-4f0a-92db-552cfaa03e45
Jun 15 15:56:35 devstack sudo[101754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:56:36 devstack sudo[101745]: pam_unix(sudo:session): session closed for user root
Jun 15 15:56:36 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-99975e5b-6a1d-4b9e-83be-07b7abff9e09 tempest-VolumeRetypeWithoutMigrationTest-171794950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.770s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:56:36 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-99975e5b-6a1d-4b9e-83be-07b7abff9e09 tempest-VolumeRetypeWithoutMigrationTest-171794950 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:56:36 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-99975e5b-6a1d-4b9e-83be-07b7abff9e09 tempest-VolumeRetypeWithoutMigrationTest-171794950 None] Deleted volume successfully.
Jun 15 15:56:36 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-99975e5b-6a1d-4b9e-83be-07b7abff9e09 tempest-VolumeRetypeWithoutMigrationTest-171794950 None] Lock "cinder-309b0b27-f380-48e1-8f64-219888175dfe-delete_volume" released by "delete_volume" :: held 2.450s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:56:36 devstack sudo[101754]: pam_unix(sudo:session): session closed for user root
Jun 15 15:56:36 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-d290a350-5339-43d0-a39b-2932e4b7110a tempest-GroupSnapshotsTest-902971916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-ae93e4a6-3ee1-46d0-82a0-b264eae897a6.31ef0ccf-09ea-4f0a-92db-552cfaa03e45" returned: 0 in 0.780s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:56:36 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-d290a350-5339-43d0-a39b-2932e4b7110a tempest-GroupSnapshotsTest-902971916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-ae93e4a6-3ee1-46d0-82a0-b264eae897a6.31ef0ccf-09ea-4f0a-92db-552cfaa03e45 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:56:36 devstack sudo[101761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-ae93e4a6-3ee1-46d0-82a0-b264eae897a6.31ef0ccf-09ea-4f0a-92db-552cfaa03e45
Jun 15 15:56:36 devstack sudo[101761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:56:37 devstack sudo[101761]: pam_unix(sudo:session): session closed for user root
Jun 15 15:56:37 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-d290a350-5339-43d0-a39b-2932e4b7110a tempest-GroupSnapshotsTest-902971916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-ae93e4a6-3ee1-46d0-82a0-b264eae897a6.31ef0ccf-09ea-4f0a-92db-552cfaa03e45" returned: 0 in 0.618s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:56:37 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-d290a350-5339-43d0-a39b-2932e4b7110a tempest-GroupSnapshotsTest-902971916 None] Lock "cinder-quobyte-31ef0ccf-09ea-4f0a-92db-552cfaa03e45" released by "_delete_snapshot" :: held 3.041s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:56:37 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-d290a350-5339-43d0-a39b-2932e4b7110a tempest-GroupSnapshotsTest-902971916 None] Lock "cinder-quobyte-ae93e4a6-3ee1-46d0-82a0-b264eae897a6" released by "delete_snapshot" :: held 3.071s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:56:37 devstack cinder-volume[91863]: WARNING cinder.quota [None req-d290a350-5339-43d0-a39b-2932e4b7110a tempest-GroupSnapshotsTest-902971916 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1586005912 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1586005912, it is now deprecated. Please use the default quota class for default quota.
Jun 15 15:56:37 devstack cinder-volume[91863]: WARNING cinder.quota [None req-d290a350-5339-43d0-a39b-2932e4b7110a tempest-GroupSnapshotsTest-902971916 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1586005912 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1586005912, it is now deprecated. Please use the default quota class for default quota.
Jun 15 15:56:37 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-d290a350-5339-43d0-a39b-2932e4b7110a tempest-GroupSnapshotsTest-902971916 None] Created reservations ['cf8f8d70-1c36-42d8-a750-34aa48ae4003', '418fe471-9740-4a0b-88e6-2bed2a9ef097', '7f6cc403-415a-44fe-aec3-b96039b6f3c4', 'aca41f0b-d473-41b0-9b8d-e69264b1ae50'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:56:37 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-d290a350-5339-43d0-a39b-2932e4b7110a tempest-GroupSnapshotsTest-902971916 None] Created reservations ['d4fa4092-923f-4328-b740-fdd0ec4af30f', '26a7a76e-5b68-4946-bd93-64c4ffa92cbe', 'b2062eda-10b2-428f-a541-13b2efeb8d11', '6709086f-05ce-4245-b48a-fc752530bc73'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:56:37 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-d290a350-5339-43d0-a39b-2932e4b7110a tempest-GroupSnapshotsTest-902971916 None] group_snapshot 6a0b96d8-a7f6-41d2-9db1-3f9217525383: deleted successfully
Jun 15 15:56:38 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-28752796-b5af-416c-8a69-0d99e34599c4 tempest-GroupSnapshotsTest-902971916 None] Acquiring lock "cinder-quobyte-662b38f3-7495-4bef-b19f-0671c7e14f49" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:56:38 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-28752796-b5af-416c-8a69-0d99e34599c4 tempest-GroupSnapshotsTest-902971916 None] Lock "cinder-quobyte-662b38f3-7495-4bef-b19f-0671c7e14f49" acquired by "delete_volume" :: waited 0.019s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:56:38 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8974a23-d2f8-415e-b107-c97304eb15c6]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:56:38 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-28752796-b5af-416c-8a69-0d99e34599c4 tempest-GroupSnapshotsTest-902971916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-662b38f3-7495-4bef-b19f-0671c7e14f49 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:56:39 devstack sudo[101764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-662b38f3-7495-4bef-b19f-0671c7e14f49
Jun 15 15:56:39 devstack sudo[101764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:56:39 devstack sudo[101764]: pam_unix(sudo:session): session closed for user root
Jun 15 15:56:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-28752796-b5af-416c-8a69-0d99e34599c4 tempest-GroupSnapshotsTest-902971916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-662b38f3-7495-4bef-b19f-0671c7e14f49" returned: 0 in 0.756s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:56:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-28752796-b5af-416c-8a69-0d99e34599c4 tempest-GroupSnapshotsTest-902971916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-662b38f3-7495-4bef-b19f-0671c7e14f49 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:56:39 devstack sudo[101793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-662b38f3-7495-4bef-b19f-0671c7e14f49
Jun 15 15:56:39 devstack sudo[101793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:56:40 devstack sudo[101793]: pam_unix(sudo:session): session closed for user root
Jun 15 15:56:40 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-28752796-b5af-416c-8a69-0d99e34599c4 tempest-GroupSnapshotsTest-902971916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-662b38f3-7495-4bef-b19f-0671c7e14f49" returned: 0 in 0.607s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:56:40 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-28752796-b5af-416c-8a69-0d99e34599c4 tempest-GroupSnapshotsTest-902971916 None] Lock "cinder-quobyte-662b38f3-7495-4bef-b19f-0671c7e14f49" released by "delete_volume" :: held 1.432s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:56:40 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-28752796-b5af-416c-8a69-0d99e34599c4 tempest-GroupSnapshotsTest-902971916 None] Acquiring lock "cinder-quobyte-ae93e4a6-3ee1-46d0-82a0-b264eae897a6" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:56:40 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-28752796-b5af-416c-8a69-0d99e34599c4 tempest-GroupSnapshotsTest-902971916 None] Lock "cinder-quobyte-ae93e4a6-3ee1-46d0-82a0-b264eae897a6" acquired by "delete_volume" :: waited 0.016s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:56:40 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a6093c2-1039-4adc-a491-b928744cb6d8]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:56:40 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-28752796-b5af-416c-8a69-0d99e34599c4 tempest-GroupSnapshotsTest-902971916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-ae93e4a6-3ee1-46d0-82a0-b264eae897a6 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:56:40 devstack sudo[101796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-ae93e4a6-3ee1-46d0-82a0-b264eae897a6
Jun 15 15:56:40 devstack sudo[101796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:56:41 devstack sudo[101796]: pam_unix(sudo:session): session closed for user root
Jun 15 15:56:41 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-28752796-b5af-416c-8a69-0d99e34599c4 tempest-GroupSnapshotsTest-902971916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-ae93e4a6-3ee1-46d0-82a0-b264eae897a6" returned: 0 in 0.797s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:56:41 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-28752796-b5af-416c-8a69-0d99e34599c4 tempest-GroupSnapshotsTest-902971916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-ae93e4a6-3ee1-46d0-82a0-b264eae897a6 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:56:41 devstack sudo[101801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-ae93e4a6-3ee1-46d0-82a0-b264eae897a6
Jun 15 15:56:41 devstack sudo[101801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:56:41 devstack sudo[101801]: pam_unix(sudo:session): session closed for user root
Jun 15 15:56:41 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-28752796-b5af-416c-8a69-0d99e34599c4 tempest-GroupSnapshotsTest-902971916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-ae93e4a6-3ee1-46d0-82a0-b264eae897a6" returned: 0 in 0.617s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:56:41 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-28752796-b5af-416c-8a69-0d99e34599c4 tempest-GroupSnapshotsTest-902971916 None] Lock "cinder-quobyte-ae93e4a6-3ee1-46d0-82a0-b264eae897a6" released by "delete_volume" :: held 1.492s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:56:41 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-28752796-b5af-416c-8a69-0d99e34599c4 tempest-GroupSnapshotsTest-902971916 None] Created reservations ['1d8867ff-2d21-451a-afb6-3fc6f6e5fe20'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:56:41 devstack cinder-volume[91863]: WARNING cinder.quota [None req-28752796-b5af-416c-8a69-0d99e34599c4 tempest-GroupSnapshotsTest-902971916 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1586005912 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1586005912, it is now deprecated. Please use the default quota class for default quota.
Jun 15 15:56:41 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-28752796-b5af-416c-8a69-0d99e34599c4 tempest-GroupSnapshotsTest-902971916 None] Created reservations ['ccba9fee-e8ed-47a8-afd2-84e949a1e1ea', '235a7b89-c075-45d2-af24-791bcef12d74', '8c52f03a-7c52-4783-ab88-5f70e70c7e9d', '75ed7c32-e50a-495c-85ec-b4507c3efdb2'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:56:42 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-28752796-b5af-416c-8a69-0d99e34599c4 tempest-GroupSnapshotsTest-902971916 None] Created reservations ['74788c87-6447-4e47-834b-51cc78a90ce5', '4234ae84-d24e-4646-860b-c18dca8922e3', '390d1aca-9cf7-4c7c-9105-16c997af6212', '8da79149-e669-4694-a375-f61a52ca53bc'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:56:42 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-28752796-b5af-416c-8a69-0d99e34599c4 tempest-GroupSnapshotsTest-902971916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:56:42 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-28752796-b5af-416c-8a69-0d99e34599c4 tempest-GroupSnapshotsTest-902971916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:56:42 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-28752796-b5af-416c-8a69-0d99e34599c4 tempest-GroupSnapshotsTest-902971916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:56:42 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-28752796-b5af-416c-8a69-0d99e34599c4 tempest-GroupSnapshotsTest-902971916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:56:42 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-28752796-b5af-416c-8a69-0d99e34599c4 tempest-GroupSnapshotsTest-902971916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:56:42 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-28752796-b5af-416c-8a69-0d99e34599c4 tempest-GroupSnapshotsTest-902971916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:56:42 devstack sudo[101805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:56:42 devstack sudo[101805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:56:42 devstack sudo[101805]: pam_unix(sudo:session): session closed for user root
Jun 15 15:56:42 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-28752796-b5af-416c-8a69-0d99e34599c4 tempest-GroupSnapshotsTest-902971916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.734s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:56:42 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-28752796-b5af-416c-8a69-0d99e34599c4 tempest-GroupSnapshotsTest-902971916 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:56:42 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-28752796-b5af-416c-8a69-0d99e34599c4 tempest-GroupSnapshotsTest-902971916 None] Delete group completed successfully.
Jun 15 15:56:43 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-bd21d31e-6ac6-4427-8d17-e76aa28e2fef tempest-GroupSnapshotsTest-902971916 None] Group tempest-GroupSnapshotsTest-Group-939435201: creating
Jun 15 15:56:43 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-bd21d31e-6ac6-4427-8d17-e76aa28e2fef tempest-GroupSnapshotsTest-902971916 None] Group tempest-GroupSnapshotsTest-Group-939435201: created successfully
Jun 15 15:56:43 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-bd21d31e-6ac6-4427-8d17-e76aa28e2fef tempest-GroupSnapshotsTest-902971916 None] Create group completed successfully.
Jun 15 15:56:45 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-83eb2399-a48a-44b1-9a19-b5e46b86ac8e tempest-GroupSnapshotsTest-902971916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 15:56:45 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-83eb2399-a48a-44b1-9a19-b5e46b86ac8e tempest-GroupSnapshotsTest-902971916 None] Flow 'volume_create_manager' (38fdff6f-36bd-4b74-bab6-346b91c27bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:56:45 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-83eb2399-a48a-44b1-9a19-b5e46b86ac8e tempest-GroupSnapshotsTest-902971916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6dc082d-a8e1-4d8f-a560-3e39673853ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:56:45 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-83eb2399-a48a-44b1-9a19-b5e46b86ac8e tempest-GroupSnapshotsTest-902971916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6dc082d-a8e1-4d8f-a560-3e39673853ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:56:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-183850813',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d10498dd-8ba1-4e83-ab28-fea9a6281b6b,host='devstack@QuobyteHD#QuobyteHD',id=8e788e54-eb58-4c5e-a6c3-8d45d3028df3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aecd64c182d14ad0a5778916a7fba8bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:56:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:56:45Z,use_quota=True,user_id='ea09cc6a961546b2be44de9f24f3dbd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8548fa5b-de87-4223-a4f7-c08ede4ff49b),volume_type_id=8548fa5b-de87-4223-a4f7-c08ede4ff49b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:56:45 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-83eb2399-a48a-44b1-9a19-b5e46b86ac8e tempest-GroupSnapshotsTest-902971916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a7c80ce-4793-4cc8-a400-cb718f5ffa7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:56:45 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-83eb2399-a48a-44b1-9a19-b5e46b86ac8e tempest-GroupSnapshotsTest-902971916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a7c80ce-4793-4cc8-a400-cb718f5ffa7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:56:45 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-83eb2399-a48a-44b1-9a19-b5e46b86ac8e tempest-GroupSnapshotsTest-902971916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8ab237b-e047-4220-a38c-440cac375c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:56:45 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-83eb2399-a48a-44b1-9a19-b5e46b86ac8e tempest-GroupSnapshotsTest-902971916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8ab237b-e047-4220-a38c-440cac375c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e788e54-eb58-4c5e-a6c3-8d45d3028df3', 'volume_name': 'volume-8e788e54-eb58-4c5e-a6c3-8d45d3028df3', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:56:45 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-83eb2399-a48a-44b1-9a19-b5e46b86ac8e tempest-GroupSnapshotsTest-902971916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55399da1-95a2-444e-8438-05a3e9201bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:56:45 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-83eb2399-a48a-44b1-9a19-b5e46b86ac8e tempest-GroupSnapshotsTest-902971916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55399da1-95a2-444e-8438-05a3e9201bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:56:45 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-83eb2399-a48a-44b1-9a19-b5e46b86ac8e tempest-GroupSnapshotsTest-902971916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aee8f50c-232f-46f8-a928-15d08baf2c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:56:45 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-83eb2399-a48a-44b1-9a19-b5e46b86ac8e tempest-GroupSnapshotsTest-902971916 None] Volume 8e788e54-eb58-4c5e-a6c3-8d45d3028df3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e788e54-eb58-4c5e-a6c3-8d45d3028df3', 'volume_size': 1}
Jun 15 15:56:45 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-83eb2399-a48a-44b1-9a19-b5e46b86ac8e tempest-GroupSnapshotsTest-902971916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:56:45 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-83eb2399-a48a-44b1-9a19-b5e46b86ac8e tempest-GroupSnapshotsTest-902971916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:56:45 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-83eb2399-a48a-44b1-9a19-b5e46b86ac8e tempest-GroupSnapshotsTest-902971916 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=d10498dd-8ba1-4e83-ab28-fea9a6281b6b,created_at=2026-06-15T13:56:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-183850813',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d10498dd-8ba1-4e83-ab28-fea9a6281b6b,host='devstack@QuobyteHD#QuobyteHD',id=8e788e54-eb58-4c5e-a6c3-8d45d3028df3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aecd64c182d14ad0a5778916a7fba8bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:56:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:56:45Z,use_quota=True,user_id='ea09cc6a961546b2be44de9f24f3dbd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8548fa5b-de87-4223-a4f7-c08ede4ff49b),volume_type_id=8548fa5b-de87-4223-a4f7-c08ede4ff49b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 15:56:45 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-83eb2399-a48a-44b1-9a19-b5e46b86ac8e tempest-GroupSnapshotsTest-902971916 None] Creating volume 8e788e54-eb58-4c5e-a6c3-8d45d3028df3 {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 15:56:45 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-83eb2399-a48a-44b1-9a19-b5e46b86ac8e tempest-GroupSnapshotsTest-902971916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:56:45 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-83eb2399-a48a-44b1-9a19-b5e46b86ac8e tempest-GroupSnapshotsTest-902971916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:56:45 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-83eb2399-a48a-44b1-9a19-b5e46b86ac8e tempest-GroupSnapshotsTest-902971916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:56:45 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-83eb2399-a48a-44b1-9a19-b5e46b86ac8e tempest-GroupSnapshotsTest-902971916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:56:45 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-83eb2399-a48a-44b1-9a19-b5e46b86ac8e tempest-GroupSnapshotsTest-902971916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:56:45 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-83eb2399-a48a-44b1-9a19-b5e46b86ac8e tempest-GroupSnapshotsTest-902971916 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 15:56:45 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-83eb2399-a48a-44b1-9a19-b5e46b86ac8e tempest-GroupSnapshotsTest-902971916 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 15:56:45 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-83eb2399-a48a-44b1-9a19-b5e46b86ac8e tempest-GroupSnapshotsTest-902971916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8e788e54-eb58-4c5e-a6c3-8d45d3028df3 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:56:45 devstack sudo[101811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8e788e54-eb58-4c5e-a6c3-8d45d3028df3 1073741824
Jun 15 15:56:45 devstack sudo[101811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:56:46 devstack sudo[101811]: pam_unix(sudo:session): session closed for user root
Jun 15 15:56:46 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-83eb2399-a48a-44b1-9a19-b5e46b86ac8e tempest-GroupSnapshotsTest-902971916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8e788e54-eb58-4c5e-a6c3-8d45d3028df3 1073741824" returned: 0 in 0.824s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:56:46 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-83eb2399-a48a-44b1-9a19-b5e46b86ac8e tempest-GroupSnapshotsTest-902971916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8e788e54-eb58-4c5e-a6c3-8d45d3028df3 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:56:46 devstack sudo[101817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8e788e54-eb58-4c5e-a6c3-8d45d3028df3
Jun 15 15:56:46 devstack sudo[101817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:56:46 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4ba0ada-d571-41f0-813a-c73946337821 tempest-VolumesListAdminTestJSON-61835266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 15:56:46 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-b4ba0ada-d571-41f0-813a-c73946337821 tempest-VolumesListAdminTestJSON-61835266 None] Flow 'volume_create_manager' (004a890b-b02d-4f96-ad9f-1fc3b49452c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:56:46 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-b4ba0ada-d571-41f0-813a-c73946337821 tempest-VolumesListAdminTestJSON-61835266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42567593-5b3a-4adb-98e6-c2da733b71f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:56:46 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-b4ba0ada-d571-41f0-813a-c73946337821 tempest-VolumesListAdminTestJSON-61835266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42567593-5b3a-4adb-98e6-c2da733b71f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:56:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1515603807',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e909b37f-5a90-40a2-8249-db9a81c6ec2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cccb9494d6fc444eb6b56c8318ea7138',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:56:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:56:47Z,use_quota=True,user_id='d70b3a9db75641d6b181be802a554573',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:56:46 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-b4ba0ada-d571-41f0-813a-c73946337821 tempest-VolumesListAdminTestJSON-61835266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27cb89ac-4447-4338-952f-3d7e58ac64ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:56:46 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-b4ba0ada-d571-41f0-813a-c73946337821 tempest-VolumesListAdminTestJSON-61835266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27cb89ac-4447-4338-952f-3d7e58ac64ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:56:46 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-b4ba0ada-d571-41f0-813a-c73946337821 tempest-VolumesListAdminTestJSON-61835266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cbfdc12-e165-47ad-9a20-99d341d30d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:56:46 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-b4ba0ada-d571-41f0-813a-c73946337821 tempest-VolumesListAdminTestJSON-61835266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cbfdc12-e165-47ad-9a20-99d341d30d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e909b37f-5a90-40a2-8249-db9a81c6ec2c', 'volume_name': 'volume-e909b37f-5a90-40a2-8249-db9a81c6ec2c', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:56:46 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-b4ba0ada-d571-41f0-813a-c73946337821 tempest-VolumesListAdminTestJSON-61835266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9f4a625-c82c-4d44-a234-8da69a372a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:56:46 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-b4ba0ada-d571-41f0-813a-c73946337821 tempest-VolumesListAdminTestJSON-61835266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9f4a625-c82c-4d44-a234-8da69a372a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:56:46 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-b4ba0ada-d571-41f0-813a-c73946337821 tempest-VolumesListAdminTestJSON-61835266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c62af87a-afad-4760-b048-3111e9f6fe04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:56:46 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-b4ba0ada-d571-41f0-813a-c73946337821 tempest-VolumesListAdminTestJSON-61835266 None] Volume e909b37f-5a90-40a2-8249-db9a81c6ec2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e909b37f-5a90-40a2-8249-db9a81c6ec2c', 'volume_size': 1}
Jun 15 15:56:46 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-b4ba0ada-d571-41f0-813a-c73946337821 tempest-VolumesListAdminTestJSON-61835266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:56:46 devstack cinder-volume[91863]: INFO cinder.volume.manager [req-35772a7d-1407-43f3-adad-2f1f8c89713b req-eac4d1ff-5f7e-479b-92a5-44b09ab2e7de tempest-AttachVolumeTestJSON-1078769545 None] Terminate volume connection completed successfully.
Jun 15 15:56:46 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [req-35772a7d-1407-43f3-adad-2f1f8c89713b req-eac4d1ff-5f7e-479b-92a5-44b09ab2e7de tempest-AttachVolumeTestJSON-1078769545 None] Deleting attachment 826868bc-c920-4ccb-b1f2-2cab7786c535. {{(pid=91863) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 15 15:56:47 devstack sudo[101817]: pam_unix(sudo:session): session closed for user root
Jun 15 15:56:47 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-83eb2399-a48a-44b1-9a19-b5e46b86ac8e tempest-GroupSnapshotsTest-902971916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8e788e54-eb58-4c5e-a6c3-8d45d3028df3" returned: 0 in 0.673s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:56:47 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-83eb2399-a48a-44b1-9a19-b5e46b86ac8e tempest-GroupSnapshotsTest-902971916 None] <== create_volume: return (1541ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 15:56:47 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-83eb2399-a48a-44b1-9a19-b5e46b86ac8e tempest-GroupSnapshotsTest-902971916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.544s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:56:47 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-b4ba0ada-d571-41f0-813a-c73946337821 tempest-VolumesListAdminTestJSON-61835266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.305s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:56:47 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-b4ba0ada-d571-41f0-813a-c73946337821 tempest-VolumesListAdminTestJSON-61835266 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:56:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1515603807',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e909b37f-5a90-40a2-8249-db9a81c6ec2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cccb9494d6fc444eb6b56c8318ea7138',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:56:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:56:47Z,use_quota=True,user_id='d70b3a9db75641d6b181be802a554573',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 15:56:47 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-b4ba0ada-d571-41f0-813a-c73946337821 tempest-VolumesListAdminTestJSON-61835266 None] Creating volume e909b37f-5a90-40a2-8249-db9a81c6ec2c {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 15:56:47 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-b4ba0ada-d571-41f0-813a-c73946337821 tempest-VolumesListAdminTestJSON-61835266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:56:47 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-b4ba0ada-d571-41f0-813a-c73946337821 tempest-VolumesListAdminTestJSON-61835266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:56:47 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-b4ba0ada-d571-41f0-813a-c73946337821 tempest-VolumesListAdminTestJSON-61835266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:56:47 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-b4ba0ada-d571-41f0-813a-c73946337821 tempest-VolumesListAdminTestJSON-61835266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:56:47 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-b4ba0ada-d571-41f0-813a-c73946337821 tempest-VolumesListAdminTestJSON-61835266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:56:47 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-b4ba0ada-d571-41f0-813a-c73946337821 tempest-VolumesListAdminTestJSON-61835266 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 15:56:47 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-b4ba0ada-d571-41f0-813a-c73946337821 tempest-VolumesListAdminTestJSON-61835266 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 15:56:47 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-b4ba0ada-d571-41f0-813a-c73946337821 tempest-VolumesListAdminTestJSON-61835266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e909b37f-5a90-40a2-8249-db9a81c6ec2c 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:56:47 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-83eb2399-a48a-44b1-9a19-b5e46b86ac8e tempest-GroupSnapshotsTest-902971916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aee8f50c-232f-46f8-a928-15d08baf2c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e788e54-eb58-4c5e-a6c3-8d45d3028df3', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:56:47 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-83eb2399-a48a-44b1-9a19-b5e46b86ac8e tempest-GroupSnapshotsTest-902971916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38855aad-b73b-4d0f-856e-8493b80a2852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:56:47 devstack sudo[101823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e909b37f-5a90-40a2-8249-db9a81c6ec2c 1073741824
Jun 15 15:56:47 devstack sudo[101823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:56:47 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-83eb2399-a48a-44b1-9a19-b5e46b86ac8e tempest-GroupSnapshotsTest-902971916 None] Volume volume-8e788e54-eb58-4c5e-a6c3-8d45d3028df3 (8e788e54-eb58-4c5e-a6c3-8d45d3028df3): created successfully
Jun 15 15:56:47 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-83eb2399-a48a-44b1-9a19-b5e46b86ac8e tempest-GroupSnapshotsTest-902971916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38855aad-b73b-4d0f-856e-8493b80a2852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:56:47 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-83eb2399-a48a-44b1-9a19-b5e46b86ac8e tempest-GroupSnapshotsTest-902971916 None] Flow 'volume_create_manager' (38fdff6f-36bd-4b74-bab6-346b91c27bd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:56:47 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-83eb2399-a48a-44b1-9a19-b5e46b86ac8e tempest-GroupSnapshotsTest-902971916 None] Created volume successfully.
Jun 15 15:56:47 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-693aa95c-4e31-4148-82c6-65ea29c70857 tempest-GroupSnapshotsTest-902971916 None] GroupSnapshot 1546bbbd-5d6b-4d1b-b5af-e8fd8c10ab21: creating.
Jun 15 15:56:47 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-693aa95c-4e31-4148-82c6-65ea29c70857 tempest-GroupSnapshotsTest-902971916 None] Group snapshot 1546bbbd-5d6b-4d1b-b5af-e8fd8c10ab21: creating. {{(pid=91863) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jun 15 15:56:48 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-693aa95c-4e31-4148-82c6-65ea29c70857 tempest-GroupSnapshotsTest-902971916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:56:48 devstack sudo[101823]: pam_unix(sudo:session): session closed for user root
Jun 15 15:56:48 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-b4ba0ada-d571-41f0-813a-c73946337821 tempest-VolumesListAdminTestJSON-61835266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e909b37f-5a90-40a2-8249-db9a81c6ec2c 1073741824" returned: 0 in 0.908s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:56:48 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-b4ba0ada-d571-41f0-813a-c73946337821 tempest-VolumesListAdminTestJSON-61835266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e909b37f-5a90-40a2-8249-db9a81c6ec2c {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:56:48 devstack sudo[101829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e909b37f-5a90-40a2-8249-db9a81c6ec2c
Jun 15 15:56:48 devstack sudo[101829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:56:48 devstack sudo[101829]: pam_unix(sudo:session): session closed for user root
Jun 15 15:56:48 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-b4ba0ada-d571-41f0-813a-c73946337821 tempest-VolumesListAdminTestJSON-61835266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e909b37f-5a90-40a2-8249-db9a81c6ec2c" returned: 0 in 0.595s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:56:48 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-b4ba0ada-d571-41f0-813a-c73946337821 tempest-VolumesListAdminTestJSON-61835266 None] <== create_volume: return (1541ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 15:56:48 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-b4ba0ada-d571-41f0-813a-c73946337821 tempest-VolumesListAdminTestJSON-61835266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.543s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:56:48 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-693aa95c-4e31-4148-82c6-65ea29c70857 tempest-GroupSnapshotsTest-902971916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.633s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:56:48 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-693aa95c-4e31-4148-82c6-65ea29c70857 tempest-GroupSnapshotsTest-902971916 None] Creating offline snapshot 289bea71-ccee-4d00-9281-42e7c10645ed of volume 8e788e54-eb58-4c5e-a6c3-8d45d3028df3 {{(pid=91863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 15 15:56:48 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc4dec73-33e6-4e5a-a7f8-79565057efbe]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:56:48 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-693aa95c-4e31-4148-82c6-65ea29c70857 tempest-GroupSnapshotsTest-902971916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8e788e54-eb58-4c5e-a6c3-8d45d3028df3 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:56:48 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-b4ba0ada-d571-41f0-813a-c73946337821 tempest-VolumesListAdminTestJSON-61835266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c62af87a-afad-4760-b048-3111e9f6fe04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e909b37f-5a90-40a2-8249-db9a81c6ec2c', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:56:48 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-b4ba0ada-d571-41f0-813a-c73946337821 tempest-VolumesListAdminTestJSON-61835266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdfa6f16-e84f-4c8a-a2e4-8e81c63d3b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:56:48 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-b4ba0ada-d571-41f0-813a-c73946337821 tempest-VolumesListAdminTestJSON-61835266 None] Volume volume-e909b37f-5a90-40a2-8249-db9a81c6ec2c (e909b37f-5a90-40a2-8249-db9a81c6ec2c): created successfully
Jun 15 15:56:48 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-b4ba0ada-d571-41f0-813a-c73946337821 tempest-VolumesListAdminTestJSON-61835266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdfa6f16-e84f-4c8a-a2e4-8e81c63d3b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:56:48 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-b4ba0ada-d571-41f0-813a-c73946337821 tempest-VolumesListAdminTestJSON-61835266 None] Flow 'volume_create_manager' (004a890b-b02d-4f96-ad9f-1fc3b49452c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:56:48 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-b4ba0ada-d571-41f0-813a-c73946337821 tempest-VolumesListAdminTestJSON-61835266 None] Created volume successfully.
Jun 15 15:56:48 devstack sudo[101833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8e788e54-eb58-4c5e-a6c3-8d45d3028df3
Jun 15 15:56:48 devstack sudo[101833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:56:49 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d1b5ec6-44a7-4fa9-8492-ab7e483046c2 tempest-VolumesListAdminTestJSON-61835266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 15:56:49 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-3d1b5ec6-44a7-4fa9-8492-ab7e483046c2 tempest-VolumesListAdminTestJSON-61835266 None] Flow 'volume_create_manager' (3d9dd3f3-b0d6-42c5-b0b1-832a9c015507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:56:49 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-3d1b5ec6-44a7-4fa9-8492-ab7e483046c2 tempest-VolumesListAdminTestJSON-61835266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0756171b-e07c-497c-aee2-49da46148fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:56:49 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-3d1b5ec6-44a7-4fa9-8492-ab7e483046c2 tempest-VolumesListAdminTestJSON-61835266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0756171b-e07c-497c-aee2-49da46148fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:56:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2067969304',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=360318f5-5141-499c-a171-89523e4b160e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cccb9494d6fc444eb6b56c8318ea7138',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:56:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:56:49Z,use_quota=True,user_id='d70b3a9db75641d6b181be802a554573',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:56:49 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-3d1b5ec6-44a7-4fa9-8492-ab7e483046c2 tempest-VolumesListAdminTestJSON-61835266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38495aba-a07b-49e9-bb16-58172a15e379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:56:49 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-3d1b5ec6-44a7-4fa9-8492-ab7e483046c2 tempest-VolumesListAdminTestJSON-61835266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38495aba-a07b-49e9-bb16-58172a15e379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:56:49 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-3d1b5ec6-44a7-4fa9-8492-ab7e483046c2 tempest-VolumesListAdminTestJSON-61835266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0639bddd-adea-4ce6-8153-11dc50e92786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:56:49 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-3d1b5ec6-44a7-4fa9-8492-ab7e483046c2 tempest-VolumesListAdminTestJSON-61835266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0639bddd-adea-4ce6-8153-11dc50e92786) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '360318f5-5141-499c-a171-89523e4b160e', 'volume_name': 'volume-360318f5-5141-499c-a171-89523e4b160e', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:56:49 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-3d1b5ec6-44a7-4fa9-8492-ab7e483046c2 tempest-VolumesListAdminTestJSON-61835266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (150369fa-abcd-4f15-9d29-ef81e382752c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:56:49 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-3d1b5ec6-44a7-4fa9-8492-ab7e483046c2 tempest-VolumesListAdminTestJSON-61835266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (150369fa-abcd-4f15-9d29-ef81e382752c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:56:49 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-3d1b5ec6-44a7-4fa9-8492-ab7e483046c2 tempest-VolumesListAdminTestJSON-61835266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb50856f-788a-4ce1-a630-615daf6dff0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:56:49 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-3d1b5ec6-44a7-4fa9-8492-ab7e483046c2 tempest-VolumesListAdminTestJSON-61835266 None] Volume 360318f5-5141-499c-a171-89523e4b160e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-360318f5-5141-499c-a171-89523e4b160e', 'volume_size': 1}
Jun 15 15:56:49 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-3d1b5ec6-44a7-4fa9-8492-ab7e483046c2 tempest-VolumesListAdminTestJSON-61835266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:56:49 devstack sudo[101833]: pam_unix(sudo:session): session closed for user root
Jun 15 15:56:49 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-693aa95c-4e31-4148-82c6-65ea29c70857 tempest-GroupSnapshotsTest-902971916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8e788e54-eb58-4c5e-a6c3-8d45d3028df3" returned: 0 in 0.808s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:56:49 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-693aa95c-4e31-4148-82c6-65ea29c70857 tempest-GroupSnapshotsTest-902971916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8e788e54-eb58-4c5e-a6c3-8d45d3028df3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8e788e54-eb58-4c5e-a6c3-8d45d3028df3.289bea71-ccee-4d00-9281-42e7c10645ed 1G {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:56:49 devstack sudo[101845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8e788e54-eb58-4c5e-a6c3-8d45d3028df3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8e788e54-eb58-4c5e-a6c3-8d45d3028df3.289bea71-ccee-4d00-9281-42e7c10645ed 1G
Jun 15 15:56:49 devstack sudo[101845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:56:50 devstack sudo[101845]: pam_unix(sudo:session): session closed for user root
Jun 15 15:56:50 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-693aa95c-4e31-4148-82c6-65ea29c70857 tempest-GroupSnapshotsTest-902971916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8e788e54-eb58-4c5e-a6c3-8d45d3028df3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8e788e54-eb58-4c5e-a6c3-8d45d3028df3.289bea71-ccee-4d00-9281-42e7c10645ed 1G" returned: 0 in 0.853s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:56:50 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-693aa95c-4e31-4148-82c6-65ea29c70857 tempest-GroupSnapshotsTest-902971916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e788e54-eb58-4c5e-a6c3-8d45d3028df3 -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8e788e54-eb58-4c5e-a6c3-8d45d3028df3.289bea71-ccee-4d00-9281-42e7c10645ed {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:56:50 devstack sudo[101885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e788e54-eb58-4c5e-a6c3-8d45d3028df3 -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8e788e54-eb58-4c5e-a6c3-8d45d3028df3.289bea71-ccee-4d00-9281-42e7c10645ed
Jun 15 15:56:50 devstack sudo[101885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:56:50 devstack sudo[101885]: pam_unix(sudo:session): session closed for user root
Jun 15 15:56:50 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-693aa95c-4e31-4148-82c6-65ea29c70857 tempest-GroupSnapshotsTest-902971916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e788e54-eb58-4c5e-a6c3-8d45d3028df3 -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8e788e54-eb58-4c5e-a6c3-8d45d3028df3.289bea71-ccee-4d00-9281-42e7c10645ed" returned: 0 in 0.640s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:56:50 devstack cinder-volume[91863]: WARNING cinder.volume.drivers.remotefs [None req-693aa95c-4e31-4148-82c6-65ea29c70857 tempest-GroupSnapshotsTest-902971916 None] /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8e788e54-eb58-4c5e-a6c3-8d45d3028df3.289bea71-ccee-4d00-9281-42e7c10645ed is being set with open permissions: ugo+rw: NotImplementedError
Jun 15 15:56:50 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-693aa95c-4e31-4148-82c6-65ea29c70857 tempest-GroupSnapshotsTest-902971916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8e788e54-eb58-4c5e-a6c3-8d45d3028df3.289bea71-ccee-4d00-9281-42e7c10645ed {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:56:51 devstack sudo[101891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8e788e54-eb58-4c5e-a6c3-8d45d3028df3.289bea71-ccee-4d00-9281-42e7c10645ed
Jun 15 15:56:51 devstack sudo[101891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:56:51 devstack sudo[101891]: pam_unix(sudo:session): session closed for user root
Jun 15 15:56:51 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-693aa95c-4e31-4148-82c6-65ea29c70857 tempest-GroupSnapshotsTest-902971916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8e788e54-eb58-4c5e-a6c3-8d45d3028df3.289bea71-ccee-4d00-9281-42e7c10645ed" returned: 0 in 0.608s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:56:51 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-693aa95c-4e31-4148-82c6-65ea29c70857 tempest-GroupSnapshotsTest-902971916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8e788e54-eb58-4c5e-a6c3-8d45d3028df3.info {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:56:51 devstack sudo[101896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8e788e54-eb58-4c5e-a6c3-8d45d3028df3.info
Jun 15 15:56:51 devstack sudo[101896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:56:52 devstack sudo[101896]: pam_unix(sudo:session): session closed for user root
Jun 15 15:56:52 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-693aa95c-4e31-4148-82c6-65ea29c70857 tempest-GroupSnapshotsTest-902971916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8e788e54-eb58-4c5e-a6c3-8d45d3028df3.info" returned: 0 in 0.632s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:56:52 devstack cinder-volume[91863]: WARNING cinder.volume.drivers.remotefs [None req-693aa95c-4e31-4148-82c6-65ea29c70857 tempest-GroupSnapshotsTest-902971916 None] /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8e788e54-eb58-4c5e-a6c3-8d45d3028df3.info is being set with open permissions: ugo+rw: NotImplementedError
Jun 15 15:56:52 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-693aa95c-4e31-4148-82c6-65ea29c70857 tempest-GroupSnapshotsTest-902971916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8e788e54-eb58-4c5e-a6c3-8d45d3028df3.info {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:56:52 devstack sudo[101899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8e788e54-eb58-4c5e-a6c3-8d45d3028df3.info
Jun 15 15:56:52 devstack sudo[101899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:56:52 devstack sudo[101899]: pam_unix(sudo:session): session closed for user root
Jun 15 15:56:52 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-693aa95c-4e31-4148-82c6-65ea29c70857 tempest-GroupSnapshotsTest-902971916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8e788e54-eb58-4c5e-a6c3-8d45d3028df3.info" returned: 0 in 0.637s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:56:52 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-693aa95c-4e31-4148-82c6-65ea29c70857 tempest-GroupSnapshotsTest-902971916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.262s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:56:52 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-3d1b5ec6-44a7-4fa9-8492-ab7e483046c2 tempest-VolumesListAdminTestJSON-61835266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.463s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:56:52 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-3d1b5ec6-44a7-4fa9-8492-ab7e483046c2 tempest-VolumesListAdminTestJSON-61835266 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:56:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2067969304',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=360318f5-5141-499c-a171-89523e4b160e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cccb9494d6fc444eb6b56c8318ea7138',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:56:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:56:49Z,use_quota=True,user_id='d70b3a9db75641d6b181be802a554573',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 15:56:52 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-3d1b5ec6-44a7-4fa9-8492-ab7e483046c2 tempest-VolumesListAdminTestJSON-61835266 None] Creating volume 360318f5-5141-499c-a171-89523e4b160e {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 15:56:52 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-3d1b5ec6-44a7-4fa9-8492-ab7e483046c2 tempest-VolumesListAdminTestJSON-61835266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:56:52 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-3d1b5ec6-44a7-4fa9-8492-ab7e483046c2 tempest-VolumesListAdminTestJSON-61835266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:56:52 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-3d1b5ec6-44a7-4fa9-8492-ab7e483046c2 tempest-VolumesListAdminTestJSON-61835266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:56:52 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-3d1b5ec6-44a7-4fa9-8492-ab7e483046c2 tempest-VolumesListAdminTestJSON-61835266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:56:52 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-3d1b5ec6-44a7-4fa9-8492-ab7e483046c2 tempest-VolumesListAdminTestJSON-61835266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:56:52 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-3d1b5ec6-44a7-4fa9-8492-ab7e483046c2 tempest-VolumesListAdminTestJSON-61835266 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 15:56:52 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-3d1b5ec6-44a7-4fa9-8492-ab7e483046c2 tempest-VolumesListAdminTestJSON-61835266 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 15:56:52 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3d1b5ec6-44a7-4fa9-8492-ab7e483046c2 tempest-VolumesListAdminTestJSON-61835266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-360318f5-5141-499c-a171-89523e4b160e 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:56:52 devstack cinder-volume[91863]: DEBUG dbcounter [-] [91863] Writing DB stats cinder:SELECT=118,cinder:INSERT=34,cinder:UPDATE=143,cinder:DELETE=4 {{(pid=91863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 15:56:52 devstack sudo[101902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-360318f5-5141-499c-a171-89523e4b160e 1073741824
Jun 15 15:56:52 devstack sudo[101902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:56:52 devstack cinder-volume[91863]: DEBUG dbcounter [-] [91863] Writing DB stats cinder:SELECT=134,cinder:INSERT=27,cinder:UPDATE=121,cinder:DELETE=6 {{(pid=91863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 15:56:53 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-693aa95c-4e31-4148-82c6-65ea29c70857 tempest-GroupSnapshotsTest-902971916 None] group_snapshot 1546bbbd-5d6b-4d1b-b5af-e8fd8c10ab21: created successfully
Jun 15 15:56:53 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-2b8b5458-9129-4fb5-8351-7ac41ab9d3de tempest-GroupSnapshotsTest-902971916 None] group_snapshot 1546bbbd-5d6b-4d1b-b5af-e8fd8c10ab21: deleting
Jun 15 15:56:53 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-2b8b5458-9129-4fb5-8351-7ac41ab9d3de tempest-GroupSnapshotsTest-902971916 None] group_snapshot 1546bbbd-5d6b-4d1b-b5af-e8fd8c10ab21: deleting {{(pid=91863) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jun 15 15:56:53 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-2b8b5458-9129-4fb5-8351-7ac41ab9d3de tempest-GroupSnapshotsTest-902971916 None] Acquiring lock "cinder-quobyte-8e788e54-eb58-4c5e-a6c3-8d45d3028df3" by "delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:56:53 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-2b8b5458-9129-4fb5-8351-7ac41ab9d3de tempest-GroupSnapshotsTest-902971916 None] Lock "cinder-quobyte-8e788e54-eb58-4c5e-a6c3-8d45d3028df3" acquired by "delete_snapshot" :: waited 0.018s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:56:53 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-2b8b5458-9129-4fb5-8351-7ac41ab9d3de tempest-GroupSnapshotsTest-902971916 None] Acquiring lock "cinder-quobyte-289bea71-ccee-4d00-9281-42e7c10645ed" by "_delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:56:53 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-2b8b5458-9129-4fb5-8351-7ac41ab9d3de tempest-GroupSnapshotsTest-902971916 None] Lock "cinder-quobyte-289bea71-ccee-4d00-9281-42e7c10645ed" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:56:53 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-2b8b5458-9129-4fb5-8351-7ac41ab9d3de tempest-GroupSnapshotsTest-902971916 None] Deleting offline snapshot 289bea71-ccee-4d00-9281-42e7c10645ed of volume 8e788e54-eb58-4c5e-a6c3-8d45d3028df3 {{(pid=91863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 15 15:56:53 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-2b8b5458-9129-4fb5-8351-7ac41ab9d3de tempest-GroupSnapshotsTest-902971916 None] snapshot_file for this snap is: volume-8e788e54-eb58-4c5e-a6c3-8d45d3028df3.289bea71-ccee-4d00-9281-42e7c10645ed {{(pid=91863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 15 15:56:53 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e4086b-2c0a-4e3f-a60c-42f1a0835a7d]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:56:53 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-2b8b5458-9129-4fb5-8351-7ac41ab9d3de tempest-GroupSnapshotsTest-902971916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8e788e54-eb58-4c5e-a6c3-8d45d3028df3.289bea71-ccee-4d00-9281-42e7c10645ed {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:56:53 devstack sudo[101907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8e788e54-eb58-4c5e-a6c3-8d45d3028df3.289bea71-ccee-4d00-9281-42e7c10645ed
Jun 15 15:56:53 devstack sudo[101907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:56:53 devstack sudo[101902]: pam_unix(sudo:session): session closed for user root
Jun 15 15:56:53 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3d1b5ec6-44a7-4fa9-8492-ab7e483046c2 tempest-VolumesListAdminTestJSON-61835266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-360318f5-5141-499c-a171-89523e4b160e 1073741824" returned: 0 in 0.925s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:56:53 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3d1b5ec6-44a7-4fa9-8492-ab7e483046c2 tempest-VolumesListAdminTestJSON-61835266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-360318f5-5141-499c-a171-89523e4b160e {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:56:53 devstack sudo[101910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-360318f5-5141-499c-a171-89523e4b160e
Jun 15 15:56:53 devstack sudo[101910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:56:54 devstack sudo[101907]: pam_unix(sudo:session): session closed for user root
Jun 15 15:56:54 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-2b8b5458-9129-4fb5-8351-7ac41ab9d3de tempest-GroupSnapshotsTest-902971916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8e788e54-eb58-4c5e-a6c3-8d45d3028df3.289bea71-ccee-4d00-9281-42e7c10645ed" returned: 0 in 0.744s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:56:54 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-2b8b5458-9129-4fb5-8351-7ac41ab9d3de tempest-GroupSnapshotsTest-902971916 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8e788e54-eb58-4c5e-a6c3-8d45d3028df3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 15:56:54 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4bb6e69-be04-4c52-8cc4-3bba0be1c113]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:56:54 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-2b8b5458-9129-4fb5-8351-7ac41ab9d3de tempest-GroupSnapshotsTest-902971916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8e788e54-eb58-4c5e-a6c3-8d45d3028df3 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:56:54 devstack sudo[101910]: pam_unix(sudo:session): session closed for user root
Jun 15 15:56:54 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3d1b5ec6-44a7-4fa9-8492-ab7e483046c2 tempest-VolumesListAdminTestJSON-61835266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-360318f5-5141-499c-a171-89523e4b160e" returned: 0 in 0.602s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:56:54 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-3d1b5ec6-44a7-4fa9-8492-ab7e483046c2 tempest-VolumesListAdminTestJSON-61835266 None] <== create_volume: return (1568ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 15:56:54 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-3d1b5ec6-44a7-4fa9-8492-ab7e483046c2 tempest-VolumesListAdminTestJSON-61835266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.571s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:56:54 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-3d1b5ec6-44a7-4fa9-8492-ab7e483046c2 tempest-VolumesListAdminTestJSON-61835266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb50856f-788a-4ce1-a630-615daf6dff0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-360318f5-5141-499c-a171-89523e4b160e', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:56:54 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-3d1b5ec6-44a7-4fa9-8492-ab7e483046c2 tempest-VolumesListAdminTestJSON-61835266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7698172-ec43-4fc3-97b3-49e235486045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:56:54 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-3d1b5ec6-44a7-4fa9-8492-ab7e483046c2 tempest-VolumesListAdminTestJSON-61835266 None] Volume volume-360318f5-5141-499c-a171-89523e4b160e (360318f5-5141-499c-a171-89523e4b160e): created successfully
Jun 15 15:56:54 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-3d1b5ec6-44a7-4fa9-8492-ab7e483046c2 tempest-VolumesListAdminTestJSON-61835266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7698172-ec43-4fc3-97b3-49e235486045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:56:54 devstack sudo[101917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8e788e54-eb58-4c5e-a6c3-8d45d3028df3
Jun 15 15:56:54 devstack sudo[101917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:56:54 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-3d1b5ec6-44a7-4fa9-8492-ab7e483046c2 tempest-VolumesListAdminTestJSON-61835266 None] Flow 'volume_create_manager' (3d9dd3f3-b0d6-42c5-b0b1-832a9c015507) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:56:54 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-3d1b5ec6-44a7-4fa9-8492-ab7e483046c2 tempest-VolumesListAdminTestJSON-61835266 None] Created volume successfully.
Jun 15 15:56:55 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-5111b9c5-c3da-4f77-8e1e-f43b6025249b tempest-VolumesListAdminTestJSON-61835266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 15:56:55 devstack sudo[101917]: pam_unix(sudo:session): session closed for user root
Jun 15 15:56:55 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5111b9c5-c3da-4f77-8e1e-f43b6025249b tempest-VolumesListAdminTestJSON-61835266 None] Flow 'volume_create_manager' (d479705f-1f93-4978-a773-f33f3492e689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:56:55 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5111b9c5-c3da-4f77-8e1e-f43b6025249b tempest-VolumesListAdminTestJSON-61835266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e836ddc-437f-4c02-aa89-4021e97c15c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:56:55 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-2b8b5458-9129-4fb5-8351-7ac41ab9d3de tempest-GroupSnapshotsTest-902971916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8e788e54-eb58-4c5e-a6c3-8d45d3028df3" returned: 0 in 0.743s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:56:55 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-2b8b5458-9129-4fb5-8351-7ac41ab9d3de tempest-GroupSnapshotsTest-902971916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8e788e54-eb58-4c5e-a6c3-8d45d3028df3.289bea71-ccee-4d00-9281-42e7c10645ed {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:56:55 devstack sudo[101922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8e788e54-eb58-4c5e-a6c3-8d45d3028df3.289bea71-ccee-4d00-9281-42e7c10645ed
Jun 15 15:56:55 devstack sudo[101922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:56:55 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5111b9c5-c3da-4f77-8e1e-f43b6025249b tempest-VolumesListAdminTestJSON-61835266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e836ddc-437f-4c02-aa89-4021e97c15c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:56:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1838569291',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3eaa68fd-736a-4da3-9154-9bf655514cfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cccb9494d6fc444eb6b56c8318ea7138',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:56:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:56:55Z,use_quota=True,user_id='d70b3a9db75641d6b181be802a554573',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:56:55 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5111b9c5-c3da-4f77-8e1e-f43b6025249b tempest-VolumesListAdminTestJSON-61835266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37bce5fc-e41f-4914-af3d-be65cc2cbcca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:56:55 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5111b9c5-c3da-4f77-8e1e-f43b6025249b tempest-VolumesListAdminTestJSON-61835266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37bce5fc-e41f-4914-af3d-be65cc2cbcca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:56:55 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5111b9c5-c3da-4f77-8e1e-f43b6025249b tempest-VolumesListAdminTestJSON-61835266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (678f6ec9-7903-42ad-9999-4a355a4591be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:56:55 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5111b9c5-c3da-4f77-8e1e-f43b6025249b tempest-VolumesListAdminTestJSON-61835266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (678f6ec9-7903-42ad-9999-4a355a4591be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3eaa68fd-736a-4da3-9154-9bf655514cfb', 'volume_name': 'volume-3eaa68fd-736a-4da3-9154-9bf655514cfb', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:56:55 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5111b9c5-c3da-4f77-8e1e-f43b6025249b tempest-VolumesListAdminTestJSON-61835266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ae70a31-12da-4249-9c70-17605bdd7880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:56:55 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5111b9c5-c3da-4f77-8e1e-f43b6025249b tempest-VolumesListAdminTestJSON-61835266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ae70a31-12da-4249-9c70-17605bdd7880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:56:55 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5111b9c5-c3da-4f77-8e1e-f43b6025249b tempest-VolumesListAdminTestJSON-61835266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77fc7515-70ad-4349-98d5-7fcdebc22174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:56:55 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-5111b9c5-c3da-4f77-8e1e-f43b6025249b tempest-VolumesListAdminTestJSON-61835266 None] Volume 3eaa68fd-736a-4da3-9154-9bf655514cfb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3eaa68fd-736a-4da3-9154-9bf655514cfb', 'volume_size': 1}
Jun 15 15:56:55 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-5111b9c5-c3da-4f77-8e1e-f43b6025249b tempest-VolumesListAdminTestJSON-61835266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:56:55 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-5111b9c5-c3da-4f77-8e1e-f43b6025249b tempest-VolumesListAdminTestJSON-61835266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:56:55 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-5111b9c5-c3da-4f77-8e1e-f43b6025249b tempest-VolumesListAdminTestJSON-61835266 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:56:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1838569291',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3eaa68fd-736a-4da3-9154-9bf655514cfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cccb9494d6fc444eb6b56c8318ea7138',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:56:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:56:55Z,use_quota=True,user_id='d70b3a9db75641d6b181be802a554573',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 15:56:55 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-5111b9c5-c3da-4f77-8e1e-f43b6025249b tempest-VolumesListAdminTestJSON-61835266 None] Creating volume 3eaa68fd-736a-4da3-9154-9bf655514cfb {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 15:56:55 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-5111b9c5-c3da-4f77-8e1e-f43b6025249b tempest-VolumesListAdminTestJSON-61835266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:56:55 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-5111b9c5-c3da-4f77-8e1e-f43b6025249b tempest-VolumesListAdminTestJSON-61835266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:56:55 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-5111b9c5-c3da-4f77-8e1e-f43b6025249b tempest-VolumesListAdminTestJSON-61835266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:56:55 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-5111b9c5-c3da-4f77-8e1e-f43b6025249b tempest-VolumesListAdminTestJSON-61835266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:56:55 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-5111b9c5-c3da-4f77-8e1e-f43b6025249b tempest-VolumesListAdminTestJSON-61835266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:56:55 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-5111b9c5-c3da-4f77-8e1e-f43b6025249b tempest-VolumesListAdminTestJSON-61835266 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 15:56:55 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-5111b9c5-c3da-4f77-8e1e-f43b6025249b tempest-VolumesListAdminTestJSON-61835266 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 15:56:55 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5111b9c5-c3da-4f77-8e1e-f43b6025249b tempest-VolumesListAdminTestJSON-61835266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3eaa68fd-736a-4da3-9154-9bf655514cfb 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:56:55 devstack sudo[101924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3eaa68fd-736a-4da3-9154-9bf655514cfb 1073741824
Jun 15 15:56:55 devstack sudo[101924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:56:55 devstack sudo[101922]: pam_unix(sudo:session): session closed for user root
Jun 15 15:56:55 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-2b8b5458-9129-4fb5-8351-7ac41ab9d3de tempest-GroupSnapshotsTest-902971916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8e788e54-eb58-4c5e-a6c3-8d45d3028df3.289bea71-ccee-4d00-9281-42e7c10645ed" returned: 0 in 0.711s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:56:55 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-2b8b5458-9129-4fb5-8351-7ac41ab9d3de tempest-GroupSnapshotsTest-902971916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8e788e54-eb58-4c5e-a6c3-8d45d3028df3.289bea71-ccee-4d00-9281-42e7c10645ed {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:56:55 devstack sudo[101933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8e788e54-eb58-4c5e-a6c3-8d45d3028df3.289bea71-ccee-4d00-9281-42e7c10645ed
Jun 15 15:56:55 devstack sudo[101933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:56:56 devstack sudo[101924]: pam_unix(sudo:session): session closed for user root
Jun 15 15:56:56 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5111b9c5-c3da-4f77-8e1e-f43b6025249b tempest-VolumesListAdminTestJSON-61835266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3eaa68fd-736a-4da3-9154-9bf655514cfb 1073741824" returned: 0 in 0.813s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:56:56 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5111b9c5-c3da-4f77-8e1e-f43b6025249b tempest-VolumesListAdminTestJSON-61835266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3eaa68fd-736a-4da3-9154-9bf655514cfb {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:56:56 devstack sudo[101935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3eaa68fd-736a-4da3-9154-9bf655514cfb
Jun 15 15:56:56 devstack sudo[101935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:56:56 devstack sudo[101933]: pam_unix(sudo:session): session closed for user root
Jun 15 15:56:56 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-2b8b5458-9129-4fb5-8351-7ac41ab9d3de tempest-GroupSnapshotsTest-902971916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8e788e54-eb58-4c5e-a6c3-8d45d3028df3.289bea71-ccee-4d00-9281-42e7c10645ed" returned: 0 in 0.638s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:56:56 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-2b8b5458-9129-4fb5-8351-7ac41ab9d3de tempest-GroupSnapshotsTest-902971916 None] Lock "cinder-quobyte-289bea71-ccee-4d00-9281-42e7c10645ed" released by "_delete_snapshot" :: held 2.965s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:56:56 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-2b8b5458-9129-4fb5-8351-7ac41ab9d3de tempest-GroupSnapshotsTest-902971916 None] Lock "cinder-quobyte-8e788e54-eb58-4c5e-a6c3-8d45d3028df3" released by "delete_snapshot" :: held 2.993s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:56:56 devstack cinder-volume[91863]: WARNING cinder.quota [None req-2b8b5458-9129-4fb5-8351-7ac41ab9d3de tempest-GroupSnapshotsTest-902971916 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1247333485 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1247333485, it is now deprecated. Please use the default quota class for default quota.
Jun 15 15:56:56 devstack cinder-volume[91863]: WARNING cinder.quota [None req-2b8b5458-9129-4fb5-8351-7ac41ab9d3de tempest-GroupSnapshotsTest-902971916 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1247333485 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1247333485, it is now deprecated. Please use the default quota class for default quota.
Jun 15 15:56:56 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-2b8b5458-9129-4fb5-8351-7ac41ab9d3de tempest-GroupSnapshotsTest-902971916 None] Created reservations ['45c45716-60c1-4e0d-b9c1-56ca1512cccb', '3ee8a8d6-b159-45e3-8f99-7fb1b40addfc', 'e9744e2a-f4aa-4ca4-902e-9d752a6b62e5', '9e262f3b-3965-4ed8-8f1a-0ae5cb0b0f98'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:56:56 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-2b8b5458-9129-4fb5-8351-7ac41ab9d3de tempest-GroupSnapshotsTest-902971916 None] group_snapshot 1546bbbd-5d6b-4d1b-b5af-e8fd8c10ab21: deleted successfully
Jun 15 15:56:56 devstack sudo[101935]: pam_unix(sudo:session): session closed for user root
Jun 15 15:56:56 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5111b9c5-c3da-4f77-8e1e-f43b6025249b tempest-VolumesListAdminTestJSON-61835266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3eaa68fd-736a-4da3-9154-9bf655514cfb" returned: 0 in 0.600s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:56:56 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-5111b9c5-c3da-4f77-8e1e-f43b6025249b tempest-VolumesListAdminTestJSON-61835266 None] <== create_volume: return (1451ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 15:56:56 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-5111b9c5-c3da-4f77-8e1e-f43b6025249b tempest-VolumesListAdminTestJSON-61835266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.453s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:56:56 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5111b9c5-c3da-4f77-8e1e-f43b6025249b tempest-VolumesListAdminTestJSON-61835266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77fc7515-70ad-4349-98d5-7fcdebc22174) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3eaa68fd-736a-4da3-9154-9bf655514cfb', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:56:56 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5111b9c5-c3da-4f77-8e1e-f43b6025249b tempest-VolumesListAdminTestJSON-61835266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e357d74f-66c8-406d-97e5-e323216fbddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:56:56 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-5111b9c5-c3da-4f77-8e1e-f43b6025249b tempest-VolumesListAdminTestJSON-61835266 None] Volume volume-3eaa68fd-736a-4da3-9154-9bf655514cfb (3eaa68fd-736a-4da3-9154-9bf655514cfb): created successfully
Jun 15 15:56:56 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5111b9c5-c3da-4f77-8e1e-f43b6025249b tempest-VolumesListAdminTestJSON-61835266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e357d74f-66c8-406d-97e5-e323216fbddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:56:56 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5111b9c5-c3da-4f77-8e1e-f43b6025249b tempest-VolumesListAdminTestJSON-61835266 None] Flow 'volume_create_manager' (d479705f-1f93-4978-a773-f33f3492e689) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:56:56 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-5111b9c5-c3da-4f77-8e1e-f43b6025249b tempest-VolumesListAdminTestJSON-61835266 None] Created volume successfully.
Jun 15 15:56:57 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-22a601c4-5ddb-4353-b4ce-9d74d518e2fc tempest-GroupSnapshotsTest-902971916 None] Acquiring lock "cinder-quobyte-8e788e54-eb58-4c5e-a6c3-8d45d3028df3" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:56:57 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-22a601c4-5ddb-4353-b4ce-9d74d518e2fc tempest-GroupSnapshotsTest-902971916 None] Lock "cinder-quobyte-8e788e54-eb58-4c5e-a6c3-8d45d3028df3" acquired by "delete_volume" :: waited 0.021s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:56:57 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f79c2e82-e027-4877-93f6-1695f77395b7]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:56:57 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-22a601c4-5ddb-4353-b4ce-9d74d518e2fc tempest-GroupSnapshotsTest-902971916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8e788e54-eb58-4c5e-a6c3-8d45d3028df3 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:56:57 devstack sudo[101943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8e788e54-eb58-4c5e-a6c3-8d45d3028df3
Jun 15 15:56:57 devstack sudo[101943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:56:57 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-276948c6-cf3a-4381-a14e-43eb72976b5e tempest-VolumesListAdminTestJSON-460535768 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 15:56:57 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-276948c6-cf3a-4381-a14e-43eb72976b5e tempest-VolumesListAdminTestJSON-460535768 None] Flow 'volume_create_manager' (736a19af-6ffc-4386-a0ec-c5a772b52076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:56:57 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-276948c6-cf3a-4381-a14e-43eb72976b5e tempest-VolumesListAdminTestJSON-460535768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fc39862-0098-45d6-8412-3f48b98f92d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:56:57 devstack sudo[101943]: pam_unix(sudo:session): session closed for user root
Jun 15 15:56:57 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-22a601c4-5ddb-4353-b4ce-9d74d518e2fc tempest-GroupSnapshotsTest-902971916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8e788e54-eb58-4c5e-a6c3-8d45d3028df3" returned: 0 in 0.812s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:56:57 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-22a601c4-5ddb-4353-b4ce-9d74d518e2fc tempest-GroupSnapshotsTest-902971916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8e788e54-eb58-4c5e-a6c3-8d45d3028df3 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:56:57 devstack sudo[101954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8e788e54-eb58-4c5e-a6c3-8d45d3028df3
Jun 15 15:56:57 devstack sudo[101954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:56:57 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-276948c6-cf3a-4381-a14e-43eb72976b5e tempest-VolumesListAdminTestJSON-460535768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fc39862-0098-45d6-8412-3f48b98f92d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:56:58Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f1baa71-cc90-4239-9b51-3196253ce349,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75e34c04f0184a9485bf9dcea7412a1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:56:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:56:58Z,use_quota=True,user_id='13fcd484263a4c79ab1efa9dcf6cddcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:56:57 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-276948c6-cf3a-4381-a14e-43eb72976b5e tempest-VolumesListAdminTestJSON-460535768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (643500d6-8dc1-434d-aea0-d3ba450b0a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:56:57 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-276948c6-cf3a-4381-a14e-43eb72976b5e tempest-VolumesListAdminTestJSON-460535768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (643500d6-8dc1-434d-aea0-d3ba450b0a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:56:57 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-276948c6-cf3a-4381-a14e-43eb72976b5e tempest-VolumesListAdminTestJSON-460535768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fa4b0bd-af06-487a-a70f-9d8dcfe7a6fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:56:57 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-276948c6-cf3a-4381-a14e-43eb72976b5e tempest-VolumesListAdminTestJSON-460535768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fa4b0bd-af06-487a-a70f-9d8dcfe7a6fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f1baa71-cc90-4239-9b51-3196253ce349', 'volume_name': 'volume-5f1baa71-cc90-4239-9b51-3196253ce349', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:56:57 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-276948c6-cf3a-4381-a14e-43eb72976b5e tempest-VolumesListAdminTestJSON-460535768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58c984a7-aeb1-4bc3-ae3c-5737f9337193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:56:57 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-276948c6-cf3a-4381-a14e-43eb72976b5e tempest-VolumesListAdminTestJSON-460535768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58c984a7-aeb1-4bc3-ae3c-5737f9337193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:56:57 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-276948c6-cf3a-4381-a14e-43eb72976b5e tempest-VolumesListAdminTestJSON-460535768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b795c014-6971-4d02-a518-7e804b93cdcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:56:57 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-276948c6-cf3a-4381-a14e-43eb72976b5e tempest-VolumesListAdminTestJSON-460535768 None] Volume 5f1baa71-cc90-4239-9b51-3196253ce349: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f1baa71-cc90-4239-9b51-3196253ce349', 'volume_size': 1}
Jun 15 15:56:57 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-276948c6-cf3a-4381-a14e-43eb72976b5e tempest-VolumesListAdminTestJSON-460535768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:56:57 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-276948c6-cf3a-4381-a14e-43eb72976b5e tempest-VolumesListAdminTestJSON-460535768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:56:57 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-276948c6-cf3a-4381-a14e-43eb72976b5e tempest-VolumesListAdminTestJSON-460535768 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:56:58Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f1baa71-cc90-4239-9b51-3196253ce349,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75e34c04f0184a9485bf9dcea7412a1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:56:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:56:58Z,use_quota=True,user_id='13fcd484263a4c79ab1efa9dcf6cddcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 15:56:57 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-276948c6-cf3a-4381-a14e-43eb72976b5e tempest-VolumesListAdminTestJSON-460535768 None] Creating volume 5f1baa71-cc90-4239-9b51-3196253ce349 {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 15:56:57 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-276948c6-cf3a-4381-a14e-43eb72976b5e tempest-VolumesListAdminTestJSON-460535768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:56:57 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-276948c6-cf3a-4381-a14e-43eb72976b5e tempest-VolumesListAdminTestJSON-460535768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:56:57 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-276948c6-cf3a-4381-a14e-43eb72976b5e tempest-VolumesListAdminTestJSON-460535768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:56:57 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-276948c6-cf3a-4381-a14e-43eb72976b5e tempest-VolumesListAdminTestJSON-460535768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:56:57 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-276948c6-cf3a-4381-a14e-43eb72976b5e tempest-VolumesListAdminTestJSON-460535768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:56:57 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-276948c6-cf3a-4381-a14e-43eb72976b5e tempest-VolumesListAdminTestJSON-460535768 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 15:56:57 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-276948c6-cf3a-4381-a14e-43eb72976b5e tempest-VolumesListAdminTestJSON-460535768 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 15:56:57 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-276948c6-cf3a-4381-a14e-43eb72976b5e tempest-VolumesListAdminTestJSON-460535768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5f1baa71-cc90-4239-9b51-3196253ce349 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:56:58 devstack sudo[101958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5f1baa71-cc90-4239-9b51-3196253ce349 1073741824
Jun 15 15:56:58 devstack sudo[101958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:56:58 devstack sudo[101954]: pam_unix(sudo:session): session closed for user root
Jun 15 15:56:58 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-22a601c4-5ddb-4353-b4ce-9d74d518e2fc tempest-GroupSnapshotsTest-902971916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8e788e54-eb58-4c5e-a6c3-8d45d3028df3" returned: 0 in 0.601s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:56:58 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-22a601c4-5ddb-4353-b4ce-9d74d518e2fc tempest-GroupSnapshotsTest-902971916 None] Lock "cinder-quobyte-8e788e54-eb58-4c5e-a6c3-8d45d3028df3" released by "delete_volume" :: held 1.495s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:56:58 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-22a601c4-5ddb-4353-b4ce-9d74d518e2fc tempest-GroupSnapshotsTest-902971916 None] Created reservations ['ba168d7f-c1ee-4f68-96d8-7bc20187102f'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:56:58 devstack cinder-volume[91863]: WARNING cinder.quota [None req-22a601c4-5ddb-4353-b4ce-9d74d518e2fc tempest-GroupSnapshotsTest-902971916 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1247333485 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1247333485, it is now deprecated. Please use the default quota class for default quota.
Jun 15 15:56:58 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-22a601c4-5ddb-4353-b4ce-9d74d518e2fc tempest-GroupSnapshotsTest-902971916 None] Created reservations ['85aece31-99c2-4a59-bcde-9a65b89df670', '78fcd12e-e303-4084-95d0-ae25ebccf26e', '54b82171-639d-40de-8260-b92026dc228b', 'bf313cb9-2d59-49ac-987d-f09c78aa0e76'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:56:58 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-22a601c4-5ddb-4353-b4ce-9d74d518e2fc tempest-GroupSnapshotsTest-902971916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:56:58 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-22a601c4-5ddb-4353-b4ce-9d74d518e2fc tempest-GroupSnapshotsTest-902971916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:56:58 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-22a601c4-5ddb-4353-b4ce-9d74d518e2fc tempest-GroupSnapshotsTest-902971916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:56:58 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-22a601c4-5ddb-4353-b4ce-9d74d518e2fc tempest-GroupSnapshotsTest-902971916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:56:58 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-22a601c4-5ddb-4353-b4ce-9d74d518e2fc tempest-GroupSnapshotsTest-902971916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:56:58 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-22a601c4-5ddb-4353-b4ce-9d74d518e2fc tempest-GroupSnapshotsTest-902971916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:56:59 devstack sudo[102014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:56:59 devstack sudo[102014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:56:59 devstack sudo[101958]: pam_unix(sudo:session): session closed for user root
Jun 15 15:56:59 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-276948c6-cf3a-4381-a14e-43eb72976b5e tempest-VolumesListAdminTestJSON-460535768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5f1baa71-cc90-4239-9b51-3196253ce349 1073741824" returned: 0 in 1.222s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:56:59 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-276948c6-cf3a-4381-a14e-43eb72976b5e tempest-VolumesListAdminTestJSON-460535768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5f1baa71-cc90-4239-9b51-3196253ce349 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:56:59 devstack sudo[102023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5f1baa71-cc90-4239-9b51-3196253ce349
Jun 15 15:56:59 devstack sudo[102023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:57:00 devstack sudo[102014]: pam_unix(sudo:session): session closed for user root
Jun 15 15:57:00 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-22a601c4-5ddb-4353-b4ce-9d74d518e2fc tempest-GroupSnapshotsTest-902971916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 1.234s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:57:00 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-22a601c4-5ddb-4353-b4ce-9d74d518e2fc tempest-GroupSnapshotsTest-902971916 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:57:00 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-22a601c4-5ddb-4353-b4ce-9d74d518e2fc tempest-GroupSnapshotsTest-902971916 None] Delete group completed successfully.
Jun 15 15:57:00 devstack sudo[102023]: pam_unix(sudo:session): session closed for user root
Jun 15 15:57:00 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-276948c6-cf3a-4381-a14e-43eb72976b5e tempest-VolumesListAdminTestJSON-460535768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5f1baa71-cc90-4239-9b51-3196253ce349" returned: 0 in 1.019s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:57:00 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-276948c6-cf3a-4381-a14e-43eb72976b5e tempest-VolumesListAdminTestJSON-460535768 None] <== create_volume: return (2333ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 15:57:00 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-276948c6-cf3a-4381-a14e-43eb72976b5e tempest-VolumesListAdminTestJSON-460535768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.336s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:57:00 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-276948c6-cf3a-4381-a14e-43eb72976b5e tempest-VolumesListAdminTestJSON-460535768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b795c014-6971-4d02-a518-7e804b93cdcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f1baa71-cc90-4239-9b51-3196253ce349', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:57:00 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-276948c6-cf3a-4381-a14e-43eb72976b5e tempest-VolumesListAdminTestJSON-460535768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33092909-5f2a-4c0e-b5ed-7bd60a79d628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:57:00 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-276948c6-cf3a-4381-a14e-43eb72976b5e tempest-VolumesListAdminTestJSON-460535768 None] Volume volume-5f1baa71-cc90-4239-9b51-3196253ce349 (5f1baa71-cc90-4239-9b51-3196253ce349): created successfully
Jun 15 15:57:00 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-276948c6-cf3a-4381-a14e-43eb72976b5e tempest-VolumesListAdminTestJSON-460535768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33092909-5f2a-4c0e-b5ed-7bd60a79d628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:57:00 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-276948c6-cf3a-4381-a14e-43eb72976b5e tempest-VolumesListAdminTestJSON-460535768 None] Flow 'volume_create_manager' (736a19af-6ffc-4386-a0ec-c5a772b52076) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:57:00 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-276948c6-cf3a-4381-a14e-43eb72976b5e tempest-VolumesListAdminTestJSON-460535768 None] Created volume successfully.
Jun 15 15:57:01 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-a0784052-2dd4-4739-b001-79fb8d342281 tempest-VolumesListAdminTestJSON-460535768 None] Acquiring lock "cinder-5f1baa71-cc90-4239-9b51-3196253ce349-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:57:01 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-a0784052-2dd4-4739-b001-79fb8d342281 tempest-VolumesListAdminTestJSON-460535768 None] Lock "cinder-5f1baa71-cc90-4239-9b51-3196253ce349-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:57:01 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-a0784052-2dd4-4739-b001-79fb8d342281 tempest-VolumesListAdminTestJSON-460535768 None] Acquiring lock "cinder-quobyte-5f1baa71-cc90-4239-9b51-3196253ce349" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:57:01 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-a0784052-2dd4-4739-b001-79fb8d342281 tempest-VolumesListAdminTestJSON-460535768 None] Lock "cinder-quobyte-5f1baa71-cc90-4239-9b51-3196253ce349" acquired by "delete_volume" :: waited 0.022s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:57:01 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[741748a9-e105-4a61-84ec-1a4fcc3931b2]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:57:01 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-a0784052-2dd4-4739-b001-79fb8d342281 tempest-VolumesListAdminTestJSON-460535768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5f1baa71-cc90-4239-9b51-3196253ce349 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:57:01 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-c1380587-f299-4202-a358-44f8e4fafa75 tempest-VolumesListAdminTestJSON-61835266 None] Acquiring lock "cinder-3eaa68fd-736a-4da3-9154-9bf655514cfb-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:57:01 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-c1380587-f299-4202-a358-44f8e4fafa75 tempest-VolumesListAdminTestJSON-61835266 None] Lock "cinder-3eaa68fd-736a-4da3-9154-9bf655514cfb-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:57:01 devstack sudo[102039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5f1baa71-cc90-4239-9b51-3196253ce349
Jun 15 15:57:01 devstack sudo[102039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:57:01 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-c1380587-f299-4202-a358-44f8e4fafa75 tempest-VolumesListAdminTestJSON-61835266 None] Acquiring lock "cinder-quobyte-3eaa68fd-736a-4da3-9154-9bf655514cfb" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:57:01 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-c1380587-f299-4202-a358-44f8e4fafa75 tempest-VolumesListAdminTestJSON-61835266 None] Lock "cinder-quobyte-3eaa68fd-736a-4da3-9154-9bf655514cfb" acquired by "delete_volume" :: waited 0.033s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:57:01 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ab35e00-df7e-4b00-976e-dc51d15adcda]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:57:01 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c1380587-f299-4202-a358-44f8e4fafa75 tempest-VolumesListAdminTestJSON-61835266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3eaa68fd-736a-4da3-9154-9bf655514cfb {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:57:02 devstack sudo[102041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3eaa68fd-736a-4da3-9154-9bf655514cfb
Jun 15 15:57:02 devstack sudo[102041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:57:02 devstack sudo[102039]: pam_unix(sudo:session): session closed for user root
Jun 15 15:57:02 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-a0784052-2dd4-4739-b001-79fb8d342281 tempest-VolumesListAdminTestJSON-460535768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5f1baa71-cc90-4239-9b51-3196253ce349" returned: 0 in 1.382s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:57:02 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-a0784052-2dd4-4739-b001-79fb8d342281 tempest-VolumesListAdminTestJSON-460535768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5f1baa71-cc90-4239-9b51-3196253ce349 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:57:02 devstack sudo[102054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5f1baa71-cc90-4239-9b51-3196253ce349
Jun 15 15:57:02 devstack sudo[102054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:57:03 devstack sudo[102041]: pam_unix(sudo:session): session closed for user root
Jun 15 15:57:03 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c1380587-f299-4202-a358-44f8e4fafa75 tempest-VolumesListAdminTestJSON-61835266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3eaa68fd-736a-4da3-9154-9bf655514cfb" returned: 0 in 1.308s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:57:03 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c1380587-f299-4202-a358-44f8e4fafa75 tempest-VolumesListAdminTestJSON-61835266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3eaa68fd-736a-4da3-9154-9bf655514cfb {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:57:03 devstack sudo[102057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3eaa68fd-736a-4da3-9154-9bf655514cfb
Jun 15 15:57:03 devstack sudo[102057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:57:03 devstack sudo[102054]: pam_unix(sudo:session): session closed for user root
Jun 15 15:57:03 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-a0784052-2dd4-4739-b001-79fb8d342281 tempest-VolumesListAdminTestJSON-460535768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5f1baa71-cc90-4239-9b51-3196253ce349" returned: 0 in 0.890s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:57:03 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-a0784052-2dd4-4739-b001-79fb8d342281 tempest-VolumesListAdminTestJSON-460535768 None] Lock "cinder-quobyte-5f1baa71-cc90-4239-9b51-3196253ce349" released by "delete_volume" :: held 2.323s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:57:03 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-a0784052-2dd4-4739-b001-79fb8d342281 tempest-VolumesListAdminTestJSON-460535768 None] Created reservations ['09119c37-960b-4756-bd31-0f4d420ed74e', 'ef6723b2-55fd-476b-995d-9b147cfc03cf', '4b6ccca2-e920-4afe-96ef-83761f2de4a8', '1071d118-bcf8-44d7-992e-10b0667635a9'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:57:03 devstack sudo[102057]: pam_unix(sudo:session): session closed for user root
Jun 15 15:57:03 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c1380587-f299-4202-a358-44f8e4fafa75 tempest-VolumesListAdminTestJSON-61835266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3eaa68fd-736a-4da3-9154-9bf655514cfb" returned: 0 in 0.787s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:57:04 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-c1380587-f299-4202-a358-44f8e4fafa75 tempest-VolumesListAdminTestJSON-61835266 None] Lock "cinder-quobyte-3eaa68fd-736a-4da3-9154-9bf655514cfb" released by "delete_volume" :: held 2.161s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:57:04 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-a0784052-2dd4-4739-b001-79fb8d342281 tempest-VolumesListAdminTestJSON-460535768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:57:04 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-a0784052-2dd4-4739-b001-79fb8d342281 tempest-VolumesListAdminTestJSON-460535768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:57:04 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-a0784052-2dd4-4739-b001-79fb8d342281 tempest-VolumesListAdminTestJSON-460535768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:57:04 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-a0784052-2dd4-4739-b001-79fb8d342281 tempest-VolumesListAdminTestJSON-460535768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:57:04 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-a0784052-2dd4-4739-b001-79fb8d342281 tempest-VolumesListAdminTestJSON-460535768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:57:04 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-a0784052-2dd4-4739-b001-79fb8d342281 tempest-VolumesListAdminTestJSON-460535768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:57:04 devstack sudo[102062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:57:04 devstack sudo[102062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:57:04 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-c1380587-f299-4202-a358-44f8e4fafa75 tempest-VolumesListAdminTestJSON-61835266 None] Created reservations ['69329d81-d70c-4576-8da1-f5d6f9d083e2', 'bc1da037-e688-4a09-bd88-286b83abffa5', 'fa5b9ae0-cb10-4f5b-a061-1556cb735ae3', '71053f75-b8b0-4fea-b31c-37961358ea8f'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:57:04 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-c1380587-f299-4202-a358-44f8e4fafa75 tempest-VolumesListAdminTestJSON-61835266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:57:04 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-c1380587-f299-4202-a358-44f8e4fafa75 tempest-VolumesListAdminTestJSON-61835266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:57:04 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-c1380587-f299-4202-a358-44f8e4fafa75 tempest-VolumesListAdminTestJSON-61835266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:57:04 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-c1380587-f299-4202-a358-44f8e4fafa75 tempest-VolumesListAdminTestJSON-61835266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:57:04 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-c1380587-f299-4202-a358-44f8e4fafa75 tempest-VolumesListAdminTestJSON-61835266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:57:04 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c1380587-f299-4202-a358-44f8e4fafa75 tempest-VolumesListAdminTestJSON-61835266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:57:04 devstack sudo[102064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:57:04 devstack sudo[102064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:57:04 devstack sudo[102062]: pam_unix(sudo:session): session closed for user root
Jun 15 15:57:04 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-a0784052-2dd4-4739-b001-79fb8d342281 tempest-VolumesListAdminTestJSON-460535768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.769s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:57:04 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-a0784052-2dd4-4739-b001-79fb8d342281 tempest-VolumesListAdminTestJSON-460535768 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:57:04 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-a0784052-2dd4-4739-b001-79fb8d342281 tempest-VolumesListAdminTestJSON-460535768 None] Deleted volume successfully.
Jun 15 15:57:04 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-a0784052-2dd4-4739-b001-79fb8d342281 tempest-VolumesListAdminTestJSON-460535768 None] Lock "cinder-5f1baa71-cc90-4239-9b51-3196253ce349-delete_volume" released by "delete_volume" :: held 3.448s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:57:04 devstack sudo[102064]: pam_unix(sudo:session): session closed for user root
Jun 15 15:57:04 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c1380587-f299-4202-a358-44f8e4fafa75 tempest-VolumesListAdminTestJSON-61835266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.729s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:57:04 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-c1380587-f299-4202-a358-44f8e4fafa75 tempest-VolumesListAdminTestJSON-61835266 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:57:04 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-c1380587-f299-4202-a358-44f8e4fafa75 tempest-VolumesListAdminTestJSON-61835266 None] Deleted volume successfully.
Jun 15 15:57:04 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-c1380587-f299-4202-a358-44f8e4fafa75 tempest-VolumesListAdminTestJSON-61835266 None] Lock "cinder-3eaa68fd-736a-4da3-9154-9bf655514cfb-delete_volume" released by "delete_volume" :: held 3.267s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:57:05 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-ebe9f3a5-843d-4b15-9895-e97369f2b3cb tempest-VolumesListAdminTestJSON-61835266 None] Acquiring lock "cinder-360318f5-5141-499c-a171-89523e4b160e-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:57:05 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-ebe9f3a5-843d-4b15-9895-e97369f2b3cb tempest-VolumesListAdminTestJSON-61835266 None] Lock "cinder-360318f5-5141-499c-a171-89523e4b160e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:57:05 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-ebe9f3a5-843d-4b15-9895-e97369f2b3cb tempest-VolumesListAdminTestJSON-61835266 None] Acquiring lock "cinder-quobyte-360318f5-5141-499c-a171-89523e4b160e" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:57:05 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-ebe9f3a5-843d-4b15-9895-e97369f2b3cb tempest-VolumesListAdminTestJSON-61835266 None] Lock "cinder-quobyte-360318f5-5141-499c-a171-89523e4b160e" acquired by "delete_volume" :: waited 0.022s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:57:05 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00f863b-4c36-4afe-b3c8-46e0a3d77a2e]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:57:05 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ebe9f3a5-843d-4b15-9895-e97369f2b3cb tempest-VolumesListAdminTestJSON-61835266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-360318f5-5141-499c-a171-89523e4b160e {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:57:05 devstack sudo[102069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-360318f5-5141-499c-a171-89523e4b160e
Jun 15 15:57:05 devstack sudo[102069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:57:06 devstack sudo[102069]: pam_unix(sudo:session): session closed for user root
Jun 15 15:57:06 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ebe9f3a5-843d-4b15-9895-e97369f2b3cb tempest-VolumesListAdminTestJSON-61835266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-360318f5-5141-499c-a171-89523e4b160e" returned: 0 in 0.784s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:57:06 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ebe9f3a5-843d-4b15-9895-e97369f2b3cb tempest-VolumesListAdminTestJSON-61835266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-360318f5-5141-499c-a171-89523e4b160e {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:57:06 devstack sudo[102074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-360318f5-5141-499c-a171-89523e4b160e
Jun 15 15:57:06 devstack sudo[102074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:57:06 devstack sudo[102074]: pam_unix(sudo:session): session closed for user root
Jun 15 15:57:06 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ebe9f3a5-843d-4b15-9895-e97369f2b3cb tempest-VolumesListAdminTestJSON-61835266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-360318f5-5141-499c-a171-89523e4b160e" returned: 0 in 0.643s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:57:06 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-ebe9f3a5-843d-4b15-9895-e97369f2b3cb tempest-VolumesListAdminTestJSON-61835266 None] Lock "cinder-quobyte-360318f5-5141-499c-a171-89523e4b160e" released by "delete_volume" :: held 1.468s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:57:06 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-ebe9f3a5-843d-4b15-9895-e97369f2b3cb tempest-VolumesListAdminTestJSON-61835266 None] Created reservations ['c60199cf-daed-4b5c-a738-36c8e869e8f7', '94dfc389-9f6f-4a30-87d1-a08747dcd46d', '8d897a68-7230-43f8-8dca-5e5cf18229ef', '6d9db9bf-fd7d-4645-ad93-63e960953e75'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:57:06 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-ebe9f3a5-843d-4b15-9895-e97369f2b3cb tempest-VolumesListAdminTestJSON-61835266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:57:06 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-ebe9f3a5-843d-4b15-9895-e97369f2b3cb tempest-VolumesListAdminTestJSON-61835266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:57:06 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-ebe9f3a5-843d-4b15-9895-e97369f2b3cb tempest-VolumesListAdminTestJSON-61835266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:57:06 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-ebe9f3a5-843d-4b15-9895-e97369f2b3cb tempest-VolumesListAdminTestJSON-61835266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:57:06 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-ebe9f3a5-843d-4b15-9895-e97369f2b3cb tempest-VolumesListAdminTestJSON-61835266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:57:06 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ebe9f3a5-843d-4b15-9895-e97369f2b3cb tempest-VolumesListAdminTestJSON-61835266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:57:06 devstack sudo[102077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:57:06 devstack sudo[102077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:57:07 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-6f232bec-541b-4ace-bcab-ff46feae8530 tempest-VolumesListAdminTestJSON-61835266 None] Acquiring lock "cinder-e909b37f-5a90-40a2-8249-db9a81c6ec2c-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:57:07 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-6f232bec-541b-4ace-bcab-ff46feae8530 tempest-VolumesListAdminTestJSON-61835266 None] Lock "cinder-e909b37f-5a90-40a2-8249-db9a81c6ec2c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:57:07 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-6f232bec-541b-4ace-bcab-ff46feae8530 tempest-VolumesListAdminTestJSON-61835266 None] Acquiring lock "cinder-quobyte-e909b37f-5a90-40a2-8249-db9a81c6ec2c" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:57:07 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-6f232bec-541b-4ace-bcab-ff46feae8530 tempest-VolumesListAdminTestJSON-61835266 None] Lock "cinder-quobyte-e909b37f-5a90-40a2-8249-db9a81c6ec2c" acquired by "delete_volume" :: waited 0.023s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:57:07 devstack sudo[102077]: pam_unix(sudo:session): session closed for user root
Jun 15 15:57:07 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ebe9f3a5-843d-4b15-9895-e97369f2b3cb tempest-VolumesListAdminTestJSON-61835266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.764s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:57:07 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-ebe9f3a5-843d-4b15-9895-e97369f2b3cb tempest-VolumesListAdminTestJSON-61835266 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:57:07 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-ebe9f3a5-843d-4b15-9895-e97369f2b3cb tempest-VolumesListAdminTestJSON-61835266 None] Deleted volume successfully.
Jun 15 15:57:07 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[87eac3da-ca91-4368-bbed-8d8a2f9887cc]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:57:07 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6f232bec-541b-4ace-bcab-ff46feae8530 tempest-VolumesListAdminTestJSON-61835266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e909b37f-5a90-40a2-8249-db9a81c6ec2c {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:57:07 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-ebe9f3a5-843d-4b15-9895-e97369f2b3cb tempest-VolumesListAdminTestJSON-61835266 None] Lock "cinder-360318f5-5141-499c-a171-89523e4b160e-delete_volume" released by "delete_volume" :: held 2.503s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:57:07 devstack sudo[102080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e909b37f-5a90-40a2-8249-db9a81c6ec2c
Jun 15 15:57:07 devstack sudo[102080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:57:08 devstack sudo[102080]: pam_unix(sudo:session): session closed for user root
Jun 15 15:57:08 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6f232bec-541b-4ace-bcab-ff46feae8530 tempest-VolumesListAdminTestJSON-61835266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e909b37f-5a90-40a2-8249-db9a81c6ec2c" returned: 0 in 0.790s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:57:08 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6f232bec-541b-4ace-bcab-ff46feae8530 tempest-VolumesListAdminTestJSON-61835266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e909b37f-5a90-40a2-8249-db9a81c6ec2c {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:57:08 devstack sudo[102085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e909b37f-5a90-40a2-8249-db9a81c6ec2c
Jun 15 15:57:08 devstack sudo[102085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:57:09 devstack sudo[102085]: pam_unix(sudo:session): session closed for user root
Jun 15 15:57:09 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6f232bec-541b-4ace-bcab-ff46feae8530 tempest-VolumesListAdminTestJSON-61835266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e909b37f-5a90-40a2-8249-db9a81c6ec2c" returned: 0 in 0.617s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:57:09 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-6f232bec-541b-4ace-bcab-ff46feae8530 tempest-VolumesListAdminTestJSON-61835266 None] Lock "cinder-quobyte-e909b37f-5a90-40a2-8249-db9a81c6ec2c" released by "delete_volume" :: held 1.467s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:57:09 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-6f232bec-541b-4ace-bcab-ff46feae8530 tempest-VolumesListAdminTestJSON-61835266 None] Created reservations ['cc8680ee-63be-4277-8adc-ea2e204483a6', '36d9f549-f9eb-4541-a080-95d0644e891b', '2f06211b-04ad-44eb-9c19-c4ee4fb84840', '7f1d8e0d-5288-438d-8de2-a3038a6b374d'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:57:09 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6f232bec-541b-4ace-bcab-ff46feae8530 tempest-VolumesListAdminTestJSON-61835266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:57:09 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6f232bec-541b-4ace-bcab-ff46feae8530 tempest-VolumesListAdminTestJSON-61835266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:57:09 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6f232bec-541b-4ace-bcab-ff46feae8530 tempest-VolumesListAdminTestJSON-61835266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:57:09 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6f232bec-541b-4ace-bcab-ff46feae8530 tempest-VolumesListAdminTestJSON-61835266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:57:09 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6f232bec-541b-4ace-bcab-ff46feae8530 tempest-VolumesListAdminTestJSON-61835266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:57:09 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6f232bec-541b-4ace-bcab-ff46feae8530 tempest-VolumesListAdminTestJSON-61835266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:57:09 devstack sudo[102088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:57:09 devstack sudo[102088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:57:09 devstack sudo[102088]: pam_unix(sudo:session): session closed for user root
Jun 15 15:57:09 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6f232bec-541b-4ace-bcab-ff46feae8530 tempest-VolumesListAdminTestJSON-61835266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.623s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:57:09 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-6f232bec-541b-4ace-bcab-ff46feae8530 tempest-VolumesListAdminTestJSON-61835266 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:57:09 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-6f232bec-541b-4ace-bcab-ff46feae8530 tempest-VolumesListAdminTestJSON-61835266 None] Deleted volume successfully.
Jun 15 15:57:09 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-6f232bec-541b-4ace-bcab-ff46feae8530 tempest-VolumesListAdminTestJSON-61835266 None] Lock "cinder-e909b37f-5a90-40a2-8249-db9a81c6ec2c-delete_volume" released by "delete_volume" :: held 2.333s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:57:17 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-15d300f6-fa9f-44a6-8c4b-53c22b7c14e3 tempest-GroupsV314Test-2010848967 None] Group tempest-GroupsV314Test-Group-156707488: creating
Jun 15 15:57:17 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-15d300f6-fa9f-44a6-8c4b-53c22b7c14e3 tempest-GroupsV314Test-2010848967 None] Group tempest-GroupsV314Test-Group-156707488: created successfully
Jun 15 15:57:17 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-15d300f6-fa9f-44a6-8c4b-53c22b7c14e3 tempest-GroupsV314Test-2010848967 None] Create group completed successfully.
Jun 15 15:57:17 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-98edf1e5-0d94-4d6f-9ab4-dbc2a3368f2c tempest-AbsoluteLimitsTests-1236971624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 15:57:17 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-98edf1e5-0d94-4d6f-9ab4-dbc2a3368f2c tempest-AbsoluteLimitsTests-1236971624 None] Flow 'volume_create_manager' (f92e4b8e-b0cb-403a-93b3-296d828f420b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:57:17 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-98edf1e5-0d94-4d6f-9ab4-dbc2a3368f2c tempest-AbsoluteLimitsTests-1236971624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8c67646-8c1a-4275-97ef-c7c40687d72e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:57:17 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-98edf1e5-0d94-4d6f-9ab4-dbc2a3368f2c tempest-AbsoluteLimitsTests-1236971624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8c67646-8c1a-4275-97ef-c7c40687d72e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:57:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1481948284',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41879d66-dace-4a0c-b9b3-c0e08b3dd11b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36d876ce108045e79efea01b14b1da84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:57:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:57:18Z,use_quota=True,user_id='59614de052bb4b4fb988769106c6bc66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:57:17 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-98edf1e5-0d94-4d6f-9ab4-dbc2a3368f2c tempest-AbsoluteLimitsTests-1236971624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c4f67ea-a5df-4f33-a6d8-5913098ab938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:57:17 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-98edf1e5-0d94-4d6f-9ab4-dbc2a3368f2c tempest-AbsoluteLimitsTests-1236971624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c4f67ea-a5df-4f33-a6d8-5913098ab938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:57:17 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-98edf1e5-0d94-4d6f-9ab4-dbc2a3368f2c tempest-AbsoluteLimitsTests-1236971624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5245185c-b1b3-460e-a1a7-faec25d4e7f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:57:17 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-98edf1e5-0d94-4d6f-9ab4-dbc2a3368f2c tempest-AbsoluteLimitsTests-1236971624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5245185c-b1b3-460e-a1a7-faec25d4e7f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41879d66-dace-4a0c-b9b3-c0e08b3dd11b', 'volume_name': 'volume-41879d66-dace-4a0c-b9b3-c0e08b3dd11b', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:57:17 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-98edf1e5-0d94-4d6f-9ab4-dbc2a3368f2c tempest-AbsoluteLimitsTests-1236971624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a78c2af2-d5d9-47f3-8f93-5aa52b61eeba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:57:17 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-98edf1e5-0d94-4d6f-9ab4-dbc2a3368f2c tempest-AbsoluteLimitsTests-1236971624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a78c2af2-d5d9-47f3-8f93-5aa52b61eeba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:57:17 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-98edf1e5-0d94-4d6f-9ab4-dbc2a3368f2c tempest-AbsoluteLimitsTests-1236971624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9d5cf97-4a2a-4899-8908-a742abb5fed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:57:17 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-98edf1e5-0d94-4d6f-9ab4-dbc2a3368f2c tempest-AbsoluteLimitsTests-1236971624 None] Volume 41879d66-dace-4a0c-b9b3-c0e08b3dd11b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41879d66-dace-4a0c-b9b3-c0e08b3dd11b', 'volume_size': 1}
Jun 15 15:57:17 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-98edf1e5-0d94-4d6f-9ab4-dbc2a3368f2c tempest-AbsoluteLimitsTests-1236971624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:57:17 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-98edf1e5-0d94-4d6f-9ab4-dbc2a3368f2c tempest-AbsoluteLimitsTests-1236971624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:57:17 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-98edf1e5-0d94-4d6f-9ab4-dbc2a3368f2c tempest-AbsoluteLimitsTests-1236971624 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:57:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1481948284',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41879d66-dace-4a0c-b9b3-c0e08b3dd11b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36d876ce108045e79efea01b14b1da84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:57:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:57:18Z,use_quota=True,user_id='59614de052bb4b4fb988769106c6bc66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 15:57:17 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-98edf1e5-0d94-4d6f-9ab4-dbc2a3368f2c tempest-AbsoluteLimitsTests-1236971624 None] Creating volume 41879d66-dace-4a0c-b9b3-c0e08b3dd11b {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 15:57:17 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-98edf1e5-0d94-4d6f-9ab4-dbc2a3368f2c tempest-AbsoluteLimitsTests-1236971624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:57:17 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-98edf1e5-0d94-4d6f-9ab4-dbc2a3368f2c tempest-AbsoluteLimitsTests-1236971624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:57:17 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-98edf1e5-0d94-4d6f-9ab4-dbc2a3368f2c tempest-AbsoluteLimitsTests-1236971624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:57:17 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-98edf1e5-0d94-4d6f-9ab4-dbc2a3368f2c tempest-AbsoluteLimitsTests-1236971624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:57:17 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-98edf1e5-0d94-4d6f-9ab4-dbc2a3368f2c tempest-AbsoluteLimitsTests-1236971624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:57:17 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-98edf1e5-0d94-4d6f-9ab4-dbc2a3368f2c tempest-AbsoluteLimitsTests-1236971624 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 15:57:17 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-98edf1e5-0d94-4d6f-9ab4-dbc2a3368f2c tempest-AbsoluteLimitsTests-1236971624 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 15:57:17 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-98edf1e5-0d94-4d6f-9ab4-dbc2a3368f2c tempest-AbsoluteLimitsTests-1236971624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-41879d66-dace-4a0c-b9b3-c0e08b3dd11b 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:57:17 devstack sudo[102101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-41879d66-dace-4a0c-b9b3-c0e08b3dd11b 1073741824
Jun 15 15:57:17 devstack sudo[102101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:57:18 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-1683a69e-fc03-42ea-b60f-15041b93956f tempest-GroupsV314Test-2010848967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 15:57:18 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-1683a69e-fc03-42ea-b60f-15041b93956f tempest-GroupsV314Test-2010848967 None] Flow 'volume_create_manager' (133a0af2-9771-4f18-b55c-39f68c021563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:57:18 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-1683a69e-fc03-42ea-b60f-15041b93956f tempest-GroupsV314Test-2010848967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bfec8c9-dcf7-4295-93c4-885c2f6cb89c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:57:18 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-1683a69e-fc03-42ea-b60f-15041b93956f tempest-GroupsV314Test-2010848967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bfec8c9-dcf7-4295-93c4-885c2f6cb89c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:57:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1450003682',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=95c1f1c6-347f-4c94-91e2-60719cae21b8,host='devstack@QuobyteHD#QuobyteHD',id=3f8613b4-a88b-490f-820a-9c3ffe04d407,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8d4744495e744e1a720e6a94636aca7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:57:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:57:19Z,use_quota=True,user_id='412eee37e3f74e7a90cc523f20b23339',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5309b45c-7cc0-44f6-81b2-840cfa221b15),volume_type_id=5309b45c-7cc0-44f6-81b2-840cfa221b15)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:57:18 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-1683a69e-fc03-42ea-b60f-15041b93956f tempest-GroupsV314Test-2010848967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b48a6017-3ded-43fc-9569-c5b1ea48eded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:57:18 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-1683a69e-fc03-42ea-b60f-15041b93956f tempest-GroupsV314Test-2010848967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b48a6017-3ded-43fc-9569-c5b1ea48eded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:57:18 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-1683a69e-fc03-42ea-b60f-15041b93956f tempest-GroupsV314Test-2010848967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (129ec2b0-c089-4cbf-b46b-500c8f8f0eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:57:18 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-1683a69e-fc03-42ea-b60f-15041b93956f tempest-GroupsV314Test-2010848967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (129ec2b0-c089-4cbf-b46b-500c8f8f0eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f8613b4-a88b-490f-820a-9c3ffe04d407', 'volume_name': 'volume-3f8613b4-a88b-490f-820a-9c3ffe04d407', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:57:18 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-1683a69e-fc03-42ea-b60f-15041b93956f tempest-GroupsV314Test-2010848967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dad4b83-3406-494c-8144-e0183236f9a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:57:18 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-1683a69e-fc03-42ea-b60f-15041b93956f tempest-GroupsV314Test-2010848967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dad4b83-3406-494c-8144-e0183236f9a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:57:18 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-1683a69e-fc03-42ea-b60f-15041b93956f tempest-GroupsV314Test-2010848967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31c04df2-73f4-4575-a4f5-b1d9ba6ba42b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:57:18 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-1683a69e-fc03-42ea-b60f-15041b93956f tempest-GroupsV314Test-2010848967 None] Volume 3f8613b4-a88b-490f-820a-9c3ffe04d407: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f8613b4-a88b-490f-820a-9c3ffe04d407', 'volume_size': 1}
Jun 15 15:57:18 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-1683a69e-fc03-42ea-b60f-15041b93956f tempest-GroupsV314Test-2010848967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:57:18 devstack sudo[102101]: pam_unix(sudo:session): session closed for user root
Jun 15 15:57:18 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-98edf1e5-0d94-4d6f-9ab4-dbc2a3368f2c tempest-AbsoluteLimitsTests-1236971624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-41879d66-dace-4a0c-b9b3-c0e08b3dd11b 1073741824" returned: 0 in 0.840s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:57:18 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-98edf1e5-0d94-4d6f-9ab4-dbc2a3368f2c tempest-AbsoluteLimitsTests-1236971624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-41879d66-dace-4a0c-b9b3-c0e08b3dd11b {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:57:18 devstack sudo[102107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-41879d66-dace-4a0c-b9b3-c0e08b3dd11b
Jun 15 15:57:18 devstack sudo[102107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:57:19 devstack sudo[102107]: pam_unix(sudo:session): session closed for user root
Jun 15 15:57:19 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-98edf1e5-0d94-4d6f-9ab4-dbc2a3368f2c tempest-AbsoluteLimitsTests-1236971624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-41879d66-dace-4a0c-b9b3-c0e08b3dd11b" returned: 0 in 0.724s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:57:19 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-98edf1e5-0d94-4d6f-9ab4-dbc2a3368f2c tempest-AbsoluteLimitsTests-1236971624 None] <== create_volume: return (1602ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 15:57:19 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-98edf1e5-0d94-4d6f-9ab4-dbc2a3368f2c tempest-AbsoluteLimitsTests-1236971624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.605s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:57:19 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-1683a69e-fc03-42ea-b60f-15041b93956f tempest-GroupsV314Test-2010848967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.779s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:57:19 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-1683a69e-fc03-42ea-b60f-15041b93956f tempest-GroupsV314Test-2010848967 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=95c1f1c6-347f-4c94-91e2-60719cae21b8,created_at=2026-06-15T13:57:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1450003682',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=95c1f1c6-347f-4c94-91e2-60719cae21b8,host='devstack@QuobyteHD#QuobyteHD',id=3f8613b4-a88b-490f-820a-9c3ffe04d407,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8d4744495e744e1a720e6a94636aca7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:57:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:57:19Z,use_quota=True,user_id='412eee37e3f74e7a90cc523f20b23339',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5309b45c-7cc0-44f6-81b2-840cfa221b15),volume_type_id=5309b45c-7cc0-44f6-81b2-840cfa221b15)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 15:57:19 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-1683a69e-fc03-42ea-b60f-15041b93956f tempest-GroupsV314Test-2010848967 None] Creating volume 3f8613b4-a88b-490f-820a-9c3ffe04d407 {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 15:57:19 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-1683a69e-fc03-42ea-b60f-15041b93956f tempest-GroupsV314Test-2010848967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:57:19 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-1683a69e-fc03-42ea-b60f-15041b93956f tempest-GroupsV314Test-2010848967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:57:19 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-1683a69e-fc03-42ea-b60f-15041b93956f tempest-GroupsV314Test-2010848967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:57:19 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-1683a69e-fc03-42ea-b60f-15041b93956f tempest-GroupsV314Test-2010848967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:57:19 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-1683a69e-fc03-42ea-b60f-15041b93956f tempest-GroupsV314Test-2010848967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:57:19 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-1683a69e-fc03-42ea-b60f-15041b93956f tempest-GroupsV314Test-2010848967 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 15:57:19 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-1683a69e-fc03-42ea-b60f-15041b93956f tempest-GroupsV314Test-2010848967 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 15:57:19 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-1683a69e-fc03-42ea-b60f-15041b93956f tempest-GroupsV314Test-2010848967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3f8613b4-a88b-490f-820a-9c3ffe04d407 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:57:19 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-98edf1e5-0d94-4d6f-9ab4-dbc2a3368f2c tempest-AbsoluteLimitsTests-1236971624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9d5cf97-4a2a-4899-8908-a742abb5fed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41879d66-dace-4a0c-b9b3-c0e08b3dd11b', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:57:19 devstack sudo[102110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3f8613b4-a88b-490f-820a-9c3ffe04d407 1073741824
Jun 15 15:57:19 devstack sudo[102110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:57:19 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-98edf1e5-0d94-4d6f-9ab4-dbc2a3368f2c tempest-AbsoluteLimitsTests-1236971624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bef25683-d635-4523-bdbd-327f02cf3406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:57:19 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-98edf1e5-0d94-4d6f-9ab4-dbc2a3368f2c tempest-AbsoluteLimitsTests-1236971624 None] Volume volume-41879d66-dace-4a0c-b9b3-c0e08b3dd11b (41879d66-dace-4a0c-b9b3-c0e08b3dd11b): created successfully
Jun 15 15:57:19 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-98edf1e5-0d94-4d6f-9ab4-dbc2a3368f2c tempest-AbsoluteLimitsTests-1236971624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bef25683-d635-4523-bdbd-327f02cf3406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:57:19 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-98edf1e5-0d94-4d6f-9ab4-dbc2a3368f2c tempest-AbsoluteLimitsTests-1236971624 None] Flow 'volume_create_manager' (f92e4b8e-b0cb-403a-93b3-296d828f420b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:57:19 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-98edf1e5-0d94-4d6f-9ab4-dbc2a3368f2c tempest-AbsoluteLimitsTests-1236971624 None] Created volume successfully.
Jun 15 15:57:20 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-65da167e-91a8-45af-86ef-c5e6d6d7a5a4 tempest-AbsoluteLimitsTests-1236971624 None] Acquiring lock "cinder-41879d66-dace-4a0c-b9b3-c0e08b3dd11b-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:57:20 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-65da167e-91a8-45af-86ef-c5e6d6d7a5a4 tempest-AbsoluteLimitsTests-1236971624 None] Lock "cinder-41879d66-dace-4a0c-b9b3-c0e08b3dd11b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:57:20 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-65da167e-91a8-45af-86ef-c5e6d6d7a5a4 tempest-AbsoluteLimitsTests-1236971624 None] Acquiring lock "cinder-quobyte-41879d66-dace-4a0c-b9b3-c0e08b3dd11b" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:57:20 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-65da167e-91a8-45af-86ef-c5e6d6d7a5a4 tempest-AbsoluteLimitsTests-1236971624 None] Lock "cinder-quobyte-41879d66-dace-4a0c-b9b3-c0e08b3dd11b" acquired by "delete_volume" :: waited 0.018s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:57:20 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b2452d-77d4-4362-b763-5c7b711c235e]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:57:20 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-65da167e-91a8-45af-86ef-c5e6d6d7a5a4 tempest-AbsoluteLimitsTests-1236971624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-41879d66-dace-4a0c-b9b3-c0e08b3dd11b {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:57:20 devstack sudo[102116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-41879d66-dace-4a0c-b9b3-c0e08b3dd11b
Jun 15 15:57:20 devstack sudo[102116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:57:20 devstack sudo[102110]: pam_unix(sudo:session): session closed for user root
Jun 15 15:57:20 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-1683a69e-fc03-42ea-b60f-15041b93956f tempest-GroupsV314Test-2010848967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3f8613b4-a88b-490f-820a-9c3ffe04d407 1073741824" returned: 0 in 0.934s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:57:20 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-1683a69e-fc03-42ea-b60f-15041b93956f tempest-GroupsV314Test-2010848967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3f8613b4-a88b-490f-820a-9c3ffe04d407 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:57:20 devstack sudo[102119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3f8613b4-a88b-490f-820a-9c3ffe04d407
Jun 15 15:57:20 devstack sudo[102119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:57:21 devstack sudo[102116]: pam_unix(sudo:session): session closed for user root
Jun 15 15:57:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-65da167e-91a8-45af-86ef-c5e6d6d7a5a4 tempest-AbsoluteLimitsTests-1236971624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-41879d66-dace-4a0c-b9b3-c0e08b3dd11b" returned: 0 in 0.805s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:57:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-65da167e-91a8-45af-86ef-c5e6d6d7a5a4 tempest-AbsoluteLimitsTests-1236971624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-41879d66-dace-4a0c-b9b3-c0e08b3dd11b {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:57:21 devstack sudo[102119]: pam_unix(sudo:session): session closed for user root
Jun 15 15:57:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-1683a69e-fc03-42ea-b60f-15041b93956f tempest-GroupsV314Test-2010848967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3f8613b4-a88b-490f-820a-9c3ffe04d407" returned: 0 in 0.612s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:57:21 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-1683a69e-fc03-42ea-b60f-15041b93956f tempest-GroupsV314Test-2010848967 None] <== create_volume: return (1598ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 15:57:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-1683a69e-fc03-42ea-b60f-15041b93956f tempest-GroupsV314Test-2010848967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.602s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:57:21 devstack sudo[102125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-41879d66-dace-4a0c-b9b3-c0e08b3dd11b
Jun 15 15:57:21 devstack sudo[102125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:57:21 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-1683a69e-fc03-42ea-b60f-15041b93956f tempest-GroupsV314Test-2010848967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31c04df2-73f4-4575-a4f5-b1d9ba6ba42b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f8613b4-a88b-490f-820a-9c3ffe04d407', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:57:21 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-1683a69e-fc03-42ea-b60f-15041b93956f tempest-GroupsV314Test-2010848967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e169b293-551c-48dc-97a0-45a5fd2718b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:57:21 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-1683a69e-fc03-42ea-b60f-15041b93956f tempest-GroupsV314Test-2010848967 None] Volume volume-3f8613b4-a88b-490f-820a-9c3ffe04d407 (3f8613b4-a88b-490f-820a-9c3ffe04d407): created successfully
Jun 15 15:57:21 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-1683a69e-fc03-42ea-b60f-15041b93956f tempest-GroupsV314Test-2010848967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e169b293-551c-48dc-97a0-45a5fd2718b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:57:21 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-1683a69e-fc03-42ea-b60f-15041b93956f tempest-GroupsV314Test-2010848967 None] Flow 'volume_create_manager' (133a0af2-9771-4f18-b55c-39f68c021563) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:57:21 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-1683a69e-fc03-42ea-b60f-15041b93956f tempest-GroupsV314Test-2010848967 None] Created volume successfully.
Jun 15 15:57:21 devstack sudo[102125]: pam_unix(sudo:session): session closed for user root
Jun 15 15:57:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-65da167e-91a8-45af-86ef-c5e6d6d7a5a4 tempest-AbsoluteLimitsTests-1236971624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-41879d66-dace-4a0c-b9b3-c0e08b3dd11b" returned: 0 in 0.586s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:57:21 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-65da167e-91a8-45af-86ef-c5e6d6d7a5a4 tempest-AbsoluteLimitsTests-1236971624 None] Lock "cinder-quobyte-41879d66-dace-4a0c-b9b3-c0e08b3dd11b" released by "delete_volume" :: held 1.433s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:57:21 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-65da167e-91a8-45af-86ef-c5e6d6d7a5a4 tempest-AbsoluteLimitsTests-1236971624 None] Created reservations ['1373e4c5-1348-42bb-b9e0-d7dfcf44562c', '1cc5ee2b-41f1-4c74-8e6c-54396a94300d', 'c000183c-d33b-483e-98f5-431814449b4e', '68164e8d-f958-48d5-ac42-7572112a1c16'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:57:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-65da167e-91a8-45af-86ef-c5e6d6d7a5a4 tempest-AbsoluteLimitsTests-1236971624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:57:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-65da167e-91a8-45af-86ef-c5e6d6d7a5a4 tempest-AbsoluteLimitsTests-1236971624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:57:21 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-65da167e-91a8-45af-86ef-c5e6d6d7a5a4 tempest-AbsoluteLimitsTests-1236971624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:57:21 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-65da167e-91a8-45af-86ef-c5e6d6d7a5a4 tempest-AbsoluteLimitsTests-1236971624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:57:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-65da167e-91a8-45af-86ef-c5e6d6d7a5a4 tempest-AbsoluteLimitsTests-1236971624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:57:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-65da167e-91a8-45af-86ef-c5e6d6d7a5a4 tempest-AbsoluteLimitsTests-1236971624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:57:21 devstack sudo[102128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:57:21 devstack sudo[102128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:57:22 devstack sudo[102128]: pam_unix(sudo:session): session closed for user root
Jun 15 15:57:22 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-65da167e-91a8-45af-86ef-c5e6d6d7a5a4 tempest-AbsoluteLimitsTests-1236971624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.613s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:57:22 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-65da167e-91a8-45af-86ef-c5e6d6d7a5a4 tempest-AbsoluteLimitsTests-1236971624 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:57:22 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-65da167e-91a8-45af-86ef-c5e6d6d7a5a4 tempest-AbsoluteLimitsTests-1236971624 None] Deleted volume successfully.
Jun 15 15:57:22 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-65da167e-91a8-45af-86ef-c5e6d6d7a5a4 tempest-AbsoluteLimitsTests-1236971624 None] Lock "cinder-41879d66-dace-4a0c-b9b3-c0e08b3dd11b-delete_volume" released by "delete_volume" :: held 2.261s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:57:23 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6e4dbd09-09e3-449a-bd38-61b1bd6ef8d2 tempest-GroupsV314Test-2010848967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:57:23 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6e4dbd09-09e3-449a-bd38-61b1bd6ef8d2 tempest-GroupsV314Test-2010848967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:57:23 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-6e4dbd09-09e3-449a-bd38-61b1bd6ef8d2 tempest-GroupsV314Test-2010848967 None] Cloning volume 3f8613b4-a88b-490f-820a-9c3ffe04d407 to volume 815f4862-af8a-4a39-921d-469f4b19fcc8
Jun 15 15:57:23 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-6e4dbd09-09e3-449a-bd38-61b1bd6ef8d2 tempest-GroupsV314Test-2010848967 None] Creating offline snapshot 0e2ad009-318e-4de1-bf7a-a7aff8b2511b of volume 3f8613b4-a88b-490f-820a-9c3ffe04d407 {{(pid=91863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 15 15:57:23 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0779ebe-93be-4797-8078-1f420dab08f2]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:57:23 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6e4dbd09-09e3-449a-bd38-61b1bd6ef8d2 tempest-GroupsV314Test-2010848967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3f8613b4-a88b-490f-820a-9c3ffe04d407 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:57:23 devstack sudo[102139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3f8613b4-a88b-490f-820a-9c3ffe04d407
Jun 15 15:57:23 devstack sudo[102139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:57:24 devstack sudo[102139]: pam_unix(sudo:session): session closed for user root
Jun 15 15:57:24 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6e4dbd09-09e3-449a-bd38-61b1bd6ef8d2 tempest-GroupsV314Test-2010848967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3f8613b4-a88b-490f-820a-9c3ffe04d407" returned: 0 in 0.936s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:57:24 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6e4dbd09-09e3-449a-bd38-61b1bd6ef8d2 tempest-GroupsV314Test-2010848967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3f8613b4-a88b-490f-820a-9c3ffe04d407,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3f8613b4-a88b-490f-820a-9c3ffe04d407.0e2ad009-318e-4de1-bf7a-a7aff8b2511b 1G {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:57:24 devstack sudo[102180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3f8613b4-a88b-490f-820a-9c3ffe04d407,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3f8613b4-a88b-490f-820a-9c3ffe04d407.0e2ad009-318e-4de1-bf7a-a7aff8b2511b 1G
Jun 15 15:57:24 devstack sudo[102180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:57:25 devstack sudo[102180]: pam_unix(sudo:session): session closed for user root
Jun 15 15:57:25 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6e4dbd09-09e3-449a-bd38-61b1bd6ef8d2 tempest-GroupsV314Test-2010848967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3f8613b4-a88b-490f-820a-9c3ffe04d407,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3f8613b4-a88b-490f-820a-9c3ffe04d407.0e2ad009-318e-4de1-bf7a-a7aff8b2511b 1G" returned: 0 in 0.998s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:57:25 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6e4dbd09-09e3-449a-bd38-61b1bd6ef8d2 tempest-GroupsV314Test-2010848967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f8613b4-a88b-490f-820a-9c3ffe04d407 -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3f8613b4-a88b-490f-820a-9c3ffe04d407.0e2ad009-318e-4de1-bf7a-a7aff8b2511b {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:57:25 devstack sudo[102192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f8613b4-a88b-490f-820a-9c3ffe04d407 -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3f8613b4-a88b-490f-820a-9c3ffe04d407.0e2ad009-318e-4de1-bf7a-a7aff8b2511b
Jun 15 15:57:25 devstack sudo[102192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:57:25 devstack sudo[102192]: pam_unix(sudo:session): session closed for user root
Jun 15 15:57:25 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6e4dbd09-09e3-449a-bd38-61b1bd6ef8d2 tempest-GroupsV314Test-2010848967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f8613b4-a88b-490f-820a-9c3ffe04d407 -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3f8613b4-a88b-490f-820a-9c3ffe04d407.0e2ad009-318e-4de1-bf7a-a7aff8b2511b" returned: 0 in 0.812s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:57:25 devstack cinder-volume[91863]: WARNING cinder.volume.drivers.remotefs [None req-6e4dbd09-09e3-449a-bd38-61b1bd6ef8d2 tempest-GroupsV314Test-2010848967 None] /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3f8613b4-a88b-490f-820a-9c3ffe04d407.0e2ad009-318e-4de1-bf7a-a7aff8b2511b is being set with open permissions: ugo+rw: NotImplementedError
Jun 15 15:57:25 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6e4dbd09-09e3-449a-bd38-61b1bd6ef8d2 tempest-GroupsV314Test-2010848967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3f8613b4-a88b-490f-820a-9c3ffe04d407.0e2ad009-318e-4de1-bf7a-a7aff8b2511b {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:57:25 devstack sudo[102199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3f8613b4-a88b-490f-820a-9c3ffe04d407.0e2ad009-318e-4de1-bf7a-a7aff8b2511b
Jun 15 15:57:25 devstack sudo[102199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:57:26 devstack sudo[102199]: pam_unix(sudo:session): session closed for user root
Jun 15 15:57:26 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6e4dbd09-09e3-449a-bd38-61b1bd6ef8d2 tempest-GroupsV314Test-2010848967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3f8613b4-a88b-490f-820a-9c3ffe04d407.0e2ad009-318e-4de1-bf7a-a7aff8b2511b" returned: 0 in 0.677s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:57:26 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6e4dbd09-09e3-449a-bd38-61b1bd6ef8d2 tempest-GroupsV314Test-2010848967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3f8613b4-a88b-490f-820a-9c3ffe04d407.info {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:57:26 devstack sudo[102203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3f8613b4-a88b-490f-820a-9c3ffe04d407.info
Jun 15 15:57:26 devstack sudo[102203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:57:27 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ff0e447-a613-4437-b7d1-be3ec4f888e0 tempest-VolumesDeleteCascade-1394360621 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 15:57:27 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8ff0e447-a613-4437-b7d1-be3ec4f888e0 tempest-VolumesDeleteCascade-1394360621 None] Flow 'volume_create_manager' (fd760d1e-5a59-4aaf-b916-f6df5d5dfe45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:57:27 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8ff0e447-a613-4437-b7d1-be3ec4f888e0 tempest-VolumesDeleteCascade-1394360621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (749b3f4d-2594-481e-8c8b-6f9d7d63a4ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:57:27 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8ff0e447-a613-4437-b7d1-be3ec4f888e0 tempest-VolumesDeleteCascade-1394360621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (749b3f4d-2594-481e-8c8b-6f9d7d63a4ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:57:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1925265998',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d18f4ff-f4f7-4ff9-8f69-575332f781ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e918721fd3c4a7d9c7942081403e952',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:57:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:57:27Z,use_quota=True,user_id='ac590f403ee6420ab5ffb13507e21541',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:57:27 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8ff0e447-a613-4437-b7d1-be3ec4f888e0 tempest-VolumesDeleteCascade-1394360621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fff165a6-e7ce-451a-bead-abfa57e903ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:57:27 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8ff0e447-a613-4437-b7d1-be3ec4f888e0 tempest-VolumesDeleteCascade-1394360621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fff165a6-e7ce-451a-bead-abfa57e903ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:57:27 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8ff0e447-a613-4437-b7d1-be3ec4f888e0 tempest-VolumesDeleteCascade-1394360621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ef98c7c-c8d5-44d6-8453-e259cc4275da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:57:27 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8ff0e447-a613-4437-b7d1-be3ec4f888e0 tempest-VolumesDeleteCascade-1394360621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ef98c7c-c8d5-44d6-8453-e259cc4275da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d18f4ff-f4f7-4ff9-8f69-575332f781ee', 'volume_name': 'volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:57:27 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8ff0e447-a613-4437-b7d1-be3ec4f888e0 tempest-VolumesDeleteCascade-1394360621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (067c6e3e-2b09-4681-a39c-beff1e1c7a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:57:27 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8ff0e447-a613-4437-b7d1-be3ec4f888e0 tempest-VolumesDeleteCascade-1394360621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (067c6e3e-2b09-4681-a39c-beff1e1c7a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:57:27 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8ff0e447-a613-4437-b7d1-be3ec4f888e0 tempest-VolumesDeleteCascade-1394360621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b5c407d-0d8f-4adf-9002-f5e38ca8f9ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:57:27 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-8ff0e447-a613-4437-b7d1-be3ec4f888e0 tempest-VolumesDeleteCascade-1394360621 None] Volume 5d18f4ff-f4f7-4ff9-8f69-575332f781ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee', 'volume_size': 1}
Jun 15 15:57:27 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-8ff0e447-a613-4437-b7d1-be3ec4f888e0 tempest-VolumesDeleteCascade-1394360621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:57:27 devstack sudo[102203]: pam_unix(sudo:session): session closed for user root
Jun 15 15:57:27 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6e4dbd09-09e3-449a-bd38-61b1bd6ef8d2 tempest-GroupsV314Test-2010848967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3f8613b4-a88b-490f-820a-9c3ffe04d407.info" returned: 0 in 0.598s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:57:27 devstack cinder-volume[91863]: WARNING cinder.volume.drivers.remotefs [None req-6e4dbd09-09e3-449a-bd38-61b1bd6ef8d2 tempest-GroupsV314Test-2010848967 None] /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3f8613b4-a88b-490f-820a-9c3ffe04d407.info is being set with open permissions: ugo+rw: NotImplementedError
Jun 15 15:57:27 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6e4dbd09-09e3-449a-bd38-61b1bd6ef8d2 tempest-GroupsV314Test-2010848967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3f8613b4-a88b-490f-820a-9c3ffe04d407.info {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:57:27 devstack sudo[102206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3f8613b4-a88b-490f-820a-9c3ffe04d407.info
Jun 15 15:57:27 devstack sudo[102206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:57:27 devstack sudo[102206]: pam_unix(sudo:session): session closed for user root
Jun 15 15:57:27 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6e4dbd09-09e3-449a-bd38-61b1bd6ef8d2 tempest-GroupsV314Test-2010848967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3f8613b4-a88b-490f-820a-9c3ffe04d407.info" returned: 0 in 0.587s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:57:27 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-6e4dbd09-09e3-449a-bd38-61b1bd6ef8d2 tempest-GroupsV314Test-2010848967 None] Acquiring lock "cinder-quobyte-815f4862-af8a-4a39-921d-469f4b19fcc8" by "_copy_volume_from_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:57:27 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-6e4dbd09-09e3-449a-bd38-61b1bd6ef8d2 tempest-GroupsV314Test-2010848967 None] Lock "cinder-quobyte-815f4862-af8a-4a39-921d-469f4b19fcc8" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:57:27 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6e4dbd09-09e3-449a-bd38-61b1bd6ef8d2 tempest-GroupsV314Test-2010848967 None] snapshot: 0e2ad009-318e-4de1-bf7a-a7aff8b2511b, volume: 815f4862-af8a-4a39-921d-469f4b19fcc8,  {{(pid=91863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 15 15:57:27 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6e4dbd09-09e3-449a-bd38-61b1bd6ef8d2 tempest-GroupsV314Test-2010848967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:57:27 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6e4dbd09-09e3-449a-bd38-61b1bd6ef8d2 tempest-GroupsV314Test-2010848967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:57:27 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6e4dbd09-09e3-449a-bd38-61b1bd6ef8d2 tempest-GroupsV314Test-2010848967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:57:27 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6e4dbd09-09e3-449a-bd38-61b1bd6ef8d2 tempest-GroupsV314Test-2010848967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:57:27 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6e4dbd09-09e3-449a-bd38-61b1bd6ef8d2 tempest-GroupsV314Test-2010848967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:57:27 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dce22e3-a07d-4380-bf39-1dba7989c3d1]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:57:27 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6e4dbd09-09e3-449a-bd38-61b1bd6ef8d2 tempest-GroupsV314Test-2010848967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3f8613b4-a88b-490f-820a-9c3ffe04d407.0e2ad009-318e-4de1-bf7a-a7aff8b2511b {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:57:27 devstack sudo[102209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3f8613b4-a88b-490f-820a-9c3ffe04d407.0e2ad009-318e-4de1-bf7a-a7aff8b2511b
Jun 15 15:57:27 devstack sudo[102209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:57:28 devstack sudo[102209]: pam_unix(sudo:session): session closed for user root
Jun 15 15:57:28 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6e4dbd09-09e3-449a-bd38-61b1bd6ef8d2 tempest-GroupsV314Test-2010848967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3f8613b4-a88b-490f-820a-9c3ffe04d407.0e2ad009-318e-4de1-bf7a-a7aff8b2511b" returned: 0 in 0.711s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:57:28 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-6e4dbd09-09e3-449a-bd38-61b1bd6ef8d2 tempest-GroupsV314Test-2010848967 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f8613b4-a88b-490f-820a-9c3ffe04d407(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 15:57:28 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6e4dbd09-09e3-449a-bd38-61b1bd6ef8d2 tempest-GroupsV314Test-2010848967 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3f8613b4-a88b-490f-820a-9c3ffe04d407 {{(pid=91863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 15 15:57:28 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6e4dbd09-09e3-449a-bd38-61b1bd6ef8d2 tempest-GroupsV314Test-2010848967 None] Creating direct copy from snapshot {{(pid=91863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 15 15:57:28 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e665855-8a9b-407e-bf20-0da13f227188]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:57:28 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6e4dbd09-09e3-449a-bd38-61b1bd6ef8d2 tempest-GroupsV314Test-2010848967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3f8613b4-a88b-490f-820a-9c3ffe04d407 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:57:28 devstack sudo[102214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3f8613b4-a88b-490f-820a-9c3ffe04d407
Jun 15 15:57:28 devstack sudo[102214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:57:29 devstack sudo[102214]: pam_unix(sudo:session): session closed for user root
Jun 15 15:57:29 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6e4dbd09-09e3-449a-bd38-61b1bd6ef8d2 tempest-GroupsV314Test-2010848967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3f8613b4-a88b-490f-820a-9c3ffe04d407" returned: 0 in 0.701s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:57:29 devstack cinder-volume[91863]: DEBUG cinder.utils [None req-6e4dbd09-09e3-449a-bd38-61b1bd6ef8d2 tempest-GroupsV314Test-2010848967 None] Path /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-815f4862-af8a-4a39-921d-469f4b19fcc8 not found in is_blk_device check {{(pid=91863) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 15 15:57:29 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6e4dbd09-09e3-449a-bd38-61b1bd6ef8d2 tempest-GroupsV314Test-2010848967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3f8613b4-a88b-490f-820a-9c3ffe04d407 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-815f4862-af8a-4a39-921d-469f4b19fcc8 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:57:29 devstack sudo[102219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3f8613b4-a88b-490f-820a-9c3ffe04d407 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-815f4862-af8a-4a39-921d-469f4b19fcc8
Jun 15 15:57:29 devstack sudo[102219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:57:31 devstack cinder-volume[91863]: DEBUG oslo_service.periodic_task [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 15:57:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:57:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:57:31 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:57:31 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:57:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:57:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:57:31 devstack sudo[102232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:57:31 devstack sudo[102232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:57:32 devstack sudo[102232]: pam_unix(sudo:session): session closed for user root
Jun 15 15:57:32 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 1.490s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:57:32 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:57:32 devstack cinder-volume[91863]: DEBUG oslo_service.periodic_task [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Running periodic task VolumeManager._thread_info {{(pid=91863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 15:57:32 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] thread count: 28 {{(pid=91863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 15 15:57:32 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] thread info: [<_MainThread(MainThread, started 131088232640640)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131088122704576)>, <Thread(Thread-3 (stat_writer), started daemon 131088123058112)>, <Thread(Rabbit-heartbeat, started daemon 131088121268864)>, <Thread(Thread-5 (_runner), started daemon 131088121904192)>, <Thread(Thread-7 (_runner), started daemon 131088122037248)>, <Thread(fd_logger, started daemon 131088119630784)>, <Thread(privsep_reader, started daemon 131088119781440)>, <Thread(tpool_thread_0, started daemon 131088111617728)>, <Thread(tpool_thread_1, started daemon 131088103225024)>, <Thread(tpool_thread_2, started daemon 131088094832320)>, <Thread(tpool_thread_3, started daemon 131088086439616)>, <Thread(tpool_thread_4, started daemon 131088078046912)>, <Thread(tpool_thread_5, started daemon 131088069654208)>, <Thread(tpool_thread_6, started daemon 131088061261504)>, <Thread(tpool_thread_7, started daemon 131088052868800)>, <Thread(tpool_thread_8, started daemon 131088044476096)>, <Thread(tpool_thread_9, started daemon 131088036083392)>, <Thread(tpool_thread_10, started daemon 131088027690688)>, <Thread(tpool_thread_11, started daemon 131088019297984)>, <Thread(tpool_thread_12, started daemon 131088010905280)>, <Thread(tpool_thread_13, started daemon 131088002512576)>, <Thread(tpool_thread_14, started daemon 131087994119872)>, <Thread(tpool_thread_15, started daemon 131087985727168)>, <Thread(tpool_thread_16, started daemon 131087977334464)>, <Thread(tpool_thread_17, started daemon 131087968941760)>, <Thread(tpool_thread_18, started daemon 131087960549056)>, <Thread(tpool_thread_19, started daemon 131087952156352)>] {{(pid=91863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 15 15:57:34 devstack sudo[102219]: pam_unix(sudo:session): session closed for user root
Jun 15 15:57:34 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6e4dbd09-09e3-449a-bd38-61b1bd6ef8d2 tempest-GroupsV314Test-2010848967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3f8613b4-a88b-490f-820a-9c3ffe04d407 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-815f4862-af8a-4a39-921d-469f4b19fcc8" returned: 0 in 5.270s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:57:34 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d80687a2-0149-43cb-8fbd-c2bfe461b15d]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:57:34 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6e4dbd09-09e3-449a-bd38-61b1bd6ef8d2 tempest-GroupsV314Test-2010848967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3f8613b4-a88b-490f-820a-9c3ffe04d407 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:57:34 devstack sudo[102272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3f8613b4-a88b-490f-820a-9c3ffe04d407
Jun 15 15:57:34 devstack sudo[102272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:57:35 devstack sudo[102272]: pam_unix(sudo:session): session closed for user root
Jun 15 15:57:35 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6e4dbd09-09e3-449a-bd38-61b1bd6ef8d2 tempest-GroupsV314Test-2010848967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3f8613b4-a88b-490f-820a-9c3ffe04d407" returned: 0 in 0.919s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:57:35 devstack cinder-volume[91863]: DEBUG cinder.image.image_utils [None req-6e4dbd09-09e3-449a-bd38-61b1bd6ef8d2 tempest-GroupsV314Test-2010848967 None] Image conversion details: src /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3f8613b4-a88b-490f-820a-9c3ffe04d407, size 1024.00 MB, duration 5.27 sec, destination /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-815f4862-af8a-4a39-921d-469f4b19fcc8 {{(pid=91863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 15 15:57:35 devstack cinder-volume[91863]: INFO cinder.image.image_utils [None req-6e4dbd09-09e3-449a-bd38-61b1bd6ef8d2 tempest-GroupsV314Test-2010848967 None] Converted 1024.00 MB image at 194.23 MB/s
Jun 15 15:57:35 devstack cinder-volume[91863]: WARNING cinder.volume.drivers.remotefs [None req-6e4dbd09-09e3-449a-bd38-61b1bd6ef8d2 tempest-GroupsV314Test-2010848967 None] /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-815f4862-af8a-4a39-921d-469f4b19fcc8 is being set with open permissions: ugo+rw: NotImplementedError
Jun 15 15:57:35 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6e4dbd09-09e3-449a-bd38-61b1bd6ef8d2 tempest-GroupsV314Test-2010848967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-815f4862-af8a-4a39-921d-469f4b19fcc8 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:57:35 devstack sudo[102277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-815f4862-af8a-4a39-921d-469f4b19fcc8
Jun 15 15:57:35 devstack sudo[102277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:57:36 devstack sudo[102277]: pam_unix(sudo:session): session closed for user root
Jun 15 15:57:36 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6e4dbd09-09e3-449a-bd38-61b1bd6ef8d2 tempest-GroupsV314Test-2010848967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-815f4862-af8a-4a39-921d-469f4b19fcc8" returned: 0 in 0.632s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:57:36 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-6e4dbd09-09e3-449a-bd38-61b1bd6ef8d2 tempest-GroupsV314Test-2010848967 None] Lock "cinder-quobyte-815f4862-af8a-4a39-921d-469f4b19fcc8" released by "_copy_volume_from_snapshot" :: held 8.318s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:57:36 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-6e4dbd09-09e3-449a-bd38-61b1bd6ef8d2 tempest-GroupsV314Test-2010848967 None] Acquiring lock "cinder-quobyte-0e2ad009-318e-4de1-bf7a-a7aff8b2511b" by "_delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:57:36 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-6e4dbd09-09e3-449a-bd38-61b1bd6ef8d2 tempest-GroupsV314Test-2010848967 None] Lock "cinder-quobyte-0e2ad009-318e-4de1-bf7a-a7aff8b2511b" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:57:36 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-6e4dbd09-09e3-449a-bd38-61b1bd6ef8d2 tempest-GroupsV314Test-2010848967 None] Deleting offline snapshot 0e2ad009-318e-4de1-bf7a-a7aff8b2511b of volume 3f8613b4-a88b-490f-820a-9c3ffe04d407 {{(pid=91863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 15 15:57:36 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-6e4dbd09-09e3-449a-bd38-61b1bd6ef8d2 tempest-GroupsV314Test-2010848967 None] snapshot_file for this snap is: volume-3f8613b4-a88b-490f-820a-9c3ffe04d407.0e2ad009-318e-4de1-bf7a-a7aff8b2511b {{(pid=91863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 15 15:57:36 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c6a141f-57d0-4588-9241-8b958ccf8a9c]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:57:36 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6e4dbd09-09e3-449a-bd38-61b1bd6ef8d2 tempest-GroupsV314Test-2010848967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3f8613b4-a88b-490f-820a-9c3ffe04d407.0e2ad009-318e-4de1-bf7a-a7aff8b2511b {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:57:36 devstack sudo[102280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3f8613b4-a88b-490f-820a-9c3ffe04d407.0e2ad009-318e-4de1-bf7a-a7aff8b2511b
Jun 15 15:57:36 devstack sudo[102280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:57:36 devstack sudo[102280]: pam_unix(sudo:session): session closed for user root
Jun 15 15:57:36 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6e4dbd09-09e3-449a-bd38-61b1bd6ef8d2 tempest-GroupsV314Test-2010848967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3f8613b4-a88b-490f-820a-9c3ffe04d407.0e2ad009-318e-4de1-bf7a-a7aff8b2511b" returned: 0 in 0.731s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:57:36 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-6e4dbd09-09e3-449a-bd38-61b1bd6ef8d2 tempest-GroupsV314Test-2010848967 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f8613b4-a88b-490f-820a-9c3ffe04d407(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 15:57:36 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[06466210-6290-4908-9c05-2326ad8e32c8]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:57:36 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6e4dbd09-09e3-449a-bd38-61b1bd6ef8d2 tempest-GroupsV314Test-2010848967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3f8613b4-a88b-490f-820a-9c3ffe04d407 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:57:37 devstack cinder-volume[91863]: DEBUG dbcounter [-] [91863] Writing DB stats cinder:SELECT=63,cinder:UPDATE=73,cinder:DELETE=6,cinder:INSERT=15 {{(pid=91863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 15:57:37 devstack sudo[102288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3f8613b4-a88b-490f-820a-9c3ffe04d407
Jun 15 15:57:37 devstack sudo[102288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:57:37 devstack sudo[102288]: pam_unix(sudo:session): session closed for user root
Jun 15 15:57:37 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6e4dbd09-09e3-449a-bd38-61b1bd6ef8d2 tempest-GroupsV314Test-2010848967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3f8613b4-a88b-490f-820a-9c3ffe04d407" returned: 0 in 0.736s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:57:37 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6e4dbd09-09e3-449a-bd38-61b1bd6ef8d2 tempest-GroupsV314Test-2010848967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3f8613b4-a88b-490f-820a-9c3ffe04d407.0e2ad009-318e-4de1-bf7a-a7aff8b2511b {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:57:37 devstack sudo[102293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3f8613b4-a88b-490f-820a-9c3ffe04d407.0e2ad009-318e-4de1-bf7a-a7aff8b2511b
Jun 15 15:57:37 devstack sudo[102293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:57:38 devstack sudo[102293]: pam_unix(sudo:session): session closed for user root
Jun 15 15:57:38 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6e4dbd09-09e3-449a-bd38-61b1bd6ef8d2 tempest-GroupsV314Test-2010848967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3f8613b4-a88b-490f-820a-9c3ffe04d407.0e2ad009-318e-4de1-bf7a-a7aff8b2511b" returned: 0 in 0.690s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:57:38 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6e4dbd09-09e3-449a-bd38-61b1bd6ef8d2 tempest-GroupsV314Test-2010848967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3f8613b4-a88b-490f-820a-9c3ffe04d407.0e2ad009-318e-4de1-bf7a-a7aff8b2511b {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:57:38 devstack sudo[102298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3f8613b4-a88b-490f-820a-9c3ffe04d407.0e2ad009-318e-4de1-bf7a-a7aff8b2511b
Jun 15 15:57:38 devstack sudo[102298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:57:39 devstack sudo[102298]: pam_unix(sudo:session): session closed for user root
Jun 15 15:57:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6e4dbd09-09e3-449a-bd38-61b1bd6ef8d2 tempest-GroupsV314Test-2010848967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3f8613b4-a88b-490f-820a-9c3ffe04d407.0e2ad009-318e-4de1-bf7a-a7aff8b2511b" returned: 0 in 0.618s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:57:39 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-6e4dbd09-09e3-449a-bd38-61b1bd6ef8d2 tempest-GroupsV314Test-2010848967 None] Lock "cinder-quobyte-0e2ad009-318e-4de1-bf7a-a7aff8b2511b" released by "_delete_snapshot" :: held 2.871s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:57:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6e4dbd09-09e3-449a-bd38-61b1bd6ef8d2 tempest-GroupsV314Test-2010848967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.021s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:57:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-8ff0e447-a613-4437-b7d1-be3ec4f888e0 tempest-VolumesDeleteCascade-1394360621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.961s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:57:39 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-8ff0e447-a613-4437-b7d1-be3ec4f888e0 tempest-VolumesDeleteCascade-1394360621 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:57:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1925265998',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d18f4ff-f4f7-4ff9-8f69-575332f781ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e918721fd3c4a7d9c7942081403e952',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:57:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:57:27Z,use_quota=True,user_id='ac590f403ee6420ab5ffb13507e21541',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 15:57:39 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-8ff0e447-a613-4437-b7d1-be3ec4f888e0 tempest-VolumesDeleteCascade-1394360621 None] Creating volume 5d18f4ff-f4f7-4ff9-8f69-575332f781ee {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 15:57:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-8ff0e447-a613-4437-b7d1-be3ec4f888e0 tempest-VolumesDeleteCascade-1394360621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:57:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-8ff0e447-a613-4437-b7d1-be3ec4f888e0 tempest-VolumesDeleteCascade-1394360621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:57:39 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-8ff0e447-a613-4437-b7d1-be3ec4f888e0 tempest-VolumesDeleteCascade-1394360621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:57:39 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-8ff0e447-a613-4437-b7d1-be3ec4f888e0 tempest-VolumesDeleteCascade-1394360621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:57:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-8ff0e447-a613-4437-b7d1-be3ec4f888e0 tempest-VolumesDeleteCascade-1394360621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:57:39 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-8ff0e447-a613-4437-b7d1-be3ec4f888e0 tempest-VolumesDeleteCascade-1394360621 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 15:57:39 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-8ff0e447-a613-4437-b7d1-be3ec4f888e0 tempest-VolumesDeleteCascade-1394360621 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 15:57:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-8ff0e447-a613-4437-b7d1-be3ec4f888e0 tempest-VolumesDeleteCascade-1394360621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:57:39 devstack sudo[102301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee 1073741824
Jun 15 15:57:39 devstack sudo[102301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:57:39 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-6e4dbd09-09e3-449a-bd38-61b1bd6ef8d2 tempest-GroupsV314Test-2010848967 None] Create group from source-group-95c1f1c6-347f-4c94-91e2-60719cae21b8 completed successfully.
Jun 15 15:57:39 devstack sudo[102301]: pam_unix(sudo:session): session closed for user root
Jun 15 15:57:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-8ff0e447-a613-4437-b7d1-be3ec4f888e0 tempest-VolumesDeleteCascade-1394360621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee 1073741824" returned: 0 in 0.739s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:57:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-8ff0e447-a613-4437-b7d1-be3ec4f888e0 tempest-VolumesDeleteCascade-1394360621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:57:39 devstack sudo[102306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee
Jun 15 15:57:39 devstack sudo[102306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:57:40 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-3c2dadec-61de-4349-bac5-a27bd087bf56 tempest-GroupsV314Test-2010848967 None] Acquiring lock "cinder-quobyte-815f4862-af8a-4a39-921d-469f4b19fcc8" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:57:40 devstack sudo[102306]: pam_unix(sudo:session): session closed for user root
Jun 15 15:57:40 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-8ff0e447-a613-4437-b7d1-be3ec4f888e0 tempest-VolumesDeleteCascade-1394360621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee" returned: 0 in 0.611s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:57:40 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-8ff0e447-a613-4437-b7d1-be3ec4f888e0 tempest-VolumesDeleteCascade-1394360621 None] <== create_volume: return (1394ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 15:57:40 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-8ff0e447-a613-4437-b7d1-be3ec4f888e0 tempest-VolumesDeleteCascade-1394360621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.398s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:57:40 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-3c2dadec-61de-4349-bac5-a27bd087bf56 tempest-GroupsV314Test-2010848967 None] Lock "cinder-quobyte-815f4862-af8a-4a39-921d-469f4b19fcc8" acquired by "delete_volume" :: waited 0.024s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:57:40 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8ff0e447-a613-4437-b7d1-be3ec4f888e0 tempest-VolumesDeleteCascade-1394360621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b5c407d-0d8f-4adf-9002-f5e38ca8f9ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:57:40 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8ff0e447-a613-4437-b7d1-be3ec4f888e0 tempest-VolumesDeleteCascade-1394360621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (606e41d2-1dc7-40eb-80d8-d631b2f92f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:57:40 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[284b9574-d433-4799-8588-263cf92e1812]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:57:40 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3c2dadec-61de-4349-bac5-a27bd087bf56 tempest-GroupsV314Test-2010848967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-815f4862-af8a-4a39-921d-469f4b19fcc8 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:57:40 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-8ff0e447-a613-4437-b7d1-be3ec4f888e0 tempest-VolumesDeleteCascade-1394360621 None] Volume volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee (5d18f4ff-f4f7-4ff9-8f69-575332f781ee): created successfully
Jun 15 15:57:40 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8ff0e447-a613-4437-b7d1-be3ec4f888e0 tempest-VolumesDeleteCascade-1394360621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (606e41d2-1dc7-40eb-80d8-d631b2f92f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:57:40 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8ff0e447-a613-4437-b7d1-be3ec4f888e0 tempest-VolumesDeleteCascade-1394360621 None] Flow 'volume_create_manager' (fd760d1e-5a59-4aaf-b916-f6df5d5dfe45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:57:40 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-8ff0e447-a613-4437-b7d1-be3ec4f888e0 tempest-VolumesDeleteCascade-1394360621 None] Created volume successfully.
Jun 15 15:57:40 devstack sudo[102309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-815f4862-af8a-4a39-921d-469f4b19fcc8
Jun 15 15:57:40 devstack sudo[102309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:57:41 devstack sudo[102309]: pam_unix(sudo:session): session closed for user root
Jun 15 15:57:41 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3c2dadec-61de-4349-bac5-a27bd087bf56 tempest-GroupsV314Test-2010848967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-815f4862-af8a-4a39-921d-469f4b19fcc8" returned: 0 in 0.740s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:57:41 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3c2dadec-61de-4349-bac5-a27bd087bf56 tempest-GroupsV314Test-2010848967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-815f4862-af8a-4a39-921d-469f4b19fcc8 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:57:41 devstack sudo[102314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-815f4862-af8a-4a39-921d-469f4b19fcc8
Jun 15 15:57:41 devstack sudo[102314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:57:41 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-d3bf6101-de66-4230-b9fb-f5a02120fe9b tempest-VolumesDeleteCascade-1394360621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:57:41 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-d3bf6101-de66-4230-b9fb-f5a02120fe9b tempest-VolumesDeleteCascade-1394360621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:57:41 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-d3bf6101-de66-4230-b9fb-f5a02120fe9b tempest-VolumesDeleteCascade-1394360621 None] Creating offline snapshot 429b5ae9-c4b2-4866-afb7-d36724aef155 of volume 5d18f4ff-f4f7-4ff9-8f69-575332f781ee {{(pid=91863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 15 15:57:41 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b694d6-6dcf-4b45-b2f6-f1b609442e5b]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:57:41 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-d3bf6101-de66-4230-b9fb-f5a02120fe9b tempest-VolumesDeleteCascade-1394360621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:57:41 devstack sudo[102316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee
Jun 15 15:57:41 devstack sudo[102316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:57:42 devstack sudo[102314]: pam_unix(sudo:session): session closed for user root
Jun 15 15:57:42 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3c2dadec-61de-4349-bac5-a27bd087bf56 tempest-GroupsV314Test-2010848967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-815f4862-af8a-4a39-921d-469f4b19fcc8" returned: 0 in 0.805s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:57:42 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-3c2dadec-61de-4349-bac5-a27bd087bf56 tempest-GroupsV314Test-2010848967 None] Lock "cinder-quobyte-815f4862-af8a-4a39-921d-469f4b19fcc8" released by "delete_volume" :: held 1.599s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:57:42 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-3c2dadec-61de-4349-bac5-a27bd087bf56 tempest-GroupsV314Test-2010848967 None] Created reservations ['7b001624-4d97-4400-9f2f-b1e0c6a8633f'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:57:42 devstack cinder-volume[91863]: WARNING cinder.quota [None req-3c2dadec-61de-4349-bac5-a27bd087bf56 tempest-GroupsV314Test-2010848967 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1275909651 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1275909651, it is now deprecated. Please use the default quota class for default quota.
Jun 15 15:57:42 devstack cinder-volume[91863]: WARNING cinder.quota [None req-3c2dadec-61de-4349-bac5-a27bd087bf56 tempest-GroupsV314Test-2010848967 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1275909651 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1275909651, it is now deprecated. Please use the default quota class for default quota.
Jun 15 15:57:42 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-3c2dadec-61de-4349-bac5-a27bd087bf56 tempest-GroupsV314Test-2010848967 None] Created reservations ['67fab057-bd1b-4702-b6c8-5389a4eaf796', 'c99c5fd6-ba28-46ae-84e7-3e3aa607e100', '13ca7284-c458-4a64-a4e9-cce7c6e58744', '5f191138-8aa5-46d8-a740-e77aac35df10'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:57:42 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-3c2dadec-61de-4349-bac5-a27bd087bf56 tempest-GroupsV314Test-2010848967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:57:42 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-3c2dadec-61de-4349-bac5-a27bd087bf56 tempest-GroupsV314Test-2010848967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:57:42 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-3c2dadec-61de-4349-bac5-a27bd087bf56 tempest-GroupsV314Test-2010848967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:57:42 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-3c2dadec-61de-4349-bac5-a27bd087bf56 tempest-GroupsV314Test-2010848967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:57:42 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-3c2dadec-61de-4349-bac5-a27bd087bf56 tempest-GroupsV314Test-2010848967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:57:42 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3c2dadec-61de-4349-bac5-a27bd087bf56 tempest-GroupsV314Test-2010848967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:57:42 devstack sudo[102316]: pam_unix(sudo:session): session closed for user root
Jun 15 15:57:42 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-d3bf6101-de66-4230-b9fb-f5a02120fe9b tempest-VolumesDeleteCascade-1394360621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee" returned: 0 in 0.872s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:57:42 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-d3bf6101-de66-4230-b9fb-f5a02120fe9b tempest-VolumesDeleteCascade-1394360621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee.429b5ae9-c4b2-4866-afb7-d36724aef155 1G {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:57:42 devstack sudo[102322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:57:42 devstack sudo[102322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:57:42 devstack sudo[102323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee.429b5ae9-c4b2-4866-afb7-d36724aef155 1G
Jun 15 15:57:42 devstack sudo[102323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:57:43 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-70e9c323-0f5e-4061-9f80-e1dba8eaefa1 tempest-GroupsV314Test-2010848967 None] Acquiring lock "cinder-quobyte-3f8613b4-a88b-490f-820a-9c3ffe04d407" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:57:43 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-70e9c323-0f5e-4061-9f80-e1dba8eaefa1 tempest-GroupsV314Test-2010848967 None] Lock "cinder-quobyte-3f8613b4-a88b-490f-820a-9c3ffe04d407" acquired by "delete_volume" :: waited 0.019s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:57:43 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6a6f6b-fa98-468b-99f9-9d83b3cfedda]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:57:43 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-70e9c323-0f5e-4061-9f80-e1dba8eaefa1 tempest-GroupsV314Test-2010848967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3f8613b4-a88b-490f-820a-9c3ffe04d407 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:57:43 devstack sudo[102322]: pam_unix(sudo:session): session closed for user root
Jun 15 15:57:43 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3c2dadec-61de-4349-bac5-a27bd087bf56 tempest-GroupsV314Test-2010848967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.809s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:57:43 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-3c2dadec-61de-4349-bac5-a27bd087bf56 tempest-GroupsV314Test-2010848967 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:57:43 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-3c2dadec-61de-4349-bac5-a27bd087bf56 tempest-GroupsV314Test-2010848967 None] Delete group completed successfully.
Jun 15 15:57:43 devstack sudo[102331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3f8613b4-a88b-490f-820a-9c3ffe04d407
Jun 15 15:57:43 devstack sudo[102331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:57:43 devstack sudo[102323]: pam_unix(sudo:session): session closed for user root
Jun 15 15:57:43 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-d3bf6101-de66-4230-b9fb-f5a02120fe9b tempest-VolumesDeleteCascade-1394360621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee.429b5ae9-c4b2-4866-afb7-d36724aef155 1G" returned: 0 in 1.067s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:57:43 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-d3bf6101-de66-4230-b9fb-f5a02120fe9b tempest-VolumesDeleteCascade-1394360621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee.429b5ae9-c4b2-4866-afb7-d36724aef155 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:57:43 devstack sudo[102343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee.429b5ae9-c4b2-4866-afb7-d36724aef155
Jun 15 15:57:43 devstack sudo[102343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:57:43 devstack sudo[102331]: pam_unix(sudo:session): session closed for user root
Jun 15 15:57:43 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-70e9c323-0f5e-4061-9f80-e1dba8eaefa1 tempest-GroupsV314Test-2010848967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3f8613b4-a88b-490f-820a-9c3ffe04d407" returned: 0 in 0.901s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:57:43 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-70e9c323-0f5e-4061-9f80-e1dba8eaefa1 tempest-GroupsV314Test-2010848967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3f8613b4-a88b-490f-820a-9c3ffe04d407 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:57:44 devstack sudo[102358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3f8613b4-a88b-490f-820a-9c3ffe04d407
Jun 15 15:57:44 devstack sudo[102358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:57:44 devstack sudo[102343]: pam_unix(sudo:session): session closed for user root
Jun 15 15:57:44 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-d3bf6101-de66-4230-b9fb-f5a02120fe9b tempest-VolumesDeleteCascade-1394360621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee.429b5ae9-c4b2-4866-afb7-d36724aef155" returned: 0 in 0.691s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:57:44 devstack cinder-volume[91863]: WARNING cinder.volume.drivers.remotefs [None req-d3bf6101-de66-4230-b9fb-f5a02120fe9b tempest-VolumesDeleteCascade-1394360621 None] /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee.429b5ae9-c4b2-4866-afb7-d36724aef155 is being set with open permissions: ugo+rw
Jun 15 15:57:44 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-d3bf6101-de66-4230-b9fb-f5a02120fe9b tempest-VolumesDeleteCascade-1394360621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee.429b5ae9-c4b2-4866-afb7-d36724aef155 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:57:44 devstack sudo[102360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee.429b5ae9-c4b2-4866-afb7-d36724aef155
Jun 15 15:57:44 devstack sudo[102360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:57:44 devstack sudo[102358]: pam_unix(sudo:session): session closed for user root
Jun 15 15:57:44 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-70e9c323-0f5e-4061-9f80-e1dba8eaefa1 tempest-GroupsV314Test-2010848967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-3f8613b4-a88b-490f-820a-9c3ffe04d407" returned: 0 in 0.586s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:57:44 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-70e9c323-0f5e-4061-9f80-e1dba8eaefa1 tempest-GroupsV314Test-2010848967 None] Lock "cinder-quobyte-3f8613b4-a88b-490f-820a-9c3ffe04d407" released by "delete_volume" :: held 1.548s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:57:44 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-70e9c323-0f5e-4061-9f80-e1dba8eaefa1 tempest-GroupsV314Test-2010848967 None] Created reservations ['02603879-cb5c-4716-987e-5fa215bdd695'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:57:44 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-70e9c323-0f5e-4061-9f80-e1dba8eaefa1 tempest-GroupsV314Test-2010848967 None] Created reservations ['196df9ab-82ca-4994-87bf-0696e1cd1162', '1a2896a2-1622-4211-9d9a-a743a8ec8b1a', '6df59ac2-dd9b-4b54-9b02-421bea42357e', '1c7d8773-a603-47cd-9654-7d2f11c8d9a3'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:57:44 devstack sudo[102360]: pam_unix(sudo:session): session closed for user root
Jun 15 15:57:44 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-d3bf6101-de66-4230-b9fb-f5a02120fe9b tempest-VolumesDeleteCascade-1394360621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee.429b5ae9-c4b2-4866-afb7-d36724aef155" returned: 0 in 0.637s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:57:44 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-d3bf6101-de66-4230-b9fb-f5a02120fe9b tempest-VolumesDeleteCascade-1394360621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee.info {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:57:44 devstack sudo[102365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee.info
Jun 15 15:57:44 devstack sudo[102365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:57:44 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-70e9c323-0f5e-4061-9f80-e1dba8eaefa1 tempest-GroupsV314Test-2010848967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:57:44 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-70e9c323-0f5e-4061-9f80-e1dba8eaefa1 tempest-GroupsV314Test-2010848967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:57:44 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-70e9c323-0f5e-4061-9f80-e1dba8eaefa1 tempest-GroupsV314Test-2010848967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:57:44 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-70e9c323-0f5e-4061-9f80-e1dba8eaefa1 tempest-GroupsV314Test-2010848967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:57:44 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-70e9c323-0f5e-4061-9f80-e1dba8eaefa1 tempest-GroupsV314Test-2010848967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:57:44 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-70e9c323-0f5e-4061-9f80-e1dba8eaefa1 tempest-GroupsV314Test-2010848967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:57:44 devstack sudo[102367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:57:44 devstack sudo[102367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:57:45 devstack sudo[102365]: pam_unix(sudo:session): session closed for user root
Jun 15 15:57:45 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-d3bf6101-de66-4230-b9fb-f5a02120fe9b tempest-VolumesDeleteCascade-1394360621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee.info" returned: 0 in 0.669s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:57:45 devstack cinder-volume[91863]: WARNING cinder.volume.drivers.remotefs [None req-d3bf6101-de66-4230-b9fb-f5a02120fe9b tempest-VolumesDeleteCascade-1394360621 None] /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee.info is being set with open permissions: ugo+rw
Jun 15 15:57:45 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-d3bf6101-de66-4230-b9fb-f5a02120fe9b tempest-VolumesDeleteCascade-1394360621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee.info {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:57:45 devstack sudo[102367]: pam_unix(sudo:session): session closed for user root
Jun 15 15:57:45 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-70e9c323-0f5e-4061-9f80-e1dba8eaefa1 tempest-GroupsV314Test-2010848967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.643s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:57:45 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-70e9c323-0f5e-4061-9f80-e1dba8eaefa1 tempest-GroupsV314Test-2010848967 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:57:45 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-70e9c323-0f5e-4061-9f80-e1dba8eaefa1 tempest-GroupsV314Test-2010848967 None] Delete group completed successfully.
Jun 15 15:57:45 devstack sudo[102371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee.info
Jun 15 15:57:45 devstack sudo[102371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:57:46 devstack sudo[102371]: pam_unix(sudo:session): session closed for user root
Jun 15 15:57:46 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-d3bf6101-de66-4230-b9fb-f5a02120fe9b tempest-VolumesDeleteCascade-1394360621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee.info" returned: 0 in 0.652s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:57:46 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-d3bf6101-de66-4230-b9fb-f5a02120fe9b tempest-VolumesDeleteCascade-1394360621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.691s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:57:46 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-d3bf6101-de66-4230-b9fb-f5a02120fe9b tempest-VolumesDeleteCascade-1394360621 None] Create snapshot completed successfully
Jun 15 15:57:46 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-74634ec3-4c32-4ddd-bb4e-f00e69d2b485 tempest-VolumesDeleteCascade-1394360621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:57:46 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-74634ec3-4c32-4ddd-bb4e-f00e69d2b485 tempest-VolumesDeleteCascade-1394360621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:57:46 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-74634ec3-4c32-4ddd-bb4e-f00e69d2b485 tempest-VolumesDeleteCascade-1394360621 None] Creating offline snapshot b25e1e22-c8e6-47a1-a998-c4c929bb7a5a of volume 5d18f4ff-f4f7-4ff9-8f69-575332f781ee {{(pid=91863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 15 15:57:46 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8a547bc-ce86-4029-b9a2-b88898795d17]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:57:46 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-74634ec3-4c32-4ddd-bb4e-f00e69d2b485 tempest-VolumesDeleteCascade-1394360621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee.429b5ae9-c4b2-4866-afb7-d36724aef155 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:57:47 devstack sudo[102378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee.429b5ae9-c4b2-4866-afb7-d36724aef155
Jun 15 15:57:47 devstack sudo[102378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:57:47 devstack sudo[102378]: pam_unix(sudo:session): session closed for user root
Jun 15 15:57:47 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-74634ec3-4c32-4ddd-bb4e-f00e69d2b485 tempest-VolumesDeleteCascade-1394360621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee.429b5ae9-c4b2-4866-afb7-d36724aef155" returned: 0 in 0.767s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:57:47 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-74634ec3-4c32-4ddd-bb4e-f00e69d2b485 tempest-VolumesDeleteCascade-1394360621 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 15:57:47 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-74634ec3-4c32-4ddd-bb4e-f00e69d2b485 tempest-VolumesDeleteCascade-1394360621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee.429b5ae9-c4b2-4866-afb7-d36724aef155,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee.b25e1e22-c8e6-47a1-a998-c4c929bb7a5a 1G {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:57:47 devstack sudo[102384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee.429b5ae9-c4b2-4866-afb7-d36724aef155,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee.b25e1e22-c8e6-47a1-a998-c4c929bb7a5a 1G
Jun 15 15:57:47 devstack sudo[102384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:57:48 devstack sudo[102384]: pam_unix(sudo:session): session closed for user root
Jun 15 15:57:48 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-74634ec3-4c32-4ddd-bb4e-f00e69d2b485 tempest-VolumesDeleteCascade-1394360621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee.429b5ae9-c4b2-4866-afb7-d36724aef155,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee.b25e1e22-c8e6-47a1-a998-c4c929bb7a5a 1G" returned: 0 in 1.238s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:57:48 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-74634ec3-4c32-4ddd-bb4e-f00e69d2b485 tempest-VolumesDeleteCascade-1394360621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee.429b5ae9-c4b2-4866-afb7-d36724aef155 -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee.b25e1e22-c8e6-47a1-a998-c4c929bb7a5a {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:57:49 devstack sudo[102444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee.429b5ae9-c4b2-4866-afb7-d36724aef155 -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee.b25e1e22-c8e6-47a1-a998-c4c929bb7a5a
Jun 15 15:57:49 devstack sudo[102444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:57:49 devstack sudo[102444]: pam_unix(sudo:session): session closed for user root
Jun 15 15:57:49 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-74634ec3-4c32-4ddd-bb4e-f00e69d2b485 tempest-VolumesDeleteCascade-1394360621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee.429b5ae9-c4b2-4866-afb7-d36724aef155 -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee.b25e1e22-c8e6-47a1-a998-c4c929bb7a5a" returned: 0 in 0.940s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:57:49 devstack cinder-volume[91863]: WARNING cinder.volume.drivers.remotefs [None req-74634ec3-4c32-4ddd-bb4e-f00e69d2b485 tempest-VolumesDeleteCascade-1394360621 None] /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee.b25e1e22-c8e6-47a1-a998-c4c929bb7a5a is being set with open permissions: ugo+rw
Jun 15 15:57:49 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-74634ec3-4c32-4ddd-bb4e-f00e69d2b485 tempest-VolumesDeleteCascade-1394360621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee.b25e1e22-c8e6-47a1-a998-c4c929bb7a5a {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:57:49 devstack sudo[102458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee.b25e1e22-c8e6-47a1-a998-c4c929bb7a5a
Jun 15 15:57:49 devstack sudo[102458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:57:50 devstack sudo[102458]: pam_unix(sudo:session): session closed for user root
Jun 15 15:57:50 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-74634ec3-4c32-4ddd-bb4e-f00e69d2b485 tempest-VolumesDeleteCascade-1394360621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee.b25e1e22-c8e6-47a1-a998-c4c929bb7a5a" returned: 0 in 0.753s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:57:50 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-74634ec3-4c32-4ddd-bb4e-f00e69d2b485 tempest-VolumesDeleteCascade-1394360621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.831s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:57:50 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-74634ec3-4c32-4ddd-bb4e-f00e69d2b485 tempest-VolumesDeleteCascade-1394360621 None] Create snapshot completed successfully
Jun 15 15:57:51 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-f1afe46c-8e88-4509-86f4-232dda9be8a9 tempest-VolumesDeleteCascade-1394360621 None] Acquiring lock "cinder-5d18f4ff-f4f7-4ff9-8f69-575332f781ee-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:57:51 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-f1afe46c-8e88-4509-86f4-232dda9be8a9 tempest-VolumesDeleteCascade-1394360621 None] Lock "cinder-5d18f4ff-f4f7-4ff9-8f69-575332f781ee-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:57:51 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-f1afe46c-8e88-4509-86f4-232dda9be8a9 tempest-VolumesDeleteCascade-1394360621 None] Performing cascade delete. {{(pid=91863) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Jun 15 15:57:51 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-f1afe46c-8e88-4509-86f4-232dda9be8a9 tempest-VolumesDeleteCascade-1394360621 None] Acquiring lock "cinder-429b5ae9-c4b2-4866-afb7-d36724aef155-delete_snapshot" by "delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:57:51 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-f1afe46c-8e88-4509-86f4-232dda9be8a9 tempest-VolumesDeleteCascade-1394360621 None] Lock "cinder-429b5ae9-c4b2-4866-afb7-d36724aef155-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:57:51 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-f1afe46c-8e88-4509-86f4-232dda9be8a9 tempest-VolumesDeleteCascade-1394360621 None] Acquiring lock "cinder-quobyte-5d18f4ff-f4f7-4ff9-8f69-575332f781ee" by "delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:57:51 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-f1afe46c-8e88-4509-86f4-232dda9be8a9 tempest-VolumesDeleteCascade-1394360621 None] Lock "cinder-quobyte-5d18f4ff-f4f7-4ff9-8f69-575332f781ee" acquired by "delete_snapshot" :: waited 0.016s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:57:51 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-f1afe46c-8e88-4509-86f4-232dda9be8a9 tempest-VolumesDeleteCascade-1394360621 None] Acquiring lock "cinder-quobyte-429b5ae9-c4b2-4866-afb7-d36724aef155" by "_delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:57:51 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-f1afe46c-8e88-4509-86f4-232dda9be8a9 tempest-VolumesDeleteCascade-1394360621 None] Lock "cinder-quobyte-429b5ae9-c4b2-4866-afb7-d36724aef155" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:57:51 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-f1afe46c-8e88-4509-86f4-232dda9be8a9 tempest-VolumesDeleteCascade-1394360621 None] Deleting offline snapshot 429b5ae9-c4b2-4866-afb7-d36724aef155 of volume 5d18f4ff-f4f7-4ff9-8f69-575332f781ee {{(pid=91863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 15 15:57:51 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-f1afe46c-8e88-4509-86f4-232dda9be8a9 tempest-VolumesDeleteCascade-1394360621 None] snapshot_file for this snap is: volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee.429b5ae9-c4b2-4866-afb7-d36724aef155 {{(pid=91863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 15 15:57:51 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[670cb493-4236-4ab5-8383-f5293888d4ac]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:57:51 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-f1afe46c-8e88-4509-86f4-232dda9be8a9 tempest-VolumesDeleteCascade-1394360621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee.429b5ae9-c4b2-4866-afb7-d36724aef155 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:57:51 devstack sudo[102463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee.429b5ae9-c4b2-4866-afb7-d36724aef155
Jun 15 15:57:51 devstack sudo[102463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:57:52 devstack sudo[102463]: pam_unix(sudo:session): session closed for user root
Jun 15 15:57:52 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-f1afe46c-8e88-4509-86f4-232dda9be8a9 tempest-VolumesDeleteCascade-1394360621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee.429b5ae9-c4b2-4866-afb7-d36724aef155" returned: 0 in 0.846s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:57:52 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-f1afe46c-8e88-4509-86f4-232dda9be8a9 tempest-VolumesDeleteCascade-1394360621 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 15:57:52 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d87b16af-9484-4b82-838e-6446da139573]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:57:52 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-f1afe46c-8e88-4509-86f4-232dda9be8a9 tempest-VolumesDeleteCascade-1394360621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:57:52 devstack sudo[102468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee
Jun 15 15:57:52 devstack sudo[102468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:57:53 devstack sudo[102468]: pam_unix(sudo:session): session closed for user root
Jun 15 15:57:53 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-f1afe46c-8e88-4509-86f4-232dda9be8a9 tempest-VolumesDeleteCascade-1394360621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee" returned: 0 in 1.010s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:57:53 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7425190b-c11d-46a6-8cb2-e81c01215762]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:57:53 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-f1afe46c-8e88-4509-86f4-232dda9be8a9 tempest-VolumesDeleteCascade-1394360621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee.b25e1e22-c8e6-47a1-a998-c4c929bb7a5a {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:57:53 devstack sudo[102474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee.b25e1e22-c8e6-47a1-a998-c4c929bb7a5a
Jun 15 15:57:53 devstack sudo[102474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:57:54 devstack sudo[102474]: pam_unix(sudo:session): session closed for user root
Jun 15 15:57:54 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-f1afe46c-8e88-4509-86f4-232dda9be8a9 tempest-VolumesDeleteCascade-1394360621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee.b25e1e22-c8e6-47a1-a998-c4c929bb7a5a" returned: 0 in 0.906s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:57:54 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-f1afe46c-8e88-4509-86f4-232dda9be8a9 tempest-VolumesDeleteCascade-1394360621 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 15:57:54 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b1b411-68f0-4c5b-9bdd-1d059b0d6d34]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:57:54 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-f1afe46c-8e88-4509-86f4-232dda9be8a9 tempest-VolumesDeleteCascade-1394360621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee.429b5ae9-c4b2-4866-afb7-d36724aef155 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:57:54 devstack sudo[102480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee.429b5ae9-c4b2-4866-afb7-d36724aef155
Jun 15 15:57:54 devstack sudo[102480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:57:55 devstack sudo[102480]: pam_unix(sudo:session): session closed for user root
Jun 15 15:57:55 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-f1afe46c-8e88-4509-86f4-232dda9be8a9 tempest-VolumesDeleteCascade-1394360621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee.429b5ae9-c4b2-4866-afb7-d36724aef155" returned: 0 in 0.996s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:57:55 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-f1afe46c-8e88-4509-86f4-232dda9be8a9 tempest-VolumesDeleteCascade-1394360621 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 15:57:55 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4faf9a4d-b20e-4cba-9cc0-48efeba872e9]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:57:55 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-f1afe46c-8e88-4509-86f4-232dda9be8a9 tempest-VolumesDeleteCascade-1394360621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:57:55 devstack sudo[102488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee
Jun 15 15:57:55 devstack sudo[102488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:57:56 devstack sudo[102488]: pam_unix(sudo:session): session closed for user root
Jun 15 15:57:56 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-f1afe46c-8e88-4509-86f4-232dda9be8a9 tempest-VolumesDeleteCascade-1394360621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee" returned: 0 in 0.786s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:57:56 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-f1afe46c-8e88-4509-86f4-232dda9be8a9 tempest-VolumesDeleteCascade-1394360621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee.429b5ae9-c4b2-4866-afb7-d36724aef155 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:57:56 devstack sudo[102494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee.429b5ae9-c4b2-4866-afb7-d36724aef155
Jun 15 15:57:56 devstack sudo[102494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:57:56 devstack sudo[102494]: pam_unix(sudo:session): session closed for user root
Jun 15 15:57:56 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-f1afe46c-8e88-4509-86f4-232dda9be8a9 tempest-VolumesDeleteCascade-1394360621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee.429b5ae9-c4b2-4866-afb7-d36724aef155" returned: 0 in 0.748s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:57:56 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-f1afe46c-8e88-4509-86f4-232dda9be8a9 tempest-VolumesDeleteCascade-1394360621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee.429b5ae9-c4b2-4866-afb7-d36724aef155 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:57:56 devstack sudo[102499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee.429b5ae9-c4b2-4866-afb7-d36724aef155
Jun 15 15:57:56 devstack sudo[102499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:57:57 devstack sudo[102499]: pam_unix(sudo:session): session closed for user root
Jun 15 15:57:57 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-f1afe46c-8e88-4509-86f4-232dda9be8a9 tempest-VolumesDeleteCascade-1394360621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee.429b5ae9-c4b2-4866-afb7-d36724aef155" returned: 0 in 0.633s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:57:57 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-f1afe46c-8e88-4509-86f4-232dda9be8a9 tempest-VolumesDeleteCascade-1394360621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee.b25e1e22-c8e6-47a1-a998-c4c929bb7a5a -F qcow2 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:57:57 devstack sudo[102502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee.b25e1e22-c8e6-47a1-a998-c4c929bb7a5a -F qcow2
Jun 15 15:57:57 devstack sudo[102502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:57:58 devstack sudo[102502]: pam_unix(sudo:session): session closed for user root
Jun 15 15:57:58 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-f1afe46c-8e88-4509-86f4-232dda9be8a9 tempest-VolumesDeleteCascade-1394360621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee.b25e1e22-c8e6-47a1-a998-c4c929bb7a5a -F qcow2" returned: 0 in 0.708s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:57:58 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-f1afe46c-8e88-4509-86f4-232dda9be8a9 tempest-VolumesDeleteCascade-1394360621 None] Lock "cinder-quobyte-429b5ae9-c4b2-4866-afb7-d36724aef155" released by "_delete_snapshot" :: held 6.884s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:57:58 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-f1afe46c-8e88-4509-86f4-232dda9be8a9 tempest-VolumesDeleteCascade-1394360621 None] Lock "cinder-quobyte-5d18f4ff-f4f7-4ff9-8f69-575332f781ee" released by "delete_snapshot" :: held 6.924s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:57:58 devstack cinder-volume[91863]: DEBUG dbcounter [-] [91863] Writing DB stats cinder:SELECT=87,cinder:UPDATE=103,cinder:INSERT=30,cinder:DELETE=4 {{(pid=91863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 15:57:58 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-f1afe46c-8e88-4509-86f4-232dda9be8a9 tempest-VolumesDeleteCascade-1394360621 None] Created reservations ['f4f2e496-8f3b-498a-a8cb-097bd3db3d95', 'd521846d-a3ce-4c76-afe9-c8234af51ce3', 'bb12756c-8691-44ab-bc74-e34a554875a2', 'd15b2eb9-3d58-47ef-9a05-231140288fff'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:57:58 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-f1afe46c-8e88-4509-86f4-232dda9be8a9 tempest-VolumesDeleteCascade-1394360621 None] Delete snapshot completed successfully.
Jun 15 15:57:58 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-f1afe46c-8e88-4509-86f4-232dda9be8a9 tempest-VolumesDeleteCascade-1394360621 None] Lock "cinder-429b5ae9-c4b2-4866-afb7-d36724aef155-delete_snapshot" released by "delete_snapshot" :: held 7.121s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:57:58 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-f1afe46c-8e88-4509-86f4-232dda9be8a9 tempest-VolumesDeleteCascade-1394360621 None] Acquiring lock "cinder-b25e1e22-c8e6-47a1-a998-c4c929bb7a5a-delete_snapshot" by "delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:57:58 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-f1afe46c-8e88-4509-86f4-232dda9be8a9 tempest-VolumesDeleteCascade-1394360621 None] Lock "cinder-b25e1e22-c8e6-47a1-a998-c4c929bb7a5a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:57:58 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-f1afe46c-8e88-4509-86f4-232dda9be8a9 tempest-VolumesDeleteCascade-1394360621 None] Acquiring lock "cinder-quobyte-5d18f4ff-f4f7-4ff9-8f69-575332f781ee" by "delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:57:58 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-f1afe46c-8e88-4509-86f4-232dda9be8a9 tempest-VolumesDeleteCascade-1394360621 None] Lock "cinder-quobyte-5d18f4ff-f4f7-4ff9-8f69-575332f781ee" acquired by "delete_snapshot" :: waited 0.033s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:57:58 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-f1afe46c-8e88-4509-86f4-232dda9be8a9 tempest-VolumesDeleteCascade-1394360621 None] Acquiring lock "cinder-quobyte-b25e1e22-c8e6-47a1-a998-c4c929bb7a5a" by "_delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:57:58 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-f1afe46c-8e88-4509-86f4-232dda9be8a9 tempest-VolumesDeleteCascade-1394360621 None] Lock "cinder-quobyte-b25e1e22-c8e6-47a1-a998-c4c929bb7a5a" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:57:58 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-f1afe46c-8e88-4509-86f4-232dda9be8a9 tempest-VolumesDeleteCascade-1394360621 None] Deleting offline snapshot b25e1e22-c8e6-47a1-a998-c4c929bb7a5a of volume 5d18f4ff-f4f7-4ff9-8f69-575332f781ee {{(pid=91863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 15 15:57:58 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-f1afe46c-8e88-4509-86f4-232dda9be8a9 tempest-VolumesDeleteCascade-1394360621 None] snapshot_file for this snap is: volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee.b25e1e22-c8e6-47a1-a998-c4c929bb7a5a {{(pid=91863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 15 15:57:58 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e003bac8-79e3-4758-888e-3ff8fbd87fa7]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:57:58 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-f1afe46c-8e88-4509-86f4-232dda9be8a9 tempest-VolumesDeleteCascade-1394360621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee.b25e1e22-c8e6-47a1-a998-c4c929bb7a5a {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:57:58 devstack sudo[102508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee.b25e1e22-c8e6-47a1-a998-c4c929bb7a5a
Jun 15 15:57:58 devstack sudo[102508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:57:59 devstack sudo[102508]: pam_unix(sudo:session): session closed for user root
Jun 15 15:57:59 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-f1afe46c-8e88-4509-86f4-232dda9be8a9 tempest-VolumesDeleteCascade-1394360621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee.b25e1e22-c8e6-47a1-a998-c4c929bb7a5a" returned: 0 in 0.725s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:57:59 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-f1afe46c-8e88-4509-86f4-232dda9be8a9 tempest-VolumesDeleteCascade-1394360621 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 15:57:59 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f34b143-f261-4051-985f-f7d73da3df46]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:57:59 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-f1afe46c-8e88-4509-86f4-232dda9be8a9 tempest-VolumesDeleteCascade-1394360621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:57:59 devstack sudo[102513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee
Jun 15 15:57:59 devstack sudo[102513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:58:00 devstack sudo[102513]: pam_unix(sudo:session): session closed for user root
Jun 15 15:58:00 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-f1afe46c-8e88-4509-86f4-232dda9be8a9 tempest-VolumesDeleteCascade-1394360621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee" returned: 0 in 0.736s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:58:00 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-f1afe46c-8e88-4509-86f4-232dda9be8a9 tempest-VolumesDeleteCascade-1394360621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee.b25e1e22-c8e6-47a1-a998-c4c929bb7a5a {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:58:00 devstack sudo[102518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee.b25e1e22-c8e6-47a1-a998-c4c929bb7a5a
Jun 15 15:58:00 devstack sudo[102518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:58:00 devstack sudo[102518]: pam_unix(sudo:session): session closed for user root
Jun 15 15:58:00 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-f1afe46c-8e88-4509-86f4-232dda9be8a9 tempest-VolumesDeleteCascade-1394360621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee.b25e1e22-c8e6-47a1-a998-c4c929bb7a5a" returned: 0 in 0.738s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:58:00 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-f1afe46c-8e88-4509-86f4-232dda9be8a9 tempest-VolumesDeleteCascade-1394360621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee.b25e1e22-c8e6-47a1-a998-c4c929bb7a5a {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:58:00 devstack sudo[102523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee.b25e1e22-c8e6-47a1-a998-c4c929bb7a5a
Jun 15 15:58:00 devstack sudo[102523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:58:01 devstack sudo[102523]: pam_unix(sudo:session): session closed for user root
Jun 15 15:58:01 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-f1afe46c-8e88-4509-86f4-232dda9be8a9 tempest-VolumesDeleteCascade-1394360621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee.b25e1e22-c8e6-47a1-a998-c4c929bb7a5a" returned: 0 in 0.578s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:58:01 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-f1afe46c-8e88-4509-86f4-232dda9be8a9 tempest-VolumesDeleteCascade-1394360621 None] Lock "cinder-quobyte-b25e1e22-c8e6-47a1-a998-c4c929bb7a5a" released by "_delete_snapshot" :: held 2.904s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:58:01 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-f1afe46c-8e88-4509-86f4-232dda9be8a9 tempest-VolumesDeleteCascade-1394360621 None] Lock "cinder-quobyte-5d18f4ff-f4f7-4ff9-8f69-575332f781ee" released by "delete_snapshot" :: held 2.937s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:58:01 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-f1afe46c-8e88-4509-86f4-232dda9be8a9 tempest-VolumesDeleteCascade-1394360621 None] Created reservations ['a402ed05-c0c2-4958-8f54-b5a323ae1090', '11a72167-ea62-4bb7-8afd-cb82eff0bced', '3c9c61e9-5344-4604-becc-7454d5a861bf', '51afd647-f176-494b-9a62-7f3e21619749'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:58:01 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-f1afe46c-8e88-4509-86f4-232dda9be8a9 tempest-VolumesDeleteCascade-1394360621 None] Delete snapshot completed successfully.
Jun 15 15:58:01 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-f1afe46c-8e88-4509-86f4-232dda9be8a9 tempest-VolumesDeleteCascade-1394360621 None] Lock "cinder-b25e1e22-c8e6-47a1-a998-c4c929bb7a5a-delete_snapshot" released by "delete_snapshot" :: held 3.102s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:58:01 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-f1afe46c-8e88-4509-86f4-232dda9be8a9 tempest-VolumesDeleteCascade-1394360621 None] Snapshots deleted, issuing volume delete {{(pid=91863) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Jun 15 15:58:01 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-f1afe46c-8e88-4509-86f4-232dda9be8a9 tempest-VolumesDeleteCascade-1394360621 None] Acquiring lock "cinder-quobyte-5d18f4ff-f4f7-4ff9-8f69-575332f781ee" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:58:01 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-f1afe46c-8e88-4509-86f4-232dda9be8a9 tempest-VolumesDeleteCascade-1394360621 None] Lock "cinder-quobyte-5d18f4ff-f4f7-4ff9-8f69-575332f781ee" acquired by "delete_volume" :: waited 0.015s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:58:01 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec2b2eb-627f-4adc-a92c-f1e0857db5f8]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:58:01 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-f1afe46c-8e88-4509-86f4-232dda9be8a9 tempest-VolumesDeleteCascade-1394360621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:58:01 devstack sudo[102526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee
Jun 15 15:58:01 devstack sudo[102526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:58:02 devstack sudo[102526]: pam_unix(sudo:session): session closed for user root
Jun 15 15:58:02 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-f1afe46c-8e88-4509-86f4-232dda9be8a9 tempest-VolumesDeleteCascade-1394360621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee" returned: 0 in 0.834s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:58:02 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-f1afe46c-8e88-4509-86f4-232dda9be8a9 tempest-VolumesDeleteCascade-1394360621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:58:02 devstack sudo[102557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee
Jun 15 15:58:02 devstack sudo[102557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:58:03 devstack sudo[102557]: pam_unix(sudo:session): session closed for user root
Jun 15 15:58:03 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-f1afe46c-8e88-4509-86f4-232dda9be8a9 tempest-VolumesDeleteCascade-1394360621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5d18f4ff-f4f7-4ff9-8f69-575332f781ee" returned: 0 in 0.602s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:58:03 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-f1afe46c-8e88-4509-86f4-232dda9be8a9 tempest-VolumesDeleteCascade-1394360621 None] Lock "cinder-quobyte-5d18f4ff-f4f7-4ff9-8f69-575332f781ee" released by "delete_volume" :: held 1.533s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:58:03 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-f1afe46c-8e88-4509-86f4-232dda9be8a9 tempest-VolumesDeleteCascade-1394360621 None] Created reservations ['43124a30-1922-47c4-928b-3c1f2efe5a5f', 'c677231e-0775-4135-9097-dfaa5dfe1eb5', 'ff5f0c9b-be1a-411b-8300-78177a16d02d', '64a654a8-b2e1-4b7c-a194-a6e96499c153'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:58:03 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-f1afe46c-8e88-4509-86f4-232dda9be8a9 tempest-VolumesDeleteCascade-1394360621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:58:03 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-f1afe46c-8e88-4509-86f4-232dda9be8a9 tempest-VolumesDeleteCascade-1394360621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:58:03 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-f1afe46c-8e88-4509-86f4-232dda9be8a9 tempest-VolumesDeleteCascade-1394360621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:58:03 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-f1afe46c-8e88-4509-86f4-232dda9be8a9 tempest-VolumesDeleteCascade-1394360621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:58:03 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-f1afe46c-8e88-4509-86f4-232dda9be8a9 tempest-VolumesDeleteCascade-1394360621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:58:03 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-f1afe46c-8e88-4509-86f4-232dda9be8a9 tempest-VolumesDeleteCascade-1394360621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:58:03 devstack sudo[102561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:58:03 devstack sudo[102561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:58:03 devstack sudo[102561]: pam_unix(sudo:session): session closed for user root
Jun 15 15:58:03 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-f1afe46c-8e88-4509-86f4-232dda9be8a9 tempest-VolumesDeleteCascade-1394360621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.635s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:58:03 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-f1afe46c-8e88-4509-86f4-232dda9be8a9 tempest-VolumesDeleteCascade-1394360621 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:58:03 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-f1afe46c-8e88-4509-86f4-232dda9be8a9 tempest-VolumesDeleteCascade-1394360621 None] Deleted volume successfully.
Jun 15 15:58:03 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-f1afe46c-8e88-4509-86f4-232dda9be8a9 tempest-VolumesDeleteCascade-1394360621 None] Lock "cinder-5d18f4ff-f4f7-4ff9-8f69-575332f781ee-delete_volume" released by "delete_volume" :: held 12.748s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:58:05 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-e435ba34-0bb3-40b5-884d-8e778bb56187 tempest-VolumesDeleteCascade-1394360621 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 15:58:05 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e435ba34-0bb3-40b5-884d-8e778bb56187 tempest-VolumesDeleteCascade-1394360621 None] Flow 'volume_create_manager' (994fbf2c-5fff-4d46-b9f9-da61ced58533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:58:05 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e435ba34-0bb3-40b5-884d-8e778bb56187 tempest-VolumesDeleteCascade-1394360621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99983133-7349-4373-a977-0526f6e49d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:58:05 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e435ba34-0bb3-40b5-884d-8e778bb56187 tempest-VolumesDeleteCascade-1394360621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99983133-7349-4373-a977-0526f6e49d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:58:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-577875868',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36b3ad73-a085-4d2b-ae1c-1538cf3e9af6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e918721fd3c4a7d9c7942081403e952',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:58:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:58:05Z,use_quota=True,user_id='ac590f403ee6420ab5ffb13507e21541',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:58:05 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e435ba34-0bb3-40b5-884d-8e778bb56187 tempest-VolumesDeleteCascade-1394360621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25af4d14-f209-4364-8de7-4cc74ef1f9fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:58:05 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e435ba34-0bb3-40b5-884d-8e778bb56187 tempest-VolumesDeleteCascade-1394360621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25af4d14-f209-4364-8de7-4cc74ef1f9fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:58:05 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e435ba34-0bb3-40b5-884d-8e778bb56187 tempest-VolumesDeleteCascade-1394360621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f566f16-62bc-44fe-b48f-959c76c7b0b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:58:05 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e435ba34-0bb3-40b5-884d-8e778bb56187 tempest-VolumesDeleteCascade-1394360621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f566f16-62bc-44fe-b48f-959c76c7b0b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36b3ad73-a085-4d2b-ae1c-1538cf3e9af6', 'volume_name': 'volume-36b3ad73-a085-4d2b-ae1c-1538cf3e9af6', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:58:05 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e435ba34-0bb3-40b5-884d-8e778bb56187 tempest-VolumesDeleteCascade-1394360621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8461482b-8ff0-4f39-9175-0e691309a340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:58:05 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e435ba34-0bb3-40b5-884d-8e778bb56187 tempest-VolumesDeleteCascade-1394360621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8461482b-8ff0-4f39-9175-0e691309a340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:58:05 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e435ba34-0bb3-40b5-884d-8e778bb56187 tempest-VolumesDeleteCascade-1394360621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d415327-bd83-4712-b180-9d710d908790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:58:05 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-e435ba34-0bb3-40b5-884d-8e778bb56187 tempest-VolumesDeleteCascade-1394360621 None] Volume 36b3ad73-a085-4d2b-ae1c-1538cf3e9af6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36b3ad73-a085-4d2b-ae1c-1538cf3e9af6', 'volume_size': 1}
Jun 15 15:58:05 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-e435ba34-0bb3-40b5-884d-8e778bb56187 tempest-VolumesDeleteCascade-1394360621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:58:05 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-e435ba34-0bb3-40b5-884d-8e778bb56187 tempest-VolumesDeleteCascade-1394360621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:58:05 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-e435ba34-0bb3-40b5-884d-8e778bb56187 tempest-VolumesDeleteCascade-1394360621 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:58:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-577875868',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36b3ad73-a085-4d2b-ae1c-1538cf3e9af6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e918721fd3c4a7d9c7942081403e952',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:58:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:58:05Z,use_quota=True,user_id='ac590f403ee6420ab5ffb13507e21541',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 15:58:05 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-e435ba34-0bb3-40b5-884d-8e778bb56187 tempest-VolumesDeleteCascade-1394360621 None] Creating volume 36b3ad73-a085-4d2b-ae1c-1538cf3e9af6 {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 15:58:05 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-e435ba34-0bb3-40b5-884d-8e778bb56187 tempest-VolumesDeleteCascade-1394360621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:58:05 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-e435ba34-0bb3-40b5-884d-8e778bb56187 tempest-VolumesDeleteCascade-1394360621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:58:05 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-e435ba34-0bb3-40b5-884d-8e778bb56187 tempest-VolumesDeleteCascade-1394360621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:58:05 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-e435ba34-0bb3-40b5-884d-8e778bb56187 tempest-VolumesDeleteCascade-1394360621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:58:05 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-e435ba34-0bb3-40b5-884d-8e778bb56187 tempest-VolumesDeleteCascade-1394360621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:58:05 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-e435ba34-0bb3-40b5-884d-8e778bb56187 tempest-VolumesDeleteCascade-1394360621 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 15:58:05 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-e435ba34-0bb3-40b5-884d-8e778bb56187 tempest-VolumesDeleteCascade-1394360621 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 15:58:05 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-e435ba34-0bb3-40b5-884d-8e778bb56187 tempest-VolumesDeleteCascade-1394360621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36b3ad73-a085-4d2b-ae1c-1538cf3e9af6 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:58:05 devstack sudo[102572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36b3ad73-a085-4d2b-ae1c-1538cf3e9af6 1073741824
Jun 15 15:58:05 devstack sudo[102572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:58:05 devstack sudo[102572]: pam_unix(sudo:session): session closed for user root
Jun 15 15:58:05 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-e435ba34-0bb3-40b5-884d-8e778bb56187 tempest-VolumesDeleteCascade-1394360621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36b3ad73-a085-4d2b-ae1c-1538cf3e9af6 1073741824" returned: 0 in 0.816s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:58:06 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-e435ba34-0bb3-40b5-884d-8e778bb56187 tempest-VolumesDeleteCascade-1394360621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36b3ad73-a085-4d2b-ae1c-1538cf3e9af6 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:58:06 devstack sudo[102578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36b3ad73-a085-4d2b-ae1c-1538cf3e9af6
Jun 15 15:58:06 devstack sudo[102578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:58:06 devstack sudo[102578]: pam_unix(sudo:session): session closed for user root
Jun 15 15:58:06 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-e435ba34-0bb3-40b5-884d-8e778bb56187 tempest-VolumesDeleteCascade-1394360621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36b3ad73-a085-4d2b-ae1c-1538cf3e9af6" returned: 0 in 0.616s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:58:06 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-e435ba34-0bb3-40b5-884d-8e778bb56187 tempest-VolumesDeleteCascade-1394360621 None] <== create_volume: return (1472ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 15:58:06 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-e435ba34-0bb3-40b5-884d-8e778bb56187 tempest-VolumesDeleteCascade-1394360621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.475s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:58:06 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e435ba34-0bb3-40b5-884d-8e778bb56187 tempest-VolumesDeleteCascade-1394360621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d415327-bd83-4712-b180-9d710d908790) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36b3ad73-a085-4d2b-ae1c-1538cf3e9af6', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:58:06 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e435ba34-0bb3-40b5-884d-8e778bb56187 tempest-VolumesDeleteCascade-1394360621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (440a1b46-8e81-47d2-8609-d07b153a9af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:58:06 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-e435ba34-0bb3-40b5-884d-8e778bb56187 tempest-VolumesDeleteCascade-1394360621 None] Volume volume-36b3ad73-a085-4d2b-ae1c-1538cf3e9af6 (36b3ad73-a085-4d2b-ae1c-1538cf3e9af6): created successfully
Jun 15 15:58:06 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e435ba34-0bb3-40b5-884d-8e778bb56187 tempest-VolumesDeleteCascade-1394360621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (440a1b46-8e81-47d2-8609-d07b153a9af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:58:06 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e435ba34-0bb3-40b5-884d-8e778bb56187 tempest-VolumesDeleteCascade-1394360621 None] Flow 'volume_create_manager' (994fbf2c-5fff-4d46-b9f9-da61ced58533) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:58:06 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-e435ba34-0bb3-40b5-884d-8e778bb56187 tempest-VolumesDeleteCascade-1394360621 None] Created volume successfully.
Jun 15 15:58:07 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-7d0f0552-b9c9-4c08-90eb-339cde9ae2b3 tempest-VolumesDeleteCascade-1394360621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:58:07 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-7d0f0552-b9c9-4c08-90eb-339cde9ae2b3 tempest-VolumesDeleteCascade-1394360621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:58:07 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-7d0f0552-b9c9-4c08-90eb-339cde9ae2b3 tempest-VolumesDeleteCascade-1394360621 None] Creating offline snapshot 4a863a9d-1ffc-4e64-9565-dc8158b0bd9e of volume 36b3ad73-a085-4d2b-ae1c-1538cf3e9af6 {{(pid=91863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 15 15:58:07 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8033c9f6-3eee-4a2b-9442-1ae2692e2bcc]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:58:07 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-7d0f0552-b9c9-4c08-90eb-339cde9ae2b3 tempest-VolumesDeleteCascade-1394360621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36b3ad73-a085-4d2b-ae1c-1538cf3e9af6 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:58:07 devstack sudo[102581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36b3ad73-a085-4d2b-ae1c-1538cf3e9af6
Jun 15 15:58:07 devstack sudo[102581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:58:08 devstack sudo[102581]: pam_unix(sudo:session): session closed for user root
Jun 15 15:58:08 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-7d0f0552-b9c9-4c08-90eb-339cde9ae2b3 tempest-VolumesDeleteCascade-1394360621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36b3ad73-a085-4d2b-ae1c-1538cf3e9af6" returned: 0 in 0.708s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:58:08 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-7d0f0552-b9c9-4c08-90eb-339cde9ae2b3 tempest-VolumesDeleteCascade-1394360621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36b3ad73-a085-4d2b-ae1c-1538cf3e9af6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36b3ad73-a085-4d2b-ae1c-1538cf3e9af6.4a863a9d-1ffc-4e64-9565-dc8158b0bd9e 1G {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:58:08 devstack sudo[102587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36b3ad73-a085-4d2b-ae1c-1538cf3e9af6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36b3ad73-a085-4d2b-ae1c-1538cf3e9af6.4a863a9d-1ffc-4e64-9565-dc8158b0bd9e 1G
Jun 15 15:58:08 devstack sudo[102587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:58:08 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-79740516-382e-4942-8e31-7bd81fbfabac tempest-VolumeTypesAccessTest-1951882040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 15:58:08 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-79740516-382e-4942-8e31-7bd81fbfabac tempest-VolumeTypesAccessTest-1951882040 None] Flow 'volume_create_manager' (91ba223c-4c91-42cb-bc7c-1980b51fe311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:58:08 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-79740516-382e-4942-8e31-7bd81fbfabac tempest-VolumeTypesAccessTest-1951882040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b13a843-0c84-4a06-a67a-46f838746fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:58:08 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-79740516-382e-4942-8e31-7bd81fbfabac tempest-VolumeTypesAccessTest-1951882040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b13a843-0c84-4a06-a67a-46f838746fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:58:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1444073242',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=558d6c65-5cea-4a23-8a43-57a80fc48074,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94a7a305329348ef9c941f459fe99fdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:58:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:58:08Z,use_quota=True,user_id='6aa677c3a69848c8b8785b682b7dcebb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2fe25172-9347-4ae0-8c6b-9d168757999a),volume_type_id=2fe25172-9347-4ae0-8c6b-9d168757999a)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:58:08 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-79740516-382e-4942-8e31-7bd81fbfabac tempest-VolumeTypesAccessTest-1951882040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9d581ae-dd58-4de4-815c-6bd254db78b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:58:08 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-79740516-382e-4942-8e31-7bd81fbfabac tempest-VolumeTypesAccessTest-1951882040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9d581ae-dd58-4de4-815c-6bd254db78b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:58:08 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-79740516-382e-4942-8e31-7bd81fbfabac tempest-VolumeTypesAccessTest-1951882040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ae1fb83-39d1-463c-92f3-aeef95ebafc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:58:08 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-79740516-382e-4942-8e31-7bd81fbfabac tempest-VolumeTypesAccessTest-1951882040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ae1fb83-39d1-463c-92f3-aeef95ebafc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '558d6c65-5cea-4a23-8a43-57a80fc48074', 'volume_name': 'volume-558d6c65-5cea-4a23-8a43-57a80fc48074', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:58:08 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-79740516-382e-4942-8e31-7bd81fbfabac tempest-VolumeTypesAccessTest-1951882040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0116be18-6062-4d95-bdab-615a29b2b092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:58:08 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-79740516-382e-4942-8e31-7bd81fbfabac tempest-VolumeTypesAccessTest-1951882040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0116be18-6062-4d95-bdab-615a29b2b092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:58:08 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-79740516-382e-4942-8e31-7bd81fbfabac tempest-VolumeTypesAccessTest-1951882040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87dcf356-454f-435a-9ee8-ec3c299c8d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:58:08 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-79740516-382e-4942-8e31-7bd81fbfabac tempest-VolumeTypesAccessTest-1951882040 None] Volume 558d6c65-5cea-4a23-8a43-57a80fc48074: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-558d6c65-5cea-4a23-8a43-57a80fc48074', 'volume_size': 1}
Jun 15 15:58:08 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-79740516-382e-4942-8e31-7bd81fbfabac tempest-VolumeTypesAccessTest-1951882040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:58:08 devstack sudo[102587]: pam_unix(sudo:session): session closed for user root
Jun 15 15:58:08 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-7d0f0552-b9c9-4c08-90eb-339cde9ae2b3 tempest-VolumesDeleteCascade-1394360621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36b3ad73-a085-4d2b-ae1c-1538cf3e9af6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36b3ad73-a085-4d2b-ae1c-1538cf3e9af6.4a863a9d-1ffc-4e64-9565-dc8158b0bd9e 1G" returned: 0 in 0.787s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:58:08 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-7d0f0552-b9c9-4c08-90eb-339cde9ae2b3 tempest-VolumesDeleteCascade-1394360621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36b3ad73-a085-4d2b-ae1c-1538cf3e9af6 -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36b3ad73-a085-4d2b-ae1c-1538cf3e9af6.4a863a9d-1ffc-4e64-9565-dc8158b0bd9e {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:58:08 devstack sudo[102593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36b3ad73-a085-4d2b-ae1c-1538cf3e9af6 -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36b3ad73-a085-4d2b-ae1c-1538cf3e9af6.4a863a9d-1ffc-4e64-9565-dc8158b0bd9e
Jun 15 15:58:08 devstack sudo[102593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:58:09 devstack sudo[102593]: pam_unix(sudo:session): session closed for user root
Jun 15 15:58:09 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-7d0f0552-b9c9-4c08-90eb-339cde9ae2b3 tempest-VolumesDeleteCascade-1394360621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36b3ad73-a085-4d2b-ae1c-1538cf3e9af6 -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36b3ad73-a085-4d2b-ae1c-1538cf3e9af6.4a863a9d-1ffc-4e64-9565-dc8158b0bd9e" returned: 0 in 0.650s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:58:09 devstack cinder-volume[91863]: WARNING cinder.volume.drivers.remotefs [None req-7d0f0552-b9c9-4c08-90eb-339cde9ae2b3 tempest-VolumesDeleteCascade-1394360621 None] /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36b3ad73-a085-4d2b-ae1c-1538cf3e9af6.4a863a9d-1ffc-4e64-9565-dc8158b0bd9e is being set with open permissions: ugo+rw
Jun 15 15:58:09 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-7d0f0552-b9c9-4c08-90eb-339cde9ae2b3 tempest-VolumesDeleteCascade-1394360621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36b3ad73-a085-4d2b-ae1c-1538cf3e9af6.4a863a9d-1ffc-4e64-9565-dc8158b0bd9e {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:58:09 devstack sudo[102598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36b3ad73-a085-4d2b-ae1c-1538cf3e9af6.4a863a9d-1ffc-4e64-9565-dc8158b0bd9e
Jun 15 15:58:09 devstack sudo[102598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:58:10 devstack sudo[102598]: pam_unix(sudo:session): session closed for user root
Jun 15 15:58:10 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-7d0f0552-b9c9-4c08-90eb-339cde9ae2b3 tempest-VolumesDeleteCascade-1394360621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36b3ad73-a085-4d2b-ae1c-1538cf3e9af6.4a863a9d-1ffc-4e64-9565-dc8158b0bd9e" returned: 0 in 0.586s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:58:10 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-7d0f0552-b9c9-4c08-90eb-339cde9ae2b3 tempest-VolumesDeleteCascade-1394360621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36b3ad73-a085-4d2b-ae1c-1538cf3e9af6.info {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:58:10 devstack sudo[102601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36b3ad73-a085-4d2b-ae1c-1538cf3e9af6.info
Jun 15 15:58:10 devstack sudo[102601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:58:10 devstack sudo[102601]: pam_unix(sudo:session): session closed for user root
Jun 15 15:58:10 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-7d0f0552-b9c9-4c08-90eb-339cde9ae2b3 tempest-VolumesDeleteCascade-1394360621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36b3ad73-a085-4d2b-ae1c-1538cf3e9af6.info" returned: 0 in 0.656s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:58:10 devstack cinder-volume[91863]: WARNING cinder.volume.drivers.remotefs [None req-7d0f0552-b9c9-4c08-90eb-339cde9ae2b3 tempest-VolumesDeleteCascade-1394360621 None] /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36b3ad73-a085-4d2b-ae1c-1538cf3e9af6.info is being set with open permissions: ugo+rw
Jun 15 15:58:10 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-7d0f0552-b9c9-4c08-90eb-339cde9ae2b3 tempest-VolumesDeleteCascade-1394360621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36b3ad73-a085-4d2b-ae1c-1538cf3e9af6.info {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:58:10 devstack sudo[102604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36b3ad73-a085-4d2b-ae1c-1538cf3e9af6.info
Jun 15 15:58:10 devstack sudo[102604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:58:11 devstack sudo[102604]: pam_unix(sudo:session): session closed for user root
Jun 15 15:58:11 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-7d0f0552-b9c9-4c08-90eb-339cde9ae2b3 tempest-VolumesDeleteCascade-1394360621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36b3ad73-a085-4d2b-ae1c-1538cf3e9af6.info" returned: 0 in 0.631s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:58:11 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-7d0f0552-b9c9-4c08-90eb-339cde9ae2b3 tempest-VolumesDeleteCascade-1394360621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.107s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:58:11 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-79740516-382e-4942-8e31-7bd81fbfabac tempest-VolumeTypesAccessTest-1951882040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.153s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:58:11 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-79740516-382e-4942-8e31-7bd81fbfabac tempest-VolumeTypesAccessTest-1951882040 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:58:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1444073242',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=558d6c65-5cea-4a23-8a43-57a80fc48074,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94a7a305329348ef9c941f459fe99fdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:58:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:58:08Z,use_quota=True,user_id='6aa677c3a69848c8b8785b682b7dcebb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2fe25172-9347-4ae0-8c6b-9d168757999a),volume_type_id=2fe25172-9347-4ae0-8c6b-9d168757999a)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 15:58:11 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-79740516-382e-4942-8e31-7bd81fbfabac tempest-VolumeTypesAccessTest-1951882040 None] Creating volume 558d6c65-5cea-4a23-8a43-57a80fc48074 {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 15:58:11 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-79740516-382e-4942-8e31-7bd81fbfabac tempest-VolumeTypesAccessTest-1951882040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:58:11 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-79740516-382e-4942-8e31-7bd81fbfabac tempest-VolumeTypesAccessTest-1951882040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:58:11 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-79740516-382e-4942-8e31-7bd81fbfabac tempest-VolumeTypesAccessTest-1951882040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:58:11 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-79740516-382e-4942-8e31-7bd81fbfabac tempest-VolumeTypesAccessTest-1951882040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:58:11 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-79740516-382e-4942-8e31-7bd81fbfabac tempest-VolumeTypesAccessTest-1951882040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:58:11 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-79740516-382e-4942-8e31-7bd81fbfabac tempest-VolumeTypesAccessTest-1951882040 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 15:58:11 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-79740516-382e-4942-8e31-7bd81fbfabac tempest-VolumeTypesAccessTest-1951882040 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 15:58:11 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-79740516-382e-4942-8e31-7bd81fbfabac tempest-VolumeTypesAccessTest-1951882040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-558d6c65-5cea-4a23-8a43-57a80fc48074 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:58:11 devstack sudo[102607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-558d6c65-5cea-4a23-8a43-57a80fc48074 1073741824
Jun 15 15:58:11 devstack sudo[102607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:58:11 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-7d0f0552-b9c9-4c08-90eb-339cde9ae2b3 tempest-VolumesDeleteCascade-1394360621 None] Create snapshot completed successfully
Jun 15 15:58:12 devstack sudo[102607]: pam_unix(sudo:session): session closed for user root
Jun 15 15:58:12 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-79740516-382e-4942-8e31-7bd81fbfabac tempest-VolumeTypesAccessTest-1951882040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-558d6c65-5cea-4a23-8a43-57a80fc48074 1073741824" returned: 0 in 0.803s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:58:12 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-79740516-382e-4942-8e31-7bd81fbfabac tempest-VolumeTypesAccessTest-1951882040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-558d6c65-5cea-4a23-8a43-57a80fc48074 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:58:12 devstack sudo[102612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-558d6c65-5cea-4a23-8a43-57a80fc48074
Jun 15 15:58:12 devstack sudo[102612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:58:12 devstack sudo[102612]: pam_unix(sudo:session): session closed for user root
Jun 15 15:58:12 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-79740516-382e-4942-8e31-7bd81fbfabac tempest-VolumeTypesAccessTest-1951882040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-558d6c65-5cea-4a23-8a43-57a80fc48074" returned: 0 in 0.633s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:58:12 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-79740516-382e-4942-8e31-7bd81fbfabac tempest-VolumeTypesAccessTest-1951882040 None] <== create_volume: return (1473ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 15:58:12 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-79740516-382e-4942-8e31-7bd81fbfabac tempest-VolumeTypesAccessTest-1951882040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.477s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:58:12 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-79740516-382e-4942-8e31-7bd81fbfabac tempest-VolumeTypesAccessTest-1951882040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87dcf356-454f-435a-9ee8-ec3c299c8d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-558d6c65-5cea-4a23-8a43-57a80fc48074', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:58:12 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-79740516-382e-4942-8e31-7bd81fbfabac tempest-VolumeTypesAccessTest-1951882040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adad4ff6-00bb-4a87-a47f-f1347e4b5365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:58:12 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-79740516-382e-4942-8e31-7bd81fbfabac tempest-VolumeTypesAccessTest-1951882040 None] Volume volume-558d6c65-5cea-4a23-8a43-57a80fc48074 (558d6c65-5cea-4a23-8a43-57a80fc48074): created successfully
Jun 15 15:58:12 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-79740516-382e-4942-8e31-7bd81fbfabac tempest-VolumeTypesAccessTest-1951882040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adad4ff6-00bb-4a87-a47f-f1347e4b5365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:58:12 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-79740516-382e-4942-8e31-7bd81fbfabac tempest-VolumeTypesAccessTest-1951882040 None] Flow 'volume_create_manager' (91ba223c-4c91-42cb-bc7c-1980b51fe311) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:58:12 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-79740516-382e-4942-8e31-7bd81fbfabac tempest-VolumeTypesAccessTest-1951882040 None] Created volume successfully.
Jun 15 15:58:12 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b34c8db-1ddd-4915-a581-085e028d3c2b tempest-VolumesDeleteCascade-1394360621 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 15:58:12 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-7b34c8db-1ddd-4915-a581-085e028d3c2b tempest-VolumesDeleteCascade-1394360621 None] Flow 'volume_create_manager' (1646a589-ddf6-4a8b-840a-1bdd5541f779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:58:12 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-7b34c8db-1ddd-4915-a581-085e028d3c2b tempest-VolumesDeleteCascade-1394360621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce66532f-559e-48a7-aba4-49764850d02f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:58:13 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-7b34c8db-1ddd-4915-a581-085e028d3c2b tempest-VolumesDeleteCascade-1394360621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce66532f-559e-48a7-aba4-49764850d02f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:58:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-451764758',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c48f079-0119-412c-bed3-cddae109e14e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e918721fd3c4a7d9c7942081403e952',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:58:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4a863a9d-1ffc-4e64-9565-dc8158b0bd9e,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:58:13Z,use_quota=True,user_id='ac590f403ee6420ab5ffb13507e21541',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:58:13 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-7b34c8db-1ddd-4915-a581-085e028d3c2b tempest-VolumesDeleteCascade-1394360621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a407d4a5-f3aa-46bf-8927-6d684495cbcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:58:13 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-7b34c8db-1ddd-4915-a581-085e028d3c2b tempest-VolumesDeleteCascade-1394360621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a407d4a5-f3aa-46bf-8927-6d684495cbcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:58:13 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-7b34c8db-1ddd-4915-a581-085e028d3c2b tempest-VolumesDeleteCascade-1394360621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0b280d3-443c-4ba1-8403-4e7026699875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:58:13 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-7b34c8db-1ddd-4915-a581-085e028d3c2b tempest-VolumesDeleteCascade-1394360621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0b280d3-443c-4ba1-8403-4e7026699875) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4c48f079-0119-412c-bed3-cddae109e14e', 'volume_name': 'volume-4c48f079-0119-412c-bed3-cddae109e14e', 'volume_size': 1, 'snapshot_id': '4a863a9d-1ffc-4e64-9565-dc8158b0bd9e'}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:58:13 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-7b34c8db-1ddd-4915-a581-085e028d3c2b tempest-VolumesDeleteCascade-1394360621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe700d42-ebea-485c-9174-59c02ef50659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:58:13 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-7b34c8db-1ddd-4915-a581-085e028d3c2b tempest-VolumesDeleteCascade-1394360621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe700d42-ebea-485c-9174-59c02ef50659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:58:13 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-7b34c8db-1ddd-4915-a581-085e028d3c2b tempest-VolumesDeleteCascade-1394360621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58761e14-71c2-4d96-bfb5-f54838eb6cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:58:13 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-7b34c8db-1ddd-4915-a581-085e028d3c2b tempest-VolumesDeleteCascade-1394360621 None] Volume 4c48f079-0119-412c-bed3-cddae109e14e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4c48f079-0119-412c-bed3-cddae109e14e', 'volume_size': 1, 'snapshot_id': '4a863a9d-1ffc-4e64-9565-dc8158b0bd9e'}
Jun 15 15:58:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-7b34c8db-1ddd-4915-a581-085e028d3c2b tempest-VolumesDeleteCascade-1394360621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:58:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-7b34c8db-1ddd-4915-a581-085e028d3c2b tempest-VolumesDeleteCascade-1394360621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:58:13 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-7b34c8db-1ddd-4915-a581-085e028d3c2b tempest-VolumesDeleteCascade-1394360621 None] Acquiring lock "cinder-quobyte-4a863a9d-1ffc-4e64-9565-dc8158b0bd9e-4c48f079-0119-412c-bed3-cddae109e14e" by "_create_volume_from_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:58:13 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-7b34c8db-1ddd-4915-a581-085e028d3c2b tempest-VolumesDeleteCascade-1394360621 None] Lock "cinder-quobyte-4a863a9d-1ffc-4e64-9565-dc8158b0bd9e-4c48f079-0119-412c-bed3-cddae109e14e" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:58:13 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-7b34c8db-1ddd-4915-a581-085e028d3c2b tempest-VolumesDeleteCascade-1394360621 None] Creating volume 4c48f079-0119-412c-bed3-cddae109e14e from snapshot 4a863a9d-1ffc-4e64-9565-dc8158b0bd9e {{(pid=91863) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 15 15:58:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-7b34c8db-1ddd-4915-a581-085e028d3c2b tempest-VolumesDeleteCascade-1394360621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:58:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-7b34c8db-1ddd-4915-a581-085e028d3c2b tempest-VolumesDeleteCascade-1394360621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:58:13 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-7b34c8db-1ddd-4915-a581-085e028d3c2b tempest-VolumesDeleteCascade-1394360621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:58:13 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-7b34c8db-1ddd-4915-a581-085e028d3c2b tempest-VolumesDeleteCascade-1394360621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:58:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-7b34c8db-1ddd-4915-a581-085e028d3c2b tempest-VolumesDeleteCascade-1394360621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:58:13 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-7b34c8db-1ddd-4915-a581-085e028d3c2b tempest-VolumesDeleteCascade-1394360621 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 15:58:13 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-7b34c8db-1ddd-4915-a581-085e028d3c2b tempest-VolumesDeleteCascade-1394360621 None] Acquiring lock "cinder-quobyte-4c48f079-0119-412c-bed3-cddae109e14e" by "_copy_volume_from_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:58:13 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-7b34c8db-1ddd-4915-a581-085e028d3c2b tempest-VolumesDeleteCascade-1394360621 None] Lock "cinder-quobyte-4c48f079-0119-412c-bed3-cddae109e14e" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:58:13 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-7b34c8db-1ddd-4915-a581-085e028d3c2b tempest-VolumesDeleteCascade-1394360621 None] snapshot: 4a863a9d-1ffc-4e64-9565-dc8158b0bd9e, volume: 4c48f079-0119-412c-bed3-cddae109e14e,  {{(pid=91863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 15 15:58:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-7b34c8db-1ddd-4915-a581-085e028d3c2b tempest-VolumesDeleteCascade-1394360621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:58:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-7b34c8db-1ddd-4915-a581-085e028d3c2b tempest-VolumesDeleteCascade-1394360621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:58:13 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-7b34c8db-1ddd-4915-a581-085e028d3c2b tempest-VolumesDeleteCascade-1394360621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:58:13 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-7b34c8db-1ddd-4915-a581-085e028d3c2b tempest-VolumesDeleteCascade-1394360621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:58:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-7b34c8db-1ddd-4915-a581-085e028d3c2b tempest-VolumesDeleteCascade-1394360621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:58:13 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f32897-46f9-4475-86ea-deb43a75753f]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:58:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-7b34c8db-1ddd-4915-a581-085e028d3c2b tempest-VolumesDeleteCascade-1394360621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36b3ad73-a085-4d2b-ae1c-1538cf3e9af6.4a863a9d-1ffc-4e64-9565-dc8158b0bd9e {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:58:13 devstack sudo[102617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36b3ad73-a085-4d2b-ae1c-1538cf3e9af6.4a863a9d-1ffc-4e64-9565-dc8158b0bd9e
Jun 15 15:58:13 devstack sudo[102617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:58:13 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-ed0003e7-c798-45a4-898c-aa193bfd5253 tempest-VolumeTypesAccessTest-1951882040 None] Acquiring lock "cinder-558d6c65-5cea-4a23-8a43-57a80fc48074-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:58:13 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-ed0003e7-c798-45a4-898c-aa193bfd5253 tempest-VolumeTypesAccessTest-1951882040 None] Lock "cinder-558d6c65-5cea-4a23-8a43-57a80fc48074-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:58:13 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-ed0003e7-c798-45a4-898c-aa193bfd5253 tempest-VolumeTypesAccessTest-1951882040 None] Acquiring lock "cinder-quobyte-558d6c65-5cea-4a23-8a43-57a80fc48074" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:58:13 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-ed0003e7-c798-45a4-898c-aa193bfd5253 tempest-VolumeTypesAccessTest-1951882040 None] Lock "cinder-quobyte-558d6c65-5cea-4a23-8a43-57a80fc48074" acquired by "delete_volume" :: waited 0.022s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:58:13 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6d0ac3a-da51-41c0-bdc4-77a845e881fc tempest-AttachVolumeTestJSON-1078769545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 15:58:13 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-b6d0ac3a-da51-41c0-bdc4-77a845e881fc tempest-AttachVolumeTestJSON-1078769545 None] Flow 'volume_create_manager' (fa9a1066-d1db-42e4-9fda-a3e5c9040d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:58:13 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-b6d0ac3a-da51-41c0-bdc4-77a845e881fc tempest-AttachVolumeTestJSON-1078769545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7286758-d5e1-4f1c-8fb5-29942d64387c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:58:13 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe2eeab-697e-4d02-910c-03e7e90ba051]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:58:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ed0003e7-c798-45a4-898c-aa193bfd5253 tempest-VolumeTypesAccessTest-1951882040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-558d6c65-5cea-4a23-8a43-57a80fc48074 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:58:13 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-b6d0ac3a-da51-41c0-bdc4-77a845e881fc tempest-AttachVolumeTestJSON-1078769545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7286758-d5e1-4f1c-8fb5-29942d64387c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:58:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1622343681',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db6d9905-80b8-41d1-af9c-350ec887547a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74b3ee574a234c568898318f69294baf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:58:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:58:14Z,use_quota=True,user_id='b05c9b2f6f26478da7a8cf339968ec29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:58:13 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-b6d0ac3a-da51-41c0-bdc4-77a845e881fc tempest-AttachVolumeTestJSON-1078769545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc507008-987b-4e2b-9c51-c5fd848dc491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:58:13 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-b6d0ac3a-da51-41c0-bdc4-77a845e881fc tempest-AttachVolumeTestJSON-1078769545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc507008-987b-4e2b-9c51-c5fd848dc491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:58:13 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-b6d0ac3a-da51-41c0-bdc4-77a845e881fc tempest-AttachVolumeTestJSON-1078769545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (decc80aa-5e89-46cf-b271-e1ba4b25ae82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:58:13 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-b6d0ac3a-da51-41c0-bdc4-77a845e881fc tempest-AttachVolumeTestJSON-1078769545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (decc80aa-5e89-46cf-b271-e1ba4b25ae82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db6d9905-80b8-41d1-af9c-350ec887547a', 'volume_name': 'volume-db6d9905-80b8-41d1-af9c-350ec887547a', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:58:13 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-b6d0ac3a-da51-41c0-bdc4-77a845e881fc tempest-AttachVolumeTestJSON-1078769545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb0d6c74-e313-45f7-8887-9c74258ab395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:58:13 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-b6d0ac3a-da51-41c0-bdc4-77a845e881fc tempest-AttachVolumeTestJSON-1078769545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb0d6c74-e313-45f7-8887-9c74258ab395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:58:13 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-b6d0ac3a-da51-41c0-bdc4-77a845e881fc tempest-AttachVolumeTestJSON-1078769545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03ae4b61-a559-4411-9eb2-49dde541a167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:58:13 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-b6d0ac3a-da51-41c0-bdc4-77a845e881fc tempest-AttachVolumeTestJSON-1078769545 None] Volume db6d9905-80b8-41d1-af9c-350ec887547a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db6d9905-80b8-41d1-af9c-350ec887547a', 'volume_size': 1}
Jun 15 15:58:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-b6d0ac3a-da51-41c0-bdc4-77a845e881fc tempest-AttachVolumeTestJSON-1078769545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:58:13 devstack sudo[102619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-558d6c65-5cea-4a23-8a43-57a80fc48074
Jun 15 15:58:13 devstack sudo[102619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:58:13 devstack sudo[102617]: pam_unix(sudo:session): session closed for user root
Jun 15 15:58:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-7b34c8db-1ddd-4915-a581-085e028d3c2b tempest-VolumesDeleteCascade-1394360621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36b3ad73-a085-4d2b-ae1c-1538cf3e9af6.4a863a9d-1ffc-4e64-9565-dc8158b0bd9e" returned: 0 in 0.761s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:58:13 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-7b34c8db-1ddd-4915-a581-085e028d3c2b tempest-VolumesDeleteCascade-1394360621 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36b3ad73-a085-4d2b-ae1c-1538cf3e9af6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 15:58:13 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-7b34c8db-1ddd-4915-a581-085e028d3c2b tempest-VolumesDeleteCascade-1394360621 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36b3ad73-a085-4d2b-ae1c-1538cf3e9af6 {{(pid=91863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 15 15:58:13 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-7b34c8db-1ddd-4915-a581-085e028d3c2b tempest-VolumesDeleteCascade-1394360621 None] Creating direct copy from snapshot {{(pid=91863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 15 15:58:13 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed645d4-af17-42c8-80ba-8a3b653c6b87]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:58:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-7b34c8db-1ddd-4915-a581-085e028d3c2b tempest-VolumesDeleteCascade-1394360621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36b3ad73-a085-4d2b-ae1c-1538cf3e9af6 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:58:14 devstack sudo[102624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36b3ad73-a085-4d2b-ae1c-1538cf3e9af6
Jun 15 15:58:14 devstack sudo[102624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:58:14 devstack sudo[102619]: pam_unix(sudo:session): session closed for user root
Jun 15 15:58:14 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ed0003e7-c798-45a4-898c-aa193bfd5253 tempest-VolumeTypesAccessTest-1951882040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-558d6c65-5cea-4a23-8a43-57a80fc48074" returned: 0 in 0.705s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:58:14 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ed0003e7-c798-45a4-898c-aa193bfd5253 tempest-VolumeTypesAccessTest-1951882040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-558d6c65-5cea-4a23-8a43-57a80fc48074 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:58:14 devstack sudo[102630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-558d6c65-5cea-4a23-8a43-57a80fc48074
Jun 15 15:58:14 devstack sudo[102630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:58:14 devstack sudo[102624]: pam_unix(sudo:session): session closed for user root
Jun 15 15:58:14 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-7b34c8db-1ddd-4915-a581-085e028d3c2b tempest-VolumesDeleteCascade-1394360621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36b3ad73-a085-4d2b-ae1c-1538cf3e9af6" returned: 0 in 0.734s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:58:14 devstack cinder-volume[91863]: DEBUG cinder.utils [None req-7b34c8db-1ddd-4915-a581-085e028d3c2b tempest-VolumesDeleteCascade-1394360621 None] Path /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4c48f079-0119-412c-bed3-cddae109e14e not found in is_blk_device check {{(pid=91863) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 15 15:58:14 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-7b34c8db-1ddd-4915-a581-085e028d3c2b tempest-VolumesDeleteCascade-1394360621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36b3ad73-a085-4d2b-ae1c-1538cf3e9af6 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4c48f079-0119-412c-bed3-cddae109e14e {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:58:14 devstack sudo[102635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36b3ad73-a085-4d2b-ae1c-1538cf3e9af6 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4c48f079-0119-412c-bed3-cddae109e14e
Jun 15 15:58:14 devstack sudo[102635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:58:15 devstack sudo[102630]: pam_unix(sudo:session): session closed for user root
Jun 15 15:58:15 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ed0003e7-c798-45a4-898c-aa193bfd5253 tempest-VolumeTypesAccessTest-1951882040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-558d6c65-5cea-4a23-8a43-57a80fc48074" returned: 0 in 0.595s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:58:15 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-ed0003e7-c798-45a4-898c-aa193bfd5253 tempest-VolumeTypesAccessTest-1951882040 None] Lock "cinder-quobyte-558d6c65-5cea-4a23-8a43-57a80fc48074" released by "delete_volume" :: held 1.386s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:58:15 devstack cinder-volume[91863]: WARNING cinder.quota [None req-ed0003e7-c798-45a4-898c-aa193bfd5253 tempest-VolumeTypesAccessTest-1951882040 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-310100352 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-310100352, it is now deprecated. Please use the default quota class for default quota.
Jun 15 15:58:15 devstack cinder-volume[91863]: WARNING cinder.quota [None req-ed0003e7-c798-45a4-898c-aa193bfd5253 tempest-VolumeTypesAccessTest-1951882040 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-310100352 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-310100352, it is now deprecated. Please use the default quota class for default quota.
Jun 15 15:58:15 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-ed0003e7-c798-45a4-898c-aa193bfd5253 tempest-VolumeTypesAccessTest-1951882040 None] Created reservations ['34fce761-a243-4391-ad5c-ddffa66ef9ef', '94b7e32a-b250-498b-94f8-bff24482156a', '76f3fc12-15b2-4039-af7b-5809c5983292', '15aaff71-90cd-402a-a16d-35cf5d836ec9'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:58:15 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-ed0003e7-c798-45a4-898c-aa193bfd5253 tempest-VolumeTypesAccessTest-1951882040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:58:15 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-ed0003e7-c798-45a4-898c-aa193bfd5253 tempest-VolumeTypesAccessTest-1951882040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:58:15 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-ed0003e7-c798-45a4-898c-aa193bfd5253 tempest-VolumeTypesAccessTest-1951882040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:58:15 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-ed0003e7-c798-45a4-898c-aa193bfd5253 tempest-VolumeTypesAccessTest-1951882040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:58:15 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-ed0003e7-c798-45a4-898c-aa193bfd5253 tempest-VolumeTypesAccessTest-1951882040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:58:15 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ed0003e7-c798-45a4-898c-aa193bfd5253 tempest-VolumeTypesAccessTest-1951882040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:58:15 devstack sudo[102639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:58:15 devstack sudo[102639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:58:16 devstack sudo[102639]: pam_unix(sudo:session): session closed for user root
Jun 15 15:58:16 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ed0003e7-c798-45a4-898c-aa193bfd5253 tempest-VolumeTypesAccessTest-1951882040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 1.037s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:58:16 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-ed0003e7-c798-45a4-898c-aa193bfd5253 tempest-VolumeTypesAccessTest-1951882040 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:58:16 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-ed0003e7-c798-45a4-898c-aa193bfd5253 tempest-VolumeTypesAccessTest-1951882040 None] Deleted volume successfully.
Jun 15 15:58:16 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-ed0003e7-c798-45a4-898c-aa193bfd5253 tempest-VolumeTypesAccessTest-1951882040 None] Lock "cinder-558d6c65-5cea-4a23-8a43-57a80fc48074-delete_volume" released by "delete_volume" :: held 2.718s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:58:19 devstack sudo[102635]: pam_unix(sudo:session): session closed for user root
Jun 15 15:58:19 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-7b34c8db-1ddd-4915-a581-085e028d3c2b tempest-VolumesDeleteCascade-1394360621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36b3ad73-a085-4d2b-ae1c-1538cf3e9af6 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4c48f079-0119-412c-bed3-cddae109e14e" returned: 0 in 4.798s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:58:19 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f80ad3b-3002-4d79-8725-8ea0f36e716a]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:58:19 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-7b34c8db-1ddd-4915-a581-085e028d3c2b tempest-VolumesDeleteCascade-1394360621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36b3ad73-a085-4d2b-ae1c-1538cf3e9af6 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:58:19 devstack sudo[102653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36b3ad73-a085-4d2b-ae1c-1538cf3e9af6
Jun 15 15:58:19 devstack sudo[102653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:58:20 devstack sudo[102653]: pam_unix(sudo:session): session closed for user root
Jun 15 15:58:20 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-7b34c8db-1ddd-4915-a581-085e028d3c2b tempest-VolumesDeleteCascade-1394360621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36b3ad73-a085-4d2b-ae1c-1538cf3e9af6" returned: 0 in 0.905s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:58:20 devstack cinder-volume[91863]: DEBUG cinder.image.image_utils [None req-7b34c8db-1ddd-4915-a581-085e028d3c2b tempest-VolumesDeleteCascade-1394360621 None] Image conversion details: src /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36b3ad73-a085-4d2b-ae1c-1538cf3e9af6, size 1024.00 MB, duration 4.80 sec, destination /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4c48f079-0119-412c-bed3-cddae109e14e {{(pid=91863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 15 15:58:20 devstack cinder-volume[91863]: INFO cinder.image.image_utils [None req-7b34c8db-1ddd-4915-a581-085e028d3c2b tempest-VolumesDeleteCascade-1394360621 None] Converted 1024.00 MB image at 213.38 MB/s
Jun 15 15:58:20 devstack cinder-volume[91863]: WARNING cinder.volume.drivers.remotefs [None req-7b34c8db-1ddd-4915-a581-085e028d3c2b tempest-VolumesDeleteCascade-1394360621 None] /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4c48f079-0119-412c-bed3-cddae109e14e is being set with open permissions: ugo+rw
Jun 15 15:58:20 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-7b34c8db-1ddd-4915-a581-085e028d3c2b tempest-VolumesDeleteCascade-1394360621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4c48f079-0119-412c-bed3-cddae109e14e {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:58:20 devstack sudo[102658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4c48f079-0119-412c-bed3-cddae109e14e
Jun 15 15:58:20 devstack sudo[102658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:58:21 devstack sudo[102658]: pam_unix(sudo:session): session closed for user root
Jun 15 15:58:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-7b34c8db-1ddd-4915-a581-085e028d3c2b tempest-VolumesDeleteCascade-1394360621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4c48f079-0119-412c-bed3-cddae109e14e" returned: 0 in 0.627s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:58:21 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-7b34c8db-1ddd-4915-a581-085e028d3c2b tempest-VolumesDeleteCascade-1394360621 None] Lock "cinder-quobyte-4c48f079-0119-412c-bed3-cddae109e14e" released by "_copy_volume_from_snapshot" :: held 7.924s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:58:21 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-7b34c8db-1ddd-4915-a581-085e028d3c2b tempest-VolumesDeleteCascade-1394360621 None] Lock "cinder-quobyte-4a863a9d-1ffc-4e64-9565-dc8158b0bd9e-4c48f079-0119-412c-bed3-cddae109e14e" released by "_create_volume_from_snapshot" :: held 7.955s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:58:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-7b34c8db-1ddd-4915-a581-085e028d3c2b tempest-VolumesDeleteCascade-1394360621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.975s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:58:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-b6d0ac3a-da51-41c0-bdc4-77a845e881fc tempest-AttachVolumeTestJSON-1078769545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.232s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:58:21 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-b6d0ac3a-da51-41c0-bdc4-77a845e881fc tempest-AttachVolumeTestJSON-1078769545 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:58:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1622343681',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db6d9905-80b8-41d1-af9c-350ec887547a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74b3ee574a234c568898318f69294baf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:58:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:58:14Z,use_quota=True,user_id='b05c9b2f6f26478da7a8cf339968ec29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 15:58:21 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-b6d0ac3a-da51-41c0-bdc4-77a845e881fc tempest-AttachVolumeTestJSON-1078769545 None] Creating volume db6d9905-80b8-41d1-af9c-350ec887547a {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 15:58:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-b6d0ac3a-da51-41c0-bdc4-77a845e881fc tempest-AttachVolumeTestJSON-1078769545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:58:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-b6d0ac3a-da51-41c0-bdc4-77a845e881fc tempest-AttachVolumeTestJSON-1078769545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:58:21 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-b6d0ac3a-da51-41c0-bdc4-77a845e881fc tempest-AttachVolumeTestJSON-1078769545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:58:21 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-b6d0ac3a-da51-41c0-bdc4-77a845e881fc tempest-AttachVolumeTestJSON-1078769545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:58:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-b6d0ac3a-da51-41c0-bdc4-77a845e881fc tempest-AttachVolumeTestJSON-1078769545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:58:21 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-b6d0ac3a-da51-41c0-bdc4-77a845e881fc tempest-AttachVolumeTestJSON-1078769545 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 15:58:21 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-b6d0ac3a-da51-41c0-bdc4-77a845e881fc tempest-AttachVolumeTestJSON-1078769545 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 15:58:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-b6d0ac3a-da51-41c0-bdc4-77a845e881fc tempest-AttachVolumeTestJSON-1078769545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-db6d9905-80b8-41d1-af9c-350ec887547a 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:58:21 devstack sudo[102662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-db6d9905-80b8-41d1-af9c-350ec887547a 1073741824
Jun 15 15:58:21 devstack sudo[102662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:58:21 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-7b34c8db-1ddd-4915-a581-085e028d3c2b tempest-VolumesDeleteCascade-1394360621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58761e14-71c2-4d96-bfb5-f54838eb6cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c48f079-0119-412c-bed3-cddae109e14e', 'volume_size': 1, 'snapshot_id': '4a863a9d-1ffc-4e64-9565-dc8158b0bd9e'}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:58:21 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-7b34c8db-1ddd-4915-a581-085e028d3c2b tempest-VolumesDeleteCascade-1394360621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8aaa46f-585d-4fa4-9bd2-c04300a75e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:58:21 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-7b34c8db-1ddd-4915-a581-085e028d3c2b tempest-VolumesDeleteCascade-1394360621 None] Volume volume-4c48f079-0119-412c-bed3-cddae109e14e (4c48f079-0119-412c-bed3-cddae109e14e): created successfully
Jun 15 15:58:21 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-7b34c8db-1ddd-4915-a581-085e028d3c2b tempest-VolumesDeleteCascade-1394360621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8aaa46f-585d-4fa4-9bd2-c04300a75e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:58:21 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-7b34c8db-1ddd-4915-a581-085e028d3c2b tempest-VolumesDeleteCascade-1394360621 None] Flow 'volume_create_manager' (1646a589-ddf6-4a8b-840a-1bdd5541f779) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:58:21 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-7b34c8db-1ddd-4915-a581-085e028d3c2b tempest-VolumesDeleteCascade-1394360621 None] Created volume successfully.
Jun 15 15:58:21 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-4e5204a0-794d-46c0-ba6c-acc618e80d86 tempest-VolumesDeleteCascade-1394360621 None] Acquiring lock "cinder-36b3ad73-a085-4d2b-ae1c-1538cf3e9af6-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:58:21 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-4e5204a0-794d-46c0-ba6c-acc618e80d86 tempest-VolumesDeleteCascade-1394360621 None] Lock "cinder-36b3ad73-a085-4d2b-ae1c-1538cf3e9af6-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:58:21 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-4e5204a0-794d-46c0-ba6c-acc618e80d86 tempest-VolumesDeleteCascade-1394360621 None] Performing cascade delete. {{(pid=91863) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Jun 15 15:58:21 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-4e5204a0-794d-46c0-ba6c-acc618e80d86 tempest-VolumesDeleteCascade-1394360621 None] Acquiring lock "cinder-4a863a9d-1ffc-4e64-9565-dc8158b0bd9e-delete_snapshot" by "delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:58:21 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-4e5204a0-794d-46c0-ba6c-acc618e80d86 tempest-VolumesDeleteCascade-1394360621 None] Lock "cinder-4a863a9d-1ffc-4e64-9565-dc8158b0bd9e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:58:21 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-4e5204a0-794d-46c0-ba6c-acc618e80d86 tempest-VolumesDeleteCascade-1394360621 None] Acquiring lock "cinder-quobyte-36b3ad73-a085-4d2b-ae1c-1538cf3e9af6" by "delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:58:21 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-4e5204a0-794d-46c0-ba6c-acc618e80d86 tempest-VolumesDeleteCascade-1394360621 None] Lock "cinder-quobyte-36b3ad73-a085-4d2b-ae1c-1538cf3e9af6" acquired by "delete_snapshot" :: waited 0.015s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:58:21 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-4e5204a0-794d-46c0-ba6c-acc618e80d86 tempest-VolumesDeleteCascade-1394360621 None] Acquiring lock "cinder-quobyte-4a863a9d-1ffc-4e64-9565-dc8158b0bd9e" by "_delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:58:21 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-4e5204a0-794d-46c0-ba6c-acc618e80d86 tempest-VolumesDeleteCascade-1394360621 None] Lock "cinder-quobyte-4a863a9d-1ffc-4e64-9565-dc8158b0bd9e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:58:21 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-4e5204a0-794d-46c0-ba6c-acc618e80d86 tempest-VolumesDeleteCascade-1394360621 None] Deleting offline snapshot 4a863a9d-1ffc-4e64-9565-dc8158b0bd9e of volume 36b3ad73-a085-4d2b-ae1c-1538cf3e9af6 {{(pid=91863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 15 15:58:21 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-4e5204a0-794d-46c0-ba6c-acc618e80d86 tempest-VolumesDeleteCascade-1394360621 None] snapshot_file for this snap is: volume-36b3ad73-a085-4d2b-ae1c-1538cf3e9af6.4a863a9d-1ffc-4e64-9565-dc8158b0bd9e {{(pid=91863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 15 15:58:21 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1051858-208c-4932-9af3-47dc001ba755]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:58:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-4e5204a0-794d-46c0-ba6c-acc618e80d86 tempest-VolumesDeleteCascade-1394360621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36b3ad73-a085-4d2b-ae1c-1538cf3e9af6.4a863a9d-1ffc-4e64-9565-dc8158b0bd9e {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:58:22 devstack sudo[102662]: pam_unix(sudo:session): session closed for user root
Jun 15 15:58:22 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-b6d0ac3a-da51-41c0-bdc4-77a845e881fc tempest-AttachVolumeTestJSON-1078769545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-db6d9905-80b8-41d1-af9c-350ec887547a 1073741824" returned: 0 in 0.956s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:58:22 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-b6d0ac3a-da51-41c0-bdc4-77a845e881fc tempest-AttachVolumeTestJSON-1078769545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-db6d9905-80b8-41d1-af9c-350ec887547a {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:58:22 devstack sudo[102667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36b3ad73-a085-4d2b-ae1c-1538cf3e9af6.4a863a9d-1ffc-4e64-9565-dc8158b0bd9e
Jun 15 15:58:22 devstack sudo[102667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:58:22 devstack sudo[102668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-db6d9905-80b8-41d1-af9c-350ec887547a
Jun 15 15:58:22 devstack sudo[102668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:58:22 devstack sudo[102667]: pam_unix(sudo:session): session closed for user root
Jun 15 15:58:22 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-4e5204a0-794d-46c0-ba6c-acc618e80d86 tempest-VolumesDeleteCascade-1394360621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36b3ad73-a085-4d2b-ae1c-1538cf3e9af6.4a863a9d-1ffc-4e64-9565-dc8158b0bd9e" returned: 0 in 0.785s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:58:22 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-4e5204a0-794d-46c0-ba6c-acc618e80d86 tempest-VolumesDeleteCascade-1394360621 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36b3ad73-a085-4d2b-ae1c-1538cf3e9af6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 15:58:22 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e56dc87-085d-486d-8e08-ccec1f2c3b59]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:58:22 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-4e5204a0-794d-46c0-ba6c-acc618e80d86 tempest-VolumesDeleteCascade-1394360621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36b3ad73-a085-4d2b-ae1c-1538cf3e9af6 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:58:22 devstack sudo[102668]: pam_unix(sudo:session): session closed for user root
Jun 15 15:58:22 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-b6d0ac3a-da51-41c0-bdc4-77a845e881fc tempest-AttachVolumeTestJSON-1078769545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-db6d9905-80b8-41d1-af9c-350ec887547a" returned: 0 in 0.717s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:58:22 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-b6d0ac3a-da51-41c0-bdc4-77a845e881fc tempest-AttachVolumeTestJSON-1078769545 None] <== create_volume: return (1728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 15:58:22 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-b6d0ac3a-da51-41c0-bdc4-77a845e881fc tempest-AttachVolumeTestJSON-1078769545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.732s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:58:22 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-b6d0ac3a-da51-41c0-bdc4-77a845e881fc tempest-AttachVolumeTestJSON-1078769545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03ae4b61-a559-4411-9eb2-49dde541a167) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db6d9905-80b8-41d1-af9c-350ec887547a', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:58:22 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-b6d0ac3a-da51-41c0-bdc4-77a845e881fc tempest-AttachVolumeTestJSON-1078769545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3da1c71b-42b8-41e3-b311-1c60de430a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:58:22 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-b6d0ac3a-da51-41c0-bdc4-77a845e881fc tempest-AttachVolumeTestJSON-1078769545 None] Volume volume-db6d9905-80b8-41d1-af9c-350ec887547a (db6d9905-80b8-41d1-af9c-350ec887547a): created successfully
Jun 15 15:58:22 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-b6d0ac3a-da51-41c0-bdc4-77a845e881fc tempest-AttachVolumeTestJSON-1078769545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3da1c71b-42b8-41e3-b311-1c60de430a0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:58:22 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-b6d0ac3a-da51-41c0-bdc4-77a845e881fc tempest-AttachVolumeTestJSON-1078769545 None] Flow 'volume_create_manager' (fa9a1066-d1db-42e4-9fda-a3e5c9040d10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:58:22 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-b6d0ac3a-da51-41c0-bdc4-77a845e881fc tempest-AttachVolumeTestJSON-1078769545 None] Created volume successfully.
Jun 15 15:58:22 devstack sudo[102675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36b3ad73-a085-4d2b-ae1c-1538cf3e9af6
Jun 15 15:58:22 devstack sudo[102675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:58:23 devstack sudo[102675]: pam_unix(sudo:session): session closed for user root
Jun 15 15:58:23 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-4e5204a0-794d-46c0-ba6c-acc618e80d86 tempest-VolumesDeleteCascade-1394360621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36b3ad73-a085-4d2b-ae1c-1538cf3e9af6" returned: 0 in 0.770s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:58:23 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-4e5204a0-794d-46c0-ba6c-acc618e80d86 tempest-VolumesDeleteCascade-1394360621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36b3ad73-a085-4d2b-ae1c-1538cf3e9af6.4a863a9d-1ffc-4e64-9565-dc8158b0bd9e {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:58:23 devstack sudo[102686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36b3ad73-a085-4d2b-ae1c-1538cf3e9af6.4a863a9d-1ffc-4e64-9565-dc8158b0bd9e
Jun 15 15:58:23 devstack sudo[102686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:58:24 devstack sudo[102686]: pam_unix(sudo:session): session closed for user root
Jun 15 15:58:24 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-4e5204a0-794d-46c0-ba6c-acc618e80d86 tempest-VolumesDeleteCascade-1394360621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36b3ad73-a085-4d2b-ae1c-1538cf3e9af6.4a863a9d-1ffc-4e64-9565-dc8158b0bd9e" returned: 0 in 0.789s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:58:24 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-4e5204a0-794d-46c0-ba6c-acc618e80d86 tempest-VolumesDeleteCascade-1394360621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36b3ad73-a085-4d2b-ae1c-1538cf3e9af6.4a863a9d-1ffc-4e64-9565-dc8158b0bd9e {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:58:24 devstack sudo[102692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36b3ad73-a085-4d2b-ae1c-1538cf3e9af6.4a863a9d-1ffc-4e64-9565-dc8158b0bd9e
Jun 15 15:58:24 devstack sudo[102692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:58:24 devstack sudo[102692]: pam_unix(sudo:session): session closed for user root
Jun 15 15:58:24 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-4e5204a0-794d-46c0-ba6c-acc618e80d86 tempest-VolumesDeleteCascade-1394360621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36b3ad73-a085-4d2b-ae1c-1538cf3e9af6.4a863a9d-1ffc-4e64-9565-dc8158b0bd9e" returned: 0 in 0.625s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:58:24 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-4e5204a0-794d-46c0-ba6c-acc618e80d86 tempest-VolumesDeleteCascade-1394360621 None] Lock "cinder-quobyte-4a863a9d-1ffc-4e64-9565-dc8158b0bd9e" released by "_delete_snapshot" :: held 3.070s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:58:24 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-4e5204a0-794d-46c0-ba6c-acc618e80d86 tempest-VolumesDeleteCascade-1394360621 None] Lock "cinder-quobyte-36b3ad73-a085-4d2b-ae1c-1538cf3e9af6" released by "delete_snapshot" :: held 3.094s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:58:25 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-4e5204a0-794d-46c0-ba6c-acc618e80d86 tempest-VolumesDeleteCascade-1394360621 None] Created reservations ['231294fc-5a30-4c14-88c2-38e2c9109e74', '6006c827-6a75-4cce-bbe0-7cf40ef1cbe9', '9019c0fe-102d-4304-8d9f-119458417fc3', '7aa87922-dcf1-49fc-8fb8-64d93fd30c4d'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:58:25 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-4e5204a0-794d-46c0-ba6c-acc618e80d86 tempest-VolumesDeleteCascade-1394360621 None] Delete snapshot completed successfully.
Jun 15 15:58:25 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-4e5204a0-794d-46c0-ba6c-acc618e80d86 tempest-VolumesDeleteCascade-1394360621 None] Lock "cinder-4a863a9d-1ffc-4e64-9565-dc8158b0bd9e-delete_snapshot" released by "delete_snapshot" :: held 3.254s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:58:25 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-4e5204a0-794d-46c0-ba6c-acc618e80d86 tempest-VolumesDeleteCascade-1394360621 None] Snapshots deleted, issuing volume delete {{(pid=91863) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Jun 15 15:58:25 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-4e5204a0-794d-46c0-ba6c-acc618e80d86 tempest-VolumesDeleteCascade-1394360621 None] Acquiring lock "cinder-quobyte-36b3ad73-a085-4d2b-ae1c-1538cf3e9af6" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:58:25 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-4e5204a0-794d-46c0-ba6c-acc618e80d86 tempest-VolumesDeleteCascade-1394360621 None] Lock "cinder-quobyte-36b3ad73-a085-4d2b-ae1c-1538cf3e9af6" acquired by "delete_volume" :: waited 0.014s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:58:25 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b43bcb6d-59aa-4aba-b63d-297eb7106811]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:58:25 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-4e5204a0-794d-46c0-ba6c-acc618e80d86 tempest-VolumesDeleteCascade-1394360621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36b3ad73-a085-4d2b-ae1c-1538cf3e9af6 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:58:25 devstack sudo[102696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36b3ad73-a085-4d2b-ae1c-1538cf3e9af6
Jun 15 15:58:25 devstack sudo[102696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:58:25 devstack sudo[102696]: pam_unix(sudo:session): session closed for user root
Jun 15 15:58:25 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-4e5204a0-794d-46c0-ba6c-acc618e80d86 tempest-VolumesDeleteCascade-1394360621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36b3ad73-a085-4d2b-ae1c-1538cf3e9af6" returned: 0 in 0.781s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:58:25 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-4e5204a0-794d-46c0-ba6c-acc618e80d86 tempest-VolumesDeleteCascade-1394360621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36b3ad73-a085-4d2b-ae1c-1538cf3e9af6 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:58:25 devstack sudo[102701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36b3ad73-a085-4d2b-ae1c-1538cf3e9af6
Jun 15 15:58:25 devstack sudo[102701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:58:26 devstack sudo[102701]: pam_unix(sudo:session): session closed for user root
Jun 15 15:58:26 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-4e5204a0-794d-46c0-ba6c-acc618e80d86 tempest-VolumesDeleteCascade-1394360621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36b3ad73-a085-4d2b-ae1c-1538cf3e9af6" returned: 0 in 0.634s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:58:26 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-4e5204a0-794d-46c0-ba6c-acc618e80d86 tempest-VolumesDeleteCascade-1394360621 None] Lock "cinder-quobyte-36b3ad73-a085-4d2b-ae1c-1538cf3e9af6" released by "delete_volume" :: held 1.478s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:58:26 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-4e5204a0-794d-46c0-ba6c-acc618e80d86 tempest-VolumesDeleteCascade-1394360621 None] Created reservations ['5943763b-61d2-4688-a9ef-86832f1def63', '8272b534-d0bc-4c6b-b392-319c00145c1e', 'a208273c-4a8a-495d-b2b6-454a70264a68', '73b77645-e791-4fd3-9a12-67eea7ef4db4'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:58:26 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-4e5204a0-794d-46c0-ba6c-acc618e80d86 tempest-VolumesDeleteCascade-1394360621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:58:26 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-4e5204a0-794d-46c0-ba6c-acc618e80d86 tempest-VolumesDeleteCascade-1394360621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:58:26 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-4e5204a0-794d-46c0-ba6c-acc618e80d86 tempest-VolumesDeleteCascade-1394360621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:58:26 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-4e5204a0-794d-46c0-ba6c-acc618e80d86 tempest-VolumesDeleteCascade-1394360621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:58:26 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-4e5204a0-794d-46c0-ba6c-acc618e80d86 tempest-VolumesDeleteCascade-1394360621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:58:26 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-4e5204a0-794d-46c0-ba6c-acc618e80d86 tempest-VolumesDeleteCascade-1394360621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:58:26 devstack sudo[102712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:58:26 devstack sudo[102712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:58:26 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [req-64e3595a-962d-4876-8742-f7c3a431b4f4 req-7e6fe771-373b-47e5-81bc-853a58281a05 tempest-AttachVolumeTestJSON-1078769545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:58:26 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [req-64e3595a-962d-4876-8742-f7c3a431b4f4 req-7e6fe771-373b-47e5-81bc-853a58281a05 tempest-AttachVolumeTestJSON-1078769545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:58:26 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e481958-e771-4f8b-833e-48ff4faa8866]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:58:26 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-64e3595a-962d-4876-8742-f7c3a431b4f4 req-7e6fe771-373b-47e5-81bc-853a58281a05 tempest-AttachVolumeTestJSON-1078769545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-db6d9905-80b8-41d1-af9c-350ec887547a {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:58:26 devstack sudo[102714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-db6d9905-80b8-41d1-af9c-350ec887547a
Jun 15 15:58:26 devstack sudo[102714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:58:27 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-efd55721-505c-4c75-8c20-e766699faaa1 tempest-VolumesDeleteCascade-1394360621 None] Acquiring lock "cinder-4c48f079-0119-412c-bed3-cddae109e14e-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:58:27 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-efd55721-505c-4c75-8c20-e766699faaa1 tempest-VolumesDeleteCascade-1394360621 None] Lock "cinder-4c48f079-0119-412c-bed3-cddae109e14e-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:58:27 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-efd55721-505c-4c75-8c20-e766699faaa1 tempest-VolumesDeleteCascade-1394360621 None] Acquiring lock "cinder-quobyte-4c48f079-0119-412c-bed3-cddae109e14e" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:58:27 devstack sudo[102712]: pam_unix(sudo:session): session closed for user root
Jun 15 15:58:27 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-4e5204a0-794d-46c0-ba6c-acc618e80d86 tempest-VolumesDeleteCascade-1394360621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.866s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:58:27 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-4e5204a0-794d-46c0-ba6c-acc618e80d86 tempest-VolumesDeleteCascade-1394360621 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:58:27 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-efd55721-505c-4c75-8c20-e766699faaa1 tempest-VolumesDeleteCascade-1394360621 None] Lock "cinder-quobyte-4c48f079-0119-412c-bed3-cddae109e14e" acquired by "delete_volume" :: waited 0.045s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:58:27 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-4e5204a0-794d-46c0-ba6c-acc618e80d86 tempest-VolumesDeleteCascade-1394360621 None] Deleted volume successfully.
Jun 15 15:58:27 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b24f6249-81b8-4ab9-a925-45ca38eae948]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:58:27 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-efd55721-505c-4c75-8c20-e766699faaa1 tempest-VolumesDeleteCascade-1394360621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4c48f079-0119-412c-bed3-cddae109e14e {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:58:27 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-4e5204a0-794d-46c0-ba6c-acc618e80d86 tempest-VolumesDeleteCascade-1394360621 None] Lock "cinder-36b3ad73-a085-4d2b-ae1c-1538cf3e9af6-delete_volume" released by "delete_volume" :: held 5.942s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:58:27 devstack sudo[102714]: pam_unix(sudo:session): session closed for user root
Jun 15 15:58:27 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-64e3595a-962d-4876-8742-f7c3a431b4f4 req-7e6fe771-373b-47e5-81bc-853a58281a05 tempest-AttachVolumeTestJSON-1078769545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-db6d9905-80b8-41d1-af9c-350ec887547a" returned: 0 in 0.938s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:58:27 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [req-64e3595a-962d-4876-8742-f7c3a431b4f4 req-7e6fe771-373b-47e5-81bc-853a58281a05 tempest-AttachVolumeTestJSON-1078769545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.964s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:58:27 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [req-64e3595a-962d-4876-8742-f7c3a431b4f4 req-7e6fe771-373b-47e5-81bc-853a58281a05 tempest-AttachVolumeTestJSON-1078769545 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc', 'name': 'volume-db6d9905-80b8-41d1-af9c-350ec887547a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'abeb370a-e77c-4f6e-b098-7fc72b91b1b8', 'enforce_multipath': True} {{(pid=91863) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 15 15:58:27 devstack sudo[102720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4c48f079-0119-412c-bed3-cddae109e14e
Jun 15 15:58:27 devstack sudo[102720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:58:27 devstack cinder-volume[91863]: INFO cinder.volume.manager [req-64e3595a-962d-4876-8742-f7c3a431b4f4 req-7e6fe771-373b-47e5-81bc-853a58281a05 tempest-AttachVolumeTestJSON-1078769545 None] attachment_update completed successfully.
Jun 15 15:58:28 devstack sudo[102720]: pam_unix(sudo:session): session closed for user root
Jun 15 15:58:28 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-efd55721-505c-4c75-8c20-e766699faaa1 tempest-VolumesDeleteCascade-1394360621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4c48f079-0119-412c-bed3-cddae109e14e" returned: 0 in 0.747s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:58:28 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-efd55721-505c-4c75-8c20-e766699faaa1 tempest-VolumesDeleteCascade-1394360621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4c48f079-0119-412c-bed3-cddae109e14e {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:58:28 devstack sudo[102753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4c48f079-0119-412c-bed3-cddae109e14e
Jun 15 15:58:28 devstack sudo[102753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:58:29 devstack sudo[102753]: pam_unix(sudo:session): session closed for user root
Jun 15 15:58:29 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-efd55721-505c-4c75-8c20-e766699faaa1 tempest-VolumesDeleteCascade-1394360621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4c48f079-0119-412c-bed3-cddae109e14e" returned: 0 in 0.847s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:58:29 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-efd55721-505c-4c75-8c20-e766699faaa1 tempest-VolumesDeleteCascade-1394360621 None] Lock "cinder-quobyte-4c48f079-0119-412c-bed3-cddae109e14e" released by "delete_volume" :: held 1.654s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:58:29 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-efd55721-505c-4c75-8c20-e766699faaa1 tempest-VolumesDeleteCascade-1394360621 None] Created reservations ['a1a20e71-2c07-45a9-a785-76f8a32fa8a5', 'f5dc13e3-6c05-4afc-affc-fb3a1c2ceb6c', '60108d83-7472-4741-8e15-4e79bee82c6e', '8a1888da-95a7-464b-aa45-81600db12db0'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:58:29 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-efd55721-505c-4c75-8c20-e766699faaa1 tempest-VolumesDeleteCascade-1394360621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:58:29 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-efd55721-505c-4c75-8c20-e766699faaa1 tempest-VolumesDeleteCascade-1394360621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:58:29 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-efd55721-505c-4c75-8c20-e766699faaa1 tempest-VolumesDeleteCascade-1394360621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:58:29 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-efd55721-505c-4c75-8c20-e766699faaa1 tempest-VolumesDeleteCascade-1394360621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:58:29 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-efd55721-505c-4c75-8c20-e766699faaa1 tempest-VolumesDeleteCascade-1394360621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:58:29 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-efd55721-505c-4c75-8c20-e766699faaa1 tempest-VolumesDeleteCascade-1394360621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:58:29 devstack sudo[103110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:58:29 devstack sudo[103110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:58:30 devstack sudo[103110]: pam_unix(sudo:session): session closed for user root
Jun 15 15:58:30 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-efd55721-505c-4c75-8c20-e766699faaa1 tempest-VolumesDeleteCascade-1394360621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.704s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:58:30 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-efd55721-505c-4c75-8c20-e766699faaa1 tempest-VolumesDeleteCascade-1394360621 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:58:30 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-efd55721-505c-4c75-8c20-e766699faaa1 tempest-VolumesDeleteCascade-1394360621 None] Deleted volume successfully.
Jun 15 15:58:30 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-efd55721-505c-4c75-8c20-e766699faaa1 tempest-VolumesDeleteCascade-1394360621 None] Lock "cinder-4c48f079-0119-412c-bed3-cddae109e14e-delete_volume" released by "delete_volume" :: held 2.727s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:58:31 devstack cinder-volume[91863]: DEBUG oslo_service.periodic_task [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 15:58:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:58:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:58:31 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:58:31 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:58:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:58:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:58:31 devstack sudo[103113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:58:31 devstack sudo[103113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:58:31 devstack sudo[103113]: pam_unix(sudo:session): session closed for user root
Jun 15 15:58:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.756s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:58:31 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:58:31 devstack cinder-volume[91863]: DEBUG oslo_service.periodic_task [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Running periodic task VolumeManager._thread_info {{(pid=91863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 15:58:31 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] thread count: 28 {{(pid=91863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 15 15:58:31 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] thread info: [<_MainThread(MainThread, started 131088232640640)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131088122704576)>, <Thread(Thread-3 (stat_writer), started daemon 131088123058112)>, <Thread(Rabbit-heartbeat, started daemon 131088121268864)>, <Thread(Thread-5 (_runner), started daemon 131088121904192)>, <Thread(Thread-7 (_runner), started daemon 131088122037248)>, <Thread(fd_logger, started daemon 131088119630784)>, <Thread(privsep_reader, started daemon 131088119781440)>, <Thread(tpool_thread_0, started daemon 131088111617728)>, <Thread(tpool_thread_1, started daemon 131088103225024)>, <Thread(tpool_thread_2, started daemon 131088094832320)>, <Thread(tpool_thread_3, started daemon 131088086439616)>, <Thread(tpool_thread_4, started daemon 131088078046912)>, <Thread(tpool_thread_5, started daemon 131088069654208)>, <Thread(tpool_thread_6, started daemon 131088061261504)>, <Thread(tpool_thread_7, started daemon 131088052868800)>, <Thread(tpool_thread_8, started daemon 131088044476096)>, <Thread(tpool_thread_9, started daemon 131088036083392)>, <Thread(tpool_thread_10, started daemon 131088027690688)>, <Thread(tpool_thread_11, started daemon 131088019297984)>, <Thread(tpool_thread_12, started daemon 131088010905280)>, <Thread(tpool_thread_13, started daemon 131088002512576)>, <Thread(tpool_thread_14, started daemon 131087994119872)>, <Thread(tpool_thread_15, started daemon 131087985727168)>, <Thread(tpool_thread_16, started daemon 131087977334464)>, <Thread(tpool_thread_17, started daemon 131087968941760)>, <Thread(tpool_thread_18, started daemon 131087960549056)>, <Thread(tpool_thread_19, started daemon 131087952156352)>] {{(pid=91863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 15 15:58:33 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a2990b3-cfe9-4076-a950-8c226f7307f2 tempest-VolumesSnapshotListTestJSON-419168158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 15:58:33 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-7a2990b3-cfe9-4076-a950-8c226f7307f2 tempest-VolumesSnapshotListTestJSON-419168158 None] Flow 'volume_create_manager' (01e35173-04a7-421a-b46c-439f9229e562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:58:33 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-7a2990b3-cfe9-4076-a950-8c226f7307f2 tempest-VolumesSnapshotListTestJSON-419168158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (945da35a-a36f-41bd-93bf-755d9dc5e7c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:58:33 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-7a2990b3-cfe9-4076-a950-8c226f7307f2 tempest-VolumesSnapshotListTestJSON-419168158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (945da35a-a36f-41bd-93bf-755d9dc5e7c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:58:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-621237927',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a63d4ea-7d03-4655-9da9-2cd03b99c0b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77c750f949c9485a81aa646df9ed3321',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:58:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:58:33Z,use_quota=True,user_id='a0c2e659fae442b39ecef67c2982e6d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:58:33 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-7a2990b3-cfe9-4076-a950-8c226f7307f2 tempest-VolumesSnapshotListTestJSON-419168158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (250d5467-efbd-4111-acd0-839e2cc04caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:58:33 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-7a2990b3-cfe9-4076-a950-8c226f7307f2 tempest-VolumesSnapshotListTestJSON-419168158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (250d5467-efbd-4111-acd0-839e2cc04caf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:58:33 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-7a2990b3-cfe9-4076-a950-8c226f7307f2 tempest-VolumesSnapshotListTestJSON-419168158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c966712a-1686-440d-ae20-5a016e56e4bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:58:33 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-7a2990b3-cfe9-4076-a950-8c226f7307f2 tempest-VolumesSnapshotListTestJSON-419168158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c966712a-1686-440d-ae20-5a016e56e4bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a63d4ea-7d03-4655-9da9-2cd03b99c0b6', 'volume_name': 'volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:58:33 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-7a2990b3-cfe9-4076-a950-8c226f7307f2 tempest-VolumesSnapshotListTestJSON-419168158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac5371db-14ff-4016-8e22-b7a2a5610d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:58:33 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-7a2990b3-cfe9-4076-a950-8c226f7307f2 tempest-VolumesSnapshotListTestJSON-419168158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac5371db-14ff-4016-8e22-b7a2a5610d1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:58:33 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-7a2990b3-cfe9-4076-a950-8c226f7307f2 tempest-VolumesSnapshotListTestJSON-419168158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fe9ac3e-cde1-45f1-902a-f7f4ffbaab40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:58:33 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-7a2990b3-cfe9-4076-a950-8c226f7307f2 tempest-VolumesSnapshotListTestJSON-419168158 None] Volume 1a63d4ea-7d03-4655-9da9-2cd03b99c0b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6', 'volume_size': 1}
Jun 15 15:58:33 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-7a2990b3-cfe9-4076-a950-8c226f7307f2 tempest-VolumesSnapshotListTestJSON-419168158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:58:33 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-7a2990b3-cfe9-4076-a950-8c226f7307f2 tempest-VolumesSnapshotListTestJSON-419168158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:58:33 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-7a2990b3-cfe9-4076-a950-8c226f7307f2 tempest-VolumesSnapshotListTestJSON-419168158 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:58:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-621237927',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a63d4ea-7d03-4655-9da9-2cd03b99c0b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77c750f949c9485a81aa646df9ed3321',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:58:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:58:33Z,use_quota=True,user_id='a0c2e659fae442b39ecef67c2982e6d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 15:58:33 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-7a2990b3-cfe9-4076-a950-8c226f7307f2 tempest-VolumesSnapshotListTestJSON-419168158 None] Creating volume 1a63d4ea-7d03-4655-9da9-2cd03b99c0b6 {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 15:58:33 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-7a2990b3-cfe9-4076-a950-8c226f7307f2 tempest-VolumesSnapshotListTestJSON-419168158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:58:33 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-7a2990b3-cfe9-4076-a950-8c226f7307f2 tempest-VolumesSnapshotListTestJSON-419168158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:58:33 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-7a2990b3-cfe9-4076-a950-8c226f7307f2 tempest-VolumesSnapshotListTestJSON-419168158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:58:33 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-7a2990b3-cfe9-4076-a950-8c226f7307f2 tempest-VolumesSnapshotListTestJSON-419168158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:58:33 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-7a2990b3-cfe9-4076-a950-8c226f7307f2 tempest-VolumesSnapshotListTestJSON-419168158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:58:33 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-7a2990b3-cfe9-4076-a950-8c226f7307f2 tempest-VolumesSnapshotListTestJSON-419168158 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 15:58:33 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-7a2990b3-cfe9-4076-a950-8c226f7307f2 tempest-VolumesSnapshotListTestJSON-419168158 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 15:58:33 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-7a2990b3-cfe9-4076-a950-8c226f7307f2 tempest-VolumesSnapshotListTestJSON-419168158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:58:33 devstack sudo[103130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6 1073741824
Jun 15 15:58:33 devstack sudo[103130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:58:33 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-131af829-6a63-480b-abd4-a76b7cf81327 tempest-AttachVolumeTestJSON-1078769545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 15:58:33 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-131af829-6a63-480b-abd4-a76b7cf81327 tempest-AttachVolumeTestJSON-1078769545 None] Flow 'volume_create_manager' (1648f9bd-c37a-4d56-bae4-a5967f5e4bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:58:33 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-131af829-6a63-480b-abd4-a76b7cf81327 tempest-AttachVolumeTestJSON-1078769545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (474989d4-2942-473a-ba43-14e9a5cb9e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:58:33 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-131af829-6a63-480b-abd4-a76b7cf81327 tempest-AttachVolumeTestJSON-1078769545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (474989d4-2942-473a-ba43-14e9a5cb9e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:58:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1766778128',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4bbff89-5683-4813-b637-be5c34e4089b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74b3ee574a234c568898318f69294baf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:58:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:58:34Z,use_quota=True,user_id='b05c9b2f6f26478da7a8cf339968ec29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:58:33 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-131af829-6a63-480b-abd4-a76b7cf81327 tempest-AttachVolumeTestJSON-1078769545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78063c70-04ab-43e2-9a9d-72a52996f34d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:58:33 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-131af829-6a63-480b-abd4-a76b7cf81327 tempest-AttachVolumeTestJSON-1078769545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78063c70-04ab-43e2-9a9d-72a52996f34d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:58:33 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-131af829-6a63-480b-abd4-a76b7cf81327 tempest-AttachVolumeTestJSON-1078769545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a16a484-bfda-4938-b70a-bfef3f8e779a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:58:33 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-131af829-6a63-480b-abd4-a76b7cf81327 tempest-AttachVolumeTestJSON-1078769545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a16a484-bfda-4938-b70a-bfef3f8e779a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4bbff89-5683-4813-b637-be5c34e4089b', 'volume_name': 'volume-d4bbff89-5683-4813-b637-be5c34e4089b', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:58:34 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-131af829-6a63-480b-abd4-a76b7cf81327 tempest-AttachVolumeTestJSON-1078769545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca6b4386-ecb4-49e9-b9b5-0318add6b7a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:58:34 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-131af829-6a63-480b-abd4-a76b7cf81327 tempest-AttachVolumeTestJSON-1078769545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca6b4386-ecb4-49e9-b9b5-0318add6b7a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:58:34 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-131af829-6a63-480b-abd4-a76b7cf81327 tempest-AttachVolumeTestJSON-1078769545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5e6cfa5-4734-4c48-bc97-a5aa0474345c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:58:34 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-131af829-6a63-480b-abd4-a76b7cf81327 tempest-AttachVolumeTestJSON-1078769545 None] Volume d4bbff89-5683-4813-b637-be5c34e4089b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4bbff89-5683-4813-b637-be5c34e4089b', 'volume_size': 1}
Jun 15 15:58:34 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-131af829-6a63-480b-abd4-a76b7cf81327 tempest-AttachVolumeTestJSON-1078769545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:58:34 devstack sudo[103130]: pam_unix(sudo:session): session closed for user root
Jun 15 15:58:34 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-7a2990b3-cfe9-4076-a950-8c226f7307f2 tempest-VolumesSnapshotListTestJSON-419168158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6 1073741824" returned: 0 in 0.960s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:58:34 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-7a2990b3-cfe9-4076-a950-8c226f7307f2 tempest-VolumesSnapshotListTestJSON-419168158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:58:34 devstack sudo[103158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6
Jun 15 15:58:34 devstack sudo[103158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:58:34 devstack sudo[103158]: pam_unix(sudo:session): session closed for user root
Jun 15 15:58:34 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-7a2990b3-cfe9-4076-a950-8c226f7307f2 tempest-VolumesSnapshotListTestJSON-419168158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6" returned: 0 in 0.591s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:58:34 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-7a2990b3-cfe9-4076-a950-8c226f7307f2 tempest-VolumesSnapshotListTestJSON-419168158 None] <== create_volume: return (1600ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 15:58:34 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-7a2990b3-cfe9-4076-a950-8c226f7307f2 tempest-VolumesSnapshotListTestJSON-419168158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.602s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:58:34 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-131af829-6a63-480b-abd4-a76b7cf81327 tempest-AttachVolumeTestJSON-1078769545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.742s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:58:34 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-131af829-6a63-480b-abd4-a76b7cf81327 tempest-AttachVolumeTestJSON-1078769545 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:58:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1766778128',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4bbff89-5683-4813-b637-be5c34e4089b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74b3ee574a234c568898318f69294baf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:58:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:58:34Z,use_quota=True,user_id='b05c9b2f6f26478da7a8cf339968ec29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 15:58:34 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-131af829-6a63-480b-abd4-a76b7cf81327 tempest-AttachVolumeTestJSON-1078769545 None] Creating volume d4bbff89-5683-4813-b637-be5c34e4089b {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 15:58:34 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-131af829-6a63-480b-abd4-a76b7cf81327 tempest-AttachVolumeTestJSON-1078769545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:58:34 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-131af829-6a63-480b-abd4-a76b7cf81327 tempest-AttachVolumeTestJSON-1078769545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:58:34 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-131af829-6a63-480b-abd4-a76b7cf81327 tempest-AttachVolumeTestJSON-1078769545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:58:34 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-131af829-6a63-480b-abd4-a76b7cf81327 tempest-AttachVolumeTestJSON-1078769545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:58:34 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-131af829-6a63-480b-abd4-a76b7cf81327 tempest-AttachVolumeTestJSON-1078769545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:58:34 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-131af829-6a63-480b-abd4-a76b7cf81327 tempest-AttachVolumeTestJSON-1078769545 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 15:58:34 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-131af829-6a63-480b-abd4-a76b7cf81327 tempest-AttachVolumeTestJSON-1078769545 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 15:58:34 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-131af829-6a63-480b-abd4-a76b7cf81327 tempest-AttachVolumeTestJSON-1078769545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-d4bbff89-5683-4813-b637-be5c34e4089b 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:58:34 devstack sudo[103162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-d4bbff89-5683-4813-b637-be5c34e4089b 1073741824
Jun 15 15:58:34 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-7a2990b3-cfe9-4076-a950-8c226f7307f2 tempest-VolumesSnapshotListTestJSON-419168158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fe9ac3e-cde1-45f1-902a-f7f4ffbaab40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:58:34 devstack sudo[103162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:58:34 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-7a2990b3-cfe9-4076-a950-8c226f7307f2 tempest-VolumesSnapshotListTestJSON-419168158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1125762a-129e-49e6-b41b-a407d1365c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:58:34 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-7a2990b3-cfe9-4076-a950-8c226f7307f2 tempest-VolumesSnapshotListTestJSON-419168158 None] Volume volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6 (1a63d4ea-7d03-4655-9da9-2cd03b99c0b6): created successfully
Jun 15 15:58:34 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-7a2990b3-cfe9-4076-a950-8c226f7307f2 tempest-VolumesSnapshotListTestJSON-419168158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1125762a-129e-49e6-b41b-a407d1365c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:58:34 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-7a2990b3-cfe9-4076-a950-8c226f7307f2 tempest-VolumesSnapshotListTestJSON-419168158 None] Flow 'volume_create_manager' (01e35173-04a7-421a-b46c-439f9229e562) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:58:34 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-7a2990b3-cfe9-4076-a950-8c226f7307f2 tempest-VolumesSnapshotListTestJSON-419168158 None] Created volume successfully.
Jun 15 15:58:35 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-9797342b-91cd-403e-8f22-1302e66bf82c tempest-VolumesSnapshotListTestJSON-419168158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:58:35 devstack sudo[103162]: pam_unix(sudo:session): session closed for user root
Jun 15 15:58:35 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-131af829-6a63-480b-abd4-a76b7cf81327 tempest-AttachVolumeTestJSON-1078769545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-d4bbff89-5683-4813-b637-be5c34e4089b 1073741824" returned: 0 in 0.953s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:58:35 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-131af829-6a63-480b-abd4-a76b7cf81327 tempest-AttachVolumeTestJSON-1078769545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-d4bbff89-5683-4813-b637-be5c34e4089b {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:58:35 devstack sudo[103168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-d4bbff89-5683-4813-b637-be5c34e4089b
Jun 15 15:58:35 devstack sudo[103168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:58:36 devstack sudo[103168]: pam_unix(sudo:session): session closed for user root
Jun 15 15:58:36 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-131af829-6a63-480b-abd4-a76b7cf81327 tempest-AttachVolumeTestJSON-1078769545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-d4bbff89-5683-4813-b637-be5c34e4089b" returned: 0 in 0.644s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:58:36 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-131af829-6a63-480b-abd4-a76b7cf81327 tempest-AttachVolumeTestJSON-1078769545 None] <== create_volume: return (1639ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 15:58:36 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-131af829-6a63-480b-abd4-a76b7cf81327 tempest-AttachVolumeTestJSON-1078769545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.642s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:58:36 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-9797342b-91cd-403e-8f22-1302e66bf82c tempest-VolumesSnapshotListTestJSON-419168158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.898s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:58:36 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-131af829-6a63-480b-abd4-a76b7cf81327 tempest-AttachVolumeTestJSON-1078769545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5e6cfa5-4734-4c48-bc97-a5aa0474345c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4bbff89-5683-4813-b637-be5c34e4089b', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:58:36 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-131af829-6a63-480b-abd4-a76b7cf81327 tempest-AttachVolumeTestJSON-1078769545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96a8f92a-fb4f-4b11-b2f9-b3f6f860c234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:58:36 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-9797342b-91cd-403e-8f22-1302e66bf82c tempest-VolumesSnapshotListTestJSON-419168158 None] Creating offline snapshot 61380c71-f5d5-46d4-8dbb-e6f6d8c33840 of volume 1a63d4ea-7d03-4655-9da9-2cd03b99c0b6 {{(pid=91863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 15 15:58:36 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-131af829-6a63-480b-abd4-a76b7cf81327 tempest-AttachVolumeTestJSON-1078769545 None] Volume volume-d4bbff89-5683-4813-b637-be5c34e4089b (d4bbff89-5683-4813-b637-be5c34e4089b): created successfully
Jun 15 15:58:36 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-131af829-6a63-480b-abd4-a76b7cf81327 tempest-AttachVolumeTestJSON-1078769545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96a8f92a-fb4f-4b11-b2f9-b3f6f860c234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:58:36 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-131af829-6a63-480b-abd4-a76b7cf81327 tempest-AttachVolumeTestJSON-1078769545 None] Flow 'volume_create_manager' (1648f9bd-c37a-4d56-bae4-a5967f5e4bff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:58:36 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf63a97-d317-4ce2-a1e5-b471a6e59012]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:58:36 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-9797342b-91cd-403e-8f22-1302e66bf82c tempest-VolumesSnapshotListTestJSON-419168158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:58:36 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-131af829-6a63-480b-abd4-a76b7cf81327 tempest-AttachVolumeTestJSON-1078769545 None] Created volume successfully.
Jun 15 15:58:36 devstack sudo[103171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6
Jun 15 15:58:36 devstack sudo[103171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:58:37 devstack sudo[103171]: pam_unix(sudo:session): session closed for user root
Jun 15 15:58:37 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-9797342b-91cd-403e-8f22-1302e66bf82c tempest-VolumesSnapshotListTestJSON-419168158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6" returned: 0 in 0.803s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:58:37 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-9797342b-91cd-403e-8f22-1302e66bf82c tempest-VolumesSnapshotListTestJSON-419168158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6.61380c71-f5d5-46d4-8dbb-e6f6d8c33840 1G {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:58:37 devstack sudo[103176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6.61380c71-f5d5-46d4-8dbb-e6f6d8c33840 1G
Jun 15 15:58:37 devstack sudo[103176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:58:38 devstack sudo[103176]: pam_unix(sudo:session): session closed for user root
Jun 15 15:58:38 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-9797342b-91cd-403e-8f22-1302e66bf82c tempest-VolumesSnapshotListTestJSON-419168158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6.61380c71-f5d5-46d4-8dbb-e6f6d8c33840 1G" returned: 0 in 0.864s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:58:38 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-9797342b-91cd-403e-8f22-1302e66bf82c tempest-VolumesSnapshotListTestJSON-419168158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6 -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6.61380c71-f5d5-46d4-8dbb-e6f6d8c33840 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:58:38 devstack sudo[103182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6 -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6.61380c71-f5d5-46d4-8dbb-e6f6d8c33840
Jun 15 15:58:38 devstack sudo[103182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:58:38 devstack sudo[103182]: pam_unix(sudo:session): session closed for user root
Jun 15 15:58:38 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-9797342b-91cd-403e-8f22-1302e66bf82c tempest-VolumesSnapshotListTestJSON-419168158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6 -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6.61380c71-f5d5-46d4-8dbb-e6f6d8c33840" returned: 0 in 0.655s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:58:38 devstack cinder-volume[91863]: WARNING cinder.volume.drivers.remotefs [None req-9797342b-91cd-403e-8f22-1302e66bf82c tempest-VolumesSnapshotListTestJSON-419168158 None] /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6.61380c71-f5d5-46d4-8dbb-e6f6d8c33840 is being set with open permissions: ugo+rw
Jun 15 15:58:38 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-9797342b-91cd-403e-8f22-1302e66bf82c tempest-VolumesSnapshotListTestJSON-419168158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6.61380c71-f5d5-46d4-8dbb-e6f6d8c33840 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:58:38 devstack sudo[103187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6.61380c71-f5d5-46d4-8dbb-e6f6d8c33840
Jun 15 15:58:38 devstack sudo[103187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:58:39 devstack sudo[103187]: pam_unix(sudo:session): session closed for user root
Jun 15 15:58:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-9797342b-91cd-403e-8f22-1302e66bf82c tempest-VolumesSnapshotListTestJSON-419168158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6.61380c71-f5d5-46d4-8dbb-e6f6d8c33840" returned: 0 in 0.609s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:58:39 devstack cinder-volume[91863]: DEBUG dbcounter [-] [91863] Writing DB stats cinder:UPDATE=106,cinder:SELECT=88,cinder:DELETE=8,cinder:INSERT=17 {{(pid=91863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 15:58:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-9797342b-91cd-403e-8f22-1302e66bf82c tempest-VolumesSnapshotListTestJSON-419168158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6.info {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:58:39 devstack sudo[103190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6.info
Jun 15 15:58:39 devstack sudo[103190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:58:40 devstack sudo[103190]: pam_unix(sudo:session): session closed for user root
Jun 15 15:58:40 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-9797342b-91cd-403e-8f22-1302e66bf82c tempest-VolumesSnapshotListTestJSON-419168158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6.info" returned: 0 in 0.678s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:58:40 devstack cinder-volume[91863]: WARNING cinder.volume.drivers.remotefs [None req-9797342b-91cd-403e-8f22-1302e66bf82c tempest-VolumesSnapshotListTestJSON-419168158 None] /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6.info is being set with open permissions: ugo+rw
Jun 15 15:58:40 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-9797342b-91cd-403e-8f22-1302e66bf82c tempest-VolumesSnapshotListTestJSON-419168158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6.info {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:58:40 devstack sudo[103193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6.info
Jun 15 15:58:40 devstack sudo[103193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:58:40 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [req-d4610a23-6079-4500-b074-864d87fb8dc6 req-37711dff-6b4a-4dcc-88d5-9e94c9f53841 tempest-AttachVolumeTestJSON-1078769545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:58:40 devstack sudo[103193]: pam_unix(sudo:session): session closed for user root
Jun 15 15:58:40 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-9797342b-91cd-403e-8f22-1302e66bf82c tempest-VolumesSnapshotListTestJSON-419168158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6.info" returned: 0 in 0.612s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:58:40 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-9797342b-91cd-403e-8f22-1302e66bf82c tempest-VolumesSnapshotListTestJSON-419168158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.358s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:58:40 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [req-d4610a23-6079-4500-b074-864d87fb8dc6 req-37711dff-6b4a-4dcc-88d5-9e94c9f53841 tempest-AttachVolumeTestJSON-1078769545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.198s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:58:40 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[82426060-0a56-4ab2-8cb5-0a869f344820]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:58:40 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-d4610a23-6079-4500-b074-864d87fb8dc6 req-37711dff-6b4a-4dcc-88d5-9e94c9f53841 tempest-AttachVolumeTestJSON-1078769545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-d4bbff89-5683-4813-b637-be5c34e4089b {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:58:40 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-9797342b-91cd-403e-8f22-1302e66bf82c tempest-VolumesSnapshotListTestJSON-419168158 None] Create snapshot completed successfully
Jun 15 15:58:40 devstack sudo[103204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-d4bbff89-5683-4813-b637-be5c34e4089b
Jun 15 15:58:40 devstack sudo[103204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:58:41 devstack sudo[103204]: pam_unix(sudo:session): session closed for user root
Jun 15 15:58:41 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-d4610a23-6079-4500-b074-864d87fb8dc6 req-37711dff-6b4a-4dcc-88d5-9e94c9f53841 tempest-AttachVolumeTestJSON-1078769545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-d4bbff89-5683-4813-b637-be5c34e4089b" returned: 0 in 0.825s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:58:41 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [req-d4610a23-6079-4500-b074-864d87fb8dc6 req-37711dff-6b4a-4dcc-88d5-9e94c9f53841 tempest-AttachVolumeTestJSON-1078769545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.850s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:58:41 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [req-d4610a23-6079-4500-b074-864d87fb8dc6 req-37711dff-6b4a-4dcc-88d5-9e94c9f53841 tempest-AttachVolumeTestJSON-1078769545 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc', 'name': 'volume-d4bbff89-5683-4813-b637-be5c34e4089b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2b9cb88e-1f72-41b8-af7c-d83de5ef6bff', 'enforce_multipath': True} {{(pid=91863) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 15 15:58:41 devstack cinder-volume[91863]: INFO cinder.volume.manager [req-d4610a23-6079-4500-b074-864d87fb8dc6 req-37711dff-6b4a-4dcc-88d5-9e94c9f53841 tempest-AttachVolumeTestJSON-1078769545 None] attachment_update completed successfully.
Jun 15 15:58:42 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-59028f5b-fbb3-4994-b65a-d70d4c2882f7 tempest-VolumesSnapshotListTestJSON-419168158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:58:42 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-59028f5b-fbb3-4994-b65a-d70d4c2882f7 tempest-VolumesSnapshotListTestJSON-419168158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:58:42 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-59028f5b-fbb3-4994-b65a-d70d4c2882f7 tempest-VolumesSnapshotListTestJSON-419168158 None] Creating offline snapshot 763686e9-ef4d-4062-9621-3eba72bfec34 of volume 1a63d4ea-7d03-4655-9da9-2cd03b99c0b6 {{(pid=91863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 15 15:58:42 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a00345c-3090-4906-a8d0-3c6fb8b520ec]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:58:42 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-59028f5b-fbb3-4994-b65a-d70d4c2882f7 tempest-VolumesSnapshotListTestJSON-419168158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6.61380c71-f5d5-46d4-8dbb-e6f6d8c33840 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:58:42 devstack sudo[103209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6.61380c71-f5d5-46d4-8dbb-e6f6d8c33840
Jun 15 15:58:42 devstack sudo[103209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:58:43 devstack sudo[103209]: pam_unix(sudo:session): session closed for user root
Jun 15 15:58:43 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-59028f5b-fbb3-4994-b65a-d70d4c2882f7 tempest-VolumesSnapshotListTestJSON-419168158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6.61380c71-f5d5-46d4-8dbb-e6f6d8c33840" returned: 0 in 1.014s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:58:43 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-59028f5b-fbb3-4994-b65a-d70d4c2882f7 tempest-VolumesSnapshotListTestJSON-419168158 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 15:58:43 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-59028f5b-fbb3-4994-b65a-d70d4c2882f7 tempest-VolumesSnapshotListTestJSON-419168158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6.61380c71-f5d5-46d4-8dbb-e6f6d8c33840,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6.763686e9-ef4d-4062-9621-3eba72bfec34 1G {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:58:43 devstack sudo[103217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6.61380c71-f5d5-46d4-8dbb-e6f6d8c33840,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6.763686e9-ef4d-4062-9621-3eba72bfec34 1G
Jun 15 15:58:43 devstack sudo[103217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:58:44 devstack sudo[103217]: pam_unix(sudo:session): session closed for user root
Jun 15 15:58:44 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-59028f5b-fbb3-4994-b65a-d70d4c2882f7 tempest-VolumesSnapshotListTestJSON-419168158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6.61380c71-f5d5-46d4-8dbb-e6f6d8c33840,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6.763686e9-ef4d-4062-9621-3eba72bfec34 1G" returned: 0 in 0.893s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:58:44 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-59028f5b-fbb3-4994-b65a-d70d4c2882f7 tempest-VolumesSnapshotListTestJSON-419168158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6.61380c71-f5d5-46d4-8dbb-e6f6d8c33840 -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6.763686e9-ef4d-4062-9621-3eba72bfec34 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:58:44 devstack sudo[103223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6.61380c71-f5d5-46d4-8dbb-e6f6d8c33840 -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6.763686e9-ef4d-4062-9621-3eba72bfec34
Jun 15 15:58:44 devstack sudo[103223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:58:44 devstack sudo[103223]: pam_unix(sudo:session): session closed for user root
Jun 15 15:58:44 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-59028f5b-fbb3-4994-b65a-d70d4c2882f7 tempest-VolumesSnapshotListTestJSON-419168158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6.61380c71-f5d5-46d4-8dbb-e6f6d8c33840 -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6.763686e9-ef4d-4062-9621-3eba72bfec34" returned: 0 in 0.658s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:58:44 devstack cinder-volume[91863]: WARNING cinder.volume.drivers.remotefs [None req-59028f5b-fbb3-4994-b65a-d70d4c2882f7 tempest-VolumesSnapshotListTestJSON-419168158 None] /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6.763686e9-ef4d-4062-9621-3eba72bfec34 is being set with open permissions: ugo+rw
Jun 15 15:58:44 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-59028f5b-fbb3-4994-b65a-d70d4c2882f7 tempest-VolumesSnapshotListTestJSON-419168158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6.763686e9-ef4d-4062-9621-3eba72bfec34 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:58:44 devstack sudo[103229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6.763686e9-ef4d-4062-9621-3eba72bfec34
Jun 15 15:58:44 devstack sudo[103229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:58:45 devstack sudo[103229]: pam_unix(sudo:session): session closed for user root
Jun 15 15:58:45 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-59028f5b-fbb3-4994-b65a-d70d4c2882f7 tempest-VolumesSnapshotListTestJSON-419168158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6.763686e9-ef4d-4062-9621-3eba72bfec34" returned: 0 in 0.657s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:58:45 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-59028f5b-fbb3-4994-b65a-d70d4c2882f7 tempest-VolumesSnapshotListTestJSON-419168158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.385s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:58:45 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-59028f5b-fbb3-4994-b65a-d70d4c2882f7 tempest-VolumesSnapshotListTestJSON-419168158 None] Create snapshot completed successfully
Jun 15 15:58:46 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-af167889-3a04-49d2-9fe7-ce6a6433880c tempest-VolumesSnapshotListTestJSON-419168158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:58:46 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-af167889-3a04-49d2-9fe7-ce6a6433880c tempest-VolumesSnapshotListTestJSON-419168158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:58:46 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-af167889-3a04-49d2-9fe7-ce6a6433880c tempest-VolumesSnapshotListTestJSON-419168158 None] Creating offline snapshot 4e915365-1036-4c81-adc2-f609f15a62f0 of volume 1a63d4ea-7d03-4655-9da9-2cd03b99c0b6 {{(pid=91863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 15 15:58:46 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[305d533a-ae79-4a05-a55f-c1a5ffa80888]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:58:46 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-af167889-3a04-49d2-9fe7-ce6a6433880c tempest-VolumesSnapshotListTestJSON-419168158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6.763686e9-ef4d-4062-9621-3eba72bfec34 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:58:46 devstack sudo[103234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6.763686e9-ef4d-4062-9621-3eba72bfec34
Jun 15 15:58:46 devstack sudo[103234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:58:47 devstack sudo[103234]: pam_unix(sudo:session): session closed for user root
Jun 15 15:58:47 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-af167889-3a04-49d2-9fe7-ce6a6433880c tempest-VolumesSnapshotListTestJSON-419168158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6.763686e9-ef4d-4062-9621-3eba72bfec34" returned: 0 in 0.752s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:58:47 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-af167889-3a04-49d2-9fe7-ce6a6433880c tempest-VolumesSnapshotListTestJSON-419168158 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 15:58:47 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-af167889-3a04-49d2-9fe7-ce6a6433880c tempest-VolumesSnapshotListTestJSON-419168158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6.763686e9-ef4d-4062-9621-3eba72bfec34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6.4e915365-1036-4c81-adc2-f609f15a62f0 1G {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:58:47 devstack sudo[103241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6.763686e9-ef4d-4062-9621-3eba72bfec34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6.4e915365-1036-4c81-adc2-f609f15a62f0 1G
Jun 15 15:58:47 devstack sudo[103241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:58:47 devstack cinder-volume[91863]: INFO cinder.volume.manager [req-22d53ce8-1b7a-4399-91d9-9d0411a98290 req-132fd7de-5f23-40ab-b730-6e8fc7be7633 tempest-AttachVolumeTestJSON-1078769545 None] Terminate volume connection completed successfully.
Jun 15 15:58:47 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [req-22d53ce8-1b7a-4399-91d9-9d0411a98290 req-132fd7de-5f23-40ab-b730-6e8fc7be7633 tempest-AttachVolumeTestJSON-1078769545 None] Deleting attachment abeb370a-e77c-4f6e-b098-7fc72b91b1b8. {{(pid=91863) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 15 15:58:48 devstack sudo[103241]: pam_unix(sudo:session): session closed for user root
Jun 15 15:58:48 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-af167889-3a04-49d2-9fe7-ce6a6433880c tempest-VolumesSnapshotListTestJSON-419168158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6.763686e9-ef4d-4062-9621-3eba72bfec34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6.4e915365-1036-4c81-adc2-f609f15a62f0 1G" returned: 0 in 0.876s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:58:48 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-af167889-3a04-49d2-9fe7-ce6a6433880c tempest-VolumesSnapshotListTestJSON-419168158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6.763686e9-ef4d-4062-9621-3eba72bfec34 -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6.4e915365-1036-4c81-adc2-f609f15a62f0 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:58:48 devstack sudo[103249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6.763686e9-ef4d-4062-9621-3eba72bfec34 -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6.4e915365-1036-4c81-adc2-f609f15a62f0
Jun 15 15:58:48 devstack sudo[103249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:58:48 devstack sudo[103249]: pam_unix(sudo:session): session closed for user root
Jun 15 15:58:48 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-af167889-3a04-49d2-9fe7-ce6a6433880c tempest-VolumesSnapshotListTestJSON-419168158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6.763686e9-ef4d-4062-9621-3eba72bfec34 -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6.4e915365-1036-4c81-adc2-f609f15a62f0" returned: 0 in 0.722s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:58:48 devstack cinder-volume[91863]: WARNING cinder.volume.drivers.remotefs [None req-af167889-3a04-49d2-9fe7-ce6a6433880c tempest-VolumesSnapshotListTestJSON-419168158 None] /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6.4e915365-1036-4c81-adc2-f609f15a62f0 is being set with open permissions: ugo+rw
Jun 15 15:58:48 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-af167889-3a04-49d2-9fe7-ce6a6433880c tempest-VolumesSnapshotListTestJSON-419168158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6.4e915365-1036-4c81-adc2-f609f15a62f0 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:58:48 devstack sudo[103279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6.4e915365-1036-4c81-adc2-f609f15a62f0
Jun 15 15:58:48 devstack sudo[103279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:58:49 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-af167889-3a04-49d2-9fe7-ce6a6433880c tempest-VolumesSnapshotListTestJSON-419168158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6.4e915365-1036-4c81-adc2-f609f15a62f0" returned: 0 in 0.638s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:58:49 devstack sudo[103279]: pam_unix(sudo:session): session closed for user root
Jun 15 15:58:49 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-af167889-3a04-49d2-9fe7-ce6a6433880c tempest-VolumesSnapshotListTestJSON-419168158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.126s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:58:49 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-af167889-3a04-49d2-9fe7-ce6a6433880c tempest-VolumesSnapshotListTestJSON-419168158 None] Create snapshot completed successfully
Jun 15 15:58:50 devstack cinder-volume[91863]: INFO cinder.volume.manager [req-ace4f064-bfb9-47c1-9c62-fe19c97c0cd5 req-683fe628-3362-444d-8a53-962fde6d85e0 tempest-AttachVolumeTestJSON-1078769545 None] Terminate volume connection completed successfully.
Jun 15 15:58:50 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [req-ace4f064-bfb9-47c1-9c62-fe19c97c0cd5 req-683fe628-3362-444d-8a53-962fde6d85e0 tempest-AttachVolumeTestJSON-1078769545 None] Deleting attachment 2b9cb88e-1f72-41b8-af7c-d83de5ef6bff. {{(pid=91863) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 15 15:58:51 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-8751bf31-81a9-4421-9c50-6e7aebb59649 tempest-VolumesSnapshotListTestJSON-419168158 None] Acquiring lock "cinder-4e915365-1036-4c81-adc2-f609f15a62f0-delete_snapshot" by "delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:58:51 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-8751bf31-81a9-4421-9c50-6e7aebb59649 tempest-VolumesSnapshotListTestJSON-419168158 None] Lock "cinder-4e915365-1036-4c81-adc2-f609f15a62f0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:58:51 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-8751bf31-81a9-4421-9c50-6e7aebb59649 tempest-VolumesSnapshotListTestJSON-419168158 None] Acquiring lock "cinder-quobyte-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6" by "delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:58:51 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-8751bf31-81a9-4421-9c50-6e7aebb59649 tempest-VolumesSnapshotListTestJSON-419168158 None] Lock "cinder-quobyte-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6" acquired by "delete_snapshot" :: waited 0.015s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:58:51 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-8751bf31-81a9-4421-9c50-6e7aebb59649 tempest-VolumesSnapshotListTestJSON-419168158 None] Acquiring lock "cinder-quobyte-4e915365-1036-4c81-adc2-f609f15a62f0" by "_delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:58:51 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-8751bf31-81a9-4421-9c50-6e7aebb59649 tempest-VolumesSnapshotListTestJSON-419168158 None] Lock "cinder-quobyte-4e915365-1036-4c81-adc2-f609f15a62f0" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:58:51 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-8751bf31-81a9-4421-9c50-6e7aebb59649 tempest-VolumesSnapshotListTestJSON-419168158 None] Deleting offline snapshot 4e915365-1036-4c81-adc2-f609f15a62f0 of volume 1a63d4ea-7d03-4655-9da9-2cd03b99c0b6 {{(pid=91863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 15 15:58:51 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-8751bf31-81a9-4421-9c50-6e7aebb59649 tempest-VolumesSnapshotListTestJSON-419168158 None] snapshot_file for this snap is: volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6.4e915365-1036-4c81-adc2-f609f15a62f0 {{(pid=91863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 15 15:58:51 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db9442f-eb38-4cc6-bbdc-303164e01c7c]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:58:51 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-8751bf31-81a9-4421-9c50-6e7aebb59649 tempest-VolumesSnapshotListTestJSON-419168158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6.4e915365-1036-4c81-adc2-f609f15a62f0 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:58:51 devstack sudo[103287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6.4e915365-1036-4c81-adc2-f609f15a62f0
Jun 15 15:58:51 devstack sudo[103287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:58:52 devstack sudo[103287]: pam_unix(sudo:session): session closed for user root
Jun 15 15:58:52 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-8751bf31-81a9-4421-9c50-6e7aebb59649 tempest-VolumesSnapshotListTestJSON-419168158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6.4e915365-1036-4c81-adc2-f609f15a62f0" returned: 0 in 0.846s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:58:52 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-8751bf31-81a9-4421-9c50-6e7aebb59649 tempest-VolumesSnapshotListTestJSON-419168158 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 15:58:52 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7052e7-7bf9-40de-aac9-4f0d34b52fa8]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:58:52 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-8751bf31-81a9-4421-9c50-6e7aebb59649 tempest-VolumesSnapshotListTestJSON-419168158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6.763686e9-ef4d-4062-9621-3eba72bfec34 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:58:52 devstack sudo[103292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6.763686e9-ef4d-4062-9621-3eba72bfec34
Jun 15 15:58:52 devstack sudo[103292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:58:53 devstack sudo[103292]: pam_unix(sudo:session): session closed for user root
Jun 15 15:58:53 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-8751bf31-81a9-4421-9c50-6e7aebb59649 tempest-VolumesSnapshotListTestJSON-419168158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6.763686e9-ef4d-4062-9621-3eba72bfec34" returned: 0 in 0.922s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:58:53 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-8751bf31-81a9-4421-9c50-6e7aebb59649 tempest-VolumesSnapshotListTestJSON-419168158 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 15:58:53 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-8751bf31-81a9-4421-9c50-6e7aebb59649 tempest-VolumesSnapshotListTestJSON-419168158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6.4e915365-1036-4c81-adc2-f609f15a62f0 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:58:53 devstack sudo[103297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6.4e915365-1036-4c81-adc2-f609f15a62f0
Jun 15 15:58:53 devstack sudo[103297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:58:54 devstack sudo[103297]: pam_unix(sudo:session): session closed for user root
Jun 15 15:58:54 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-8751bf31-81a9-4421-9c50-6e7aebb59649 tempest-VolumesSnapshotListTestJSON-419168158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6.4e915365-1036-4c81-adc2-f609f15a62f0" returned: 0 in 1.248s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:58:54 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-8751bf31-81a9-4421-9c50-6e7aebb59649 tempest-VolumesSnapshotListTestJSON-419168158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6.4e915365-1036-4c81-adc2-f609f15a62f0 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:58:54 devstack sudo[103344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6.4e915365-1036-4c81-adc2-f609f15a62f0
Jun 15 15:58:54 devstack sudo[103344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:58:55 devstack sudo[103344]: pam_unix(sudo:session): session closed for user root
Jun 15 15:58:55 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-8751bf31-81a9-4421-9c50-6e7aebb59649 tempest-VolumesSnapshotListTestJSON-419168158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6.4e915365-1036-4c81-adc2-f609f15a62f0" returned: 0 in 0.702s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:58:55 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-8751bf31-81a9-4421-9c50-6e7aebb59649 tempest-VolumesSnapshotListTestJSON-419168158 None] Lock "cinder-quobyte-4e915365-1036-4c81-adc2-f609f15a62f0" released by "_delete_snapshot" :: held 3.843s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:58:55 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-8751bf31-81a9-4421-9c50-6e7aebb59649 tempest-VolumesSnapshotListTestJSON-419168158 None] Lock "cinder-quobyte-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6" released by "delete_snapshot" :: held 3.865s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:58:55 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-8751bf31-81a9-4421-9c50-6e7aebb59649 tempest-VolumesSnapshotListTestJSON-419168158 None] Created reservations ['e33484fa-4730-4f81-906f-3d312258de95', 'bc4fa7de-ae62-4601-9de2-4867f152133c', 'fa165a91-5782-4c03-9dd2-5d7b99e57f7f', '7d8c4f42-708a-4193-9c8d-575db160ec09'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:58:55 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-8751bf31-81a9-4421-9c50-6e7aebb59649 tempest-VolumesSnapshotListTestJSON-419168158 None] Delete snapshot completed successfully.
Jun 15 15:58:55 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-8751bf31-81a9-4421-9c50-6e7aebb59649 tempest-VolumesSnapshotListTestJSON-419168158 None] Lock "cinder-4e915365-1036-4c81-adc2-f609f15a62f0-delete_snapshot" released by "delete_snapshot" :: held 4.018s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:58:55 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-3921f15b-2403-4bd9-b2b4-ef87ea6b0a12 tempest-VolumesSnapshotListTestJSON-419168158 None] Acquiring lock "cinder-763686e9-ef4d-4062-9621-3eba72bfec34-delete_snapshot" by "delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:58:55 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-3921f15b-2403-4bd9-b2b4-ef87ea6b0a12 tempest-VolumesSnapshotListTestJSON-419168158 None] Lock "cinder-763686e9-ef4d-4062-9621-3eba72bfec34-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:58:55 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-3921f15b-2403-4bd9-b2b4-ef87ea6b0a12 tempest-VolumesSnapshotListTestJSON-419168158 None] Acquiring lock "cinder-quobyte-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6" by "delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:58:55 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-3921f15b-2403-4bd9-b2b4-ef87ea6b0a12 tempest-VolumesSnapshotListTestJSON-419168158 None] Lock "cinder-quobyte-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6" acquired by "delete_snapshot" :: waited 0.034s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:58:55 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-3921f15b-2403-4bd9-b2b4-ef87ea6b0a12 tempest-VolumesSnapshotListTestJSON-419168158 None] Acquiring lock "cinder-quobyte-763686e9-ef4d-4062-9621-3eba72bfec34" by "_delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:58:55 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-3921f15b-2403-4bd9-b2b4-ef87ea6b0a12 tempest-VolumesSnapshotListTestJSON-419168158 None] Lock "cinder-quobyte-763686e9-ef4d-4062-9621-3eba72bfec34" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:58:55 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-3921f15b-2403-4bd9-b2b4-ef87ea6b0a12 tempest-VolumesSnapshotListTestJSON-419168158 None] Deleting offline snapshot 763686e9-ef4d-4062-9621-3eba72bfec34 of volume 1a63d4ea-7d03-4655-9da9-2cd03b99c0b6 {{(pid=91863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 15 15:58:55 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-3921f15b-2403-4bd9-b2b4-ef87ea6b0a12 tempest-VolumesSnapshotListTestJSON-419168158 None] snapshot_file for this snap is: volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6.763686e9-ef4d-4062-9621-3eba72bfec34 {{(pid=91863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 15 15:58:55 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de7698a-db3f-4ae4-909b-56b871198861]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:58:55 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3921f15b-2403-4bd9-b2b4-ef87ea6b0a12 tempest-VolumesSnapshotListTestJSON-419168158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6.763686e9-ef4d-4062-9621-3eba72bfec34 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:58:56 devstack sudo[103362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6.763686e9-ef4d-4062-9621-3eba72bfec34
Jun 15 15:58:56 devstack sudo[103362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:58:56 devstack sudo[103362]: pam_unix(sudo:session): session closed for user root
Jun 15 15:58:56 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3921f15b-2403-4bd9-b2b4-ef87ea6b0a12 tempest-VolumesSnapshotListTestJSON-419168158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6.763686e9-ef4d-4062-9621-3eba72bfec34" returned: 0 in 0.816s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:58:56 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-3921f15b-2403-4bd9-b2b4-ef87ea6b0a12 tempest-VolumesSnapshotListTestJSON-419168158 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 15:58:56 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aecbf30-8604-413a-8d19-2923fe2c02d4]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:58:56 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3921f15b-2403-4bd9-b2b4-ef87ea6b0a12 tempest-VolumesSnapshotListTestJSON-419168158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6.61380c71-f5d5-46d4-8dbb-e6f6d8c33840 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:58:56 devstack sudo[103368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6.61380c71-f5d5-46d4-8dbb-e6f6d8c33840
Jun 15 15:58:56 devstack sudo[103368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:58:57 devstack sudo[103368]: pam_unix(sudo:session): session closed for user root
Jun 15 15:58:57 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3921f15b-2403-4bd9-b2b4-ef87ea6b0a12 tempest-VolumesSnapshotListTestJSON-419168158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6.61380c71-f5d5-46d4-8dbb-e6f6d8c33840" returned: 0 in 0.794s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:58:57 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-3921f15b-2403-4bd9-b2b4-ef87ea6b0a12 tempest-VolumesSnapshotListTestJSON-419168158 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 15:58:57 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3921f15b-2403-4bd9-b2b4-ef87ea6b0a12 tempest-VolumesSnapshotListTestJSON-419168158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6.763686e9-ef4d-4062-9621-3eba72bfec34 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:58:57 devstack sudo[103374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6.763686e9-ef4d-4062-9621-3eba72bfec34
Jun 15 15:58:57 devstack sudo[103374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:58:58 devstack sudo[103374]: pam_unix(sudo:session): session closed for user root
Jun 15 15:58:58 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3921f15b-2403-4bd9-b2b4-ef87ea6b0a12 tempest-VolumesSnapshotListTestJSON-419168158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6.763686e9-ef4d-4062-9621-3eba72bfec34" returned: 0 in 0.795s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:58:58 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3921f15b-2403-4bd9-b2b4-ef87ea6b0a12 tempest-VolumesSnapshotListTestJSON-419168158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6.763686e9-ef4d-4062-9621-3eba72bfec34 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:58:58 devstack sudo[103379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6.763686e9-ef4d-4062-9621-3eba72bfec34
Jun 15 15:58:58 devstack sudo[103379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:58:58 devstack sudo[103379]: pam_unix(sudo:session): session closed for user root
Jun 15 15:58:58 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3921f15b-2403-4bd9-b2b4-ef87ea6b0a12 tempest-VolumesSnapshotListTestJSON-419168158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6.763686e9-ef4d-4062-9621-3eba72bfec34" returned: 0 in 0.653s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:58:59 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-3921f15b-2403-4bd9-b2b4-ef87ea6b0a12 tempest-VolumesSnapshotListTestJSON-419168158 None] Lock "cinder-quobyte-763686e9-ef4d-4062-9621-3eba72bfec34" released by "_delete_snapshot" :: held 3.186s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:58:59 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-3921f15b-2403-4bd9-b2b4-ef87ea6b0a12 tempest-VolumesSnapshotListTestJSON-419168158 None] Lock "cinder-quobyte-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6" released by "delete_snapshot" :: held 3.212s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:58:59 devstack cinder-volume[91863]: DEBUG dbcounter [-] [91863] Writing DB stats cinder:SELECT=69,cinder:INSERT=23,cinder:UPDATE=74,cinder:DELETE=8 {{(pid=91863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 15:58:59 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-3921f15b-2403-4bd9-b2b4-ef87ea6b0a12 tempest-VolumesSnapshotListTestJSON-419168158 None] Created reservations ['07052766-e582-4747-8fea-268601696306', '427a7d35-2e9d-449c-82b2-6ed25342ac9a', '3e34a054-0404-43af-982c-52a69c7bb88a', '63454f8f-86ff-45e1-a91c-d7a5cb9ca007'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:58:59 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-3921f15b-2403-4bd9-b2b4-ef87ea6b0a12 tempest-VolumesSnapshotListTestJSON-419168158 None] Delete snapshot completed successfully.
Jun 15 15:58:59 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-3921f15b-2403-4bd9-b2b4-ef87ea6b0a12 tempest-VolumesSnapshotListTestJSON-419168158 None] Lock "cinder-763686e9-ef4d-4062-9621-3eba72bfec34-delete_snapshot" released by "delete_snapshot" :: held 3.371s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:59:00 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-ffe01310-bb34-4fad-acad-82f259529aed tempest-VolumesSnapshotListTestJSON-419168158 None] Acquiring lock "cinder-61380c71-f5d5-46d4-8dbb-e6f6d8c33840-delete_snapshot" by "delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:59:00 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-ffe01310-bb34-4fad-acad-82f259529aed tempest-VolumesSnapshotListTestJSON-419168158 None] Lock "cinder-61380c71-f5d5-46d4-8dbb-e6f6d8c33840-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:59:00 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-ffe01310-bb34-4fad-acad-82f259529aed tempest-VolumesSnapshotListTestJSON-419168158 None] Acquiring lock "cinder-quobyte-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6" by "delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:59:00 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-ffe01310-bb34-4fad-acad-82f259529aed tempest-VolumesSnapshotListTestJSON-419168158 None] Lock "cinder-quobyte-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6" acquired by "delete_snapshot" :: waited 0.027s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:59:00 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-ffe01310-bb34-4fad-acad-82f259529aed tempest-VolumesSnapshotListTestJSON-419168158 None] Acquiring lock "cinder-quobyte-61380c71-f5d5-46d4-8dbb-e6f6d8c33840" by "_delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:59:00 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-ffe01310-bb34-4fad-acad-82f259529aed tempest-VolumesSnapshotListTestJSON-419168158 None] Lock "cinder-quobyte-61380c71-f5d5-46d4-8dbb-e6f6d8c33840" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:59:00 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-ffe01310-bb34-4fad-acad-82f259529aed tempest-VolumesSnapshotListTestJSON-419168158 None] Deleting offline snapshot 61380c71-f5d5-46d4-8dbb-e6f6d8c33840 of volume 1a63d4ea-7d03-4655-9da9-2cd03b99c0b6 {{(pid=91863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 15 15:59:00 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-ffe01310-bb34-4fad-acad-82f259529aed tempest-VolumesSnapshotListTestJSON-419168158 None] snapshot_file for this snap is: volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6.61380c71-f5d5-46d4-8dbb-e6f6d8c33840 {{(pid=91863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 15 15:59:00 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a44dcb0-aa67-4e19-8dd9-183bc896bf93]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:59:00 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ffe01310-bb34-4fad-acad-82f259529aed tempest-VolumesSnapshotListTestJSON-419168158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6.61380c71-f5d5-46d4-8dbb-e6f6d8c33840 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:59:00 devstack sudo[103386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6.61380c71-f5d5-46d4-8dbb-e6f6d8c33840
Jun 15 15:59:00 devstack sudo[103386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:59:01 devstack sudo[103386]: pam_unix(sudo:session): session closed for user root
Jun 15 15:59:01 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ffe01310-bb34-4fad-acad-82f259529aed tempest-VolumesSnapshotListTestJSON-419168158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6.61380c71-f5d5-46d4-8dbb-e6f6d8c33840" returned: 0 in 1.054s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:59:01 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-ffe01310-bb34-4fad-acad-82f259529aed tempest-VolumesSnapshotListTestJSON-419168158 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 15:59:01 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f8b468a-f3a6-43e3-8a75-06032104fb42]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:59:01 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ffe01310-bb34-4fad-acad-82f259529aed tempest-VolumesSnapshotListTestJSON-419168158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:59:01 devstack sudo[103450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6
Jun 15 15:59:01 devstack sudo[103450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:59:01 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-21fec74f-6d0e-4e30-903b-20a3832f24f3 tempest-AttachVolumeTestJSON-1078769545 None] Acquiring lock "cinder-d4bbff89-5683-4813-b637-be5c34e4089b-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:59:01 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-21fec74f-6d0e-4e30-903b-20a3832f24f3 tempest-AttachVolumeTestJSON-1078769545 None] Lock "cinder-d4bbff89-5683-4813-b637-be5c34e4089b-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:59:01 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-21fec74f-6d0e-4e30-903b-20a3832f24f3 tempest-AttachVolumeTestJSON-1078769545 None] Acquiring lock "cinder-quobyte-d4bbff89-5683-4813-b637-be5c34e4089b" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:59:02 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-21fec74f-6d0e-4e30-903b-20a3832f24f3 tempest-AttachVolumeTestJSON-1078769545 None] Lock "cinder-quobyte-d4bbff89-5683-4813-b637-be5c34e4089b" acquired by "delete_volume" :: waited 0.039s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:59:02 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f70e111d-16b3-4da1-9cd1-ca341171f3a2]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:59:02 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-21fec74f-6d0e-4e30-903b-20a3832f24f3 tempest-AttachVolumeTestJSON-1078769545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-d4bbff89-5683-4813-b637-be5c34e4089b {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:59:02 devstack sudo[103457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-d4bbff89-5683-4813-b637-be5c34e4089b
Jun 15 15:59:02 devstack sudo[103457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:59:02 devstack sudo[103450]: pam_unix(sudo:session): session closed for user root
Jun 15 15:59:02 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ffe01310-bb34-4fad-acad-82f259529aed tempest-VolumesSnapshotListTestJSON-419168158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6" returned: 0 in 1.015s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:59:02 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ffe01310-bb34-4fad-acad-82f259529aed tempest-VolumesSnapshotListTestJSON-419168158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6.61380c71-f5d5-46d4-8dbb-e6f6d8c33840 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:59:02 devstack sudo[103461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6.61380c71-f5d5-46d4-8dbb-e6f6d8c33840
Jun 15 15:59:02 devstack sudo[103461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:59:03 devstack sudo[103457]: pam_unix(sudo:session): session closed for user root
Jun 15 15:59:03 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-21fec74f-6d0e-4e30-903b-20a3832f24f3 tempest-AttachVolumeTestJSON-1078769545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-d4bbff89-5683-4813-b637-be5c34e4089b" returned: 0 in 0.927s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:59:03 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-21fec74f-6d0e-4e30-903b-20a3832f24f3 tempest-AttachVolumeTestJSON-1078769545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-d4bbff89-5683-4813-b637-be5c34e4089b {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:59:03 devstack sudo[103469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-d4bbff89-5683-4813-b637-be5c34e4089b
Jun 15 15:59:03 devstack sudo[103469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:59:03 devstack sudo[103461]: pam_unix(sudo:session): session closed for user root
Jun 15 15:59:03 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ffe01310-bb34-4fad-acad-82f259529aed tempest-VolumesSnapshotListTestJSON-419168158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6.61380c71-f5d5-46d4-8dbb-e6f6d8c33840" returned: 0 in 0.992s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:59:03 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ffe01310-bb34-4fad-acad-82f259529aed tempest-VolumesSnapshotListTestJSON-419168158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6.61380c71-f5d5-46d4-8dbb-e6f6d8c33840 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:59:03 devstack sudo[103472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6.61380c71-f5d5-46d4-8dbb-e6f6d8c33840
Jun 15 15:59:03 devstack sudo[103472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:59:04 devstack sudo[103469]: pam_unix(sudo:session): session closed for user root
Jun 15 15:59:04 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-21fec74f-6d0e-4e30-903b-20a3832f24f3 tempest-AttachVolumeTestJSON-1078769545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-d4bbff89-5683-4813-b637-be5c34e4089b" returned: 0 in 1.159s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:59:04 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-21fec74f-6d0e-4e30-903b-20a3832f24f3 tempest-AttachVolumeTestJSON-1078769545 None] Lock "cinder-quobyte-d4bbff89-5683-4813-b637-be5c34e4089b" released by "delete_volume" :: held 2.189s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:59:04 devstack sudo[103472]: pam_unix(sudo:session): session closed for user root
Jun 15 15:59:04 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ffe01310-bb34-4fad-acad-82f259529aed tempest-VolumesSnapshotListTestJSON-419168158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6.61380c71-f5d5-46d4-8dbb-e6f6d8c33840" returned: 0 in 1.018s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:59:04 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-ffe01310-bb34-4fad-acad-82f259529aed tempest-VolumesSnapshotListTestJSON-419168158 None] Lock "cinder-quobyte-61380c71-f5d5-46d4-8dbb-e6f6d8c33840" released by "_delete_snapshot" :: held 4.286s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:59:04 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-21fec74f-6d0e-4e30-903b-20a3832f24f3 tempest-AttachVolumeTestJSON-1078769545 None] Created reservations ['5a678db2-c44d-45a8-b99a-75e42bbdc8ba', 'f727eb35-2732-4d79-99bb-e5f2c314d536', '84c4b9dc-c696-413d-b5c9-8a6aeacd3440', '022db291-158d-4c77-8165-8f9ed1608a2e'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:59:04 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-ffe01310-bb34-4fad-acad-82f259529aed tempest-VolumesSnapshotListTestJSON-419168158 None] Lock "cinder-quobyte-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6" released by "delete_snapshot" :: held 4.330s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:59:04 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-21fec74f-6d0e-4e30-903b-20a3832f24f3 tempest-AttachVolumeTestJSON-1078769545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:59:04 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-21fec74f-6d0e-4e30-903b-20a3832f24f3 tempest-AttachVolumeTestJSON-1078769545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:59:04 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-21fec74f-6d0e-4e30-903b-20a3832f24f3 tempest-AttachVolumeTestJSON-1078769545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:59:04 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-21fec74f-6d0e-4e30-903b-20a3832f24f3 tempest-AttachVolumeTestJSON-1078769545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:59:04 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-21fec74f-6d0e-4e30-903b-20a3832f24f3 tempest-AttachVolumeTestJSON-1078769545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:59:04 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-21fec74f-6d0e-4e30-903b-20a3832f24f3 tempest-AttachVolumeTestJSON-1078769545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:59:04 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-ffe01310-bb34-4fad-acad-82f259529aed tempest-VolumesSnapshotListTestJSON-419168158 None] Created reservations ['daddb885-5b70-4485-946d-f908ae37bbc5', '3e7adb93-08c4-4183-ac8b-02ebe7070e26', '1561baca-2fde-4a29-a7b8-d017a5e019db', 'b4852f99-febd-4fbd-9c15-1b97e350106e'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:59:04 devstack sudo[103478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:59:04 devstack sudo[103478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:59:04 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-ffe01310-bb34-4fad-acad-82f259529aed tempest-VolumesSnapshotListTestJSON-419168158 None] Delete snapshot completed successfully.
Jun 15 15:59:04 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-8694e2c4-c5b9-44f3-b4e9-8fa26a1d4ec4 tempest-VolumesActionsTest-1837607340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 15:59:04 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8694e2c4-c5b9-44f3-b4e9-8fa26a1d4ec4 tempest-VolumesActionsTest-1837607340 None] Flow 'volume_create_manager' (ed9faeb5-feba-4566-ada2-862ecc431ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:59:04 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8694e2c4-c5b9-44f3-b4e9-8fa26a1d4ec4 tempest-VolumesActionsTest-1837607340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfaafb20-67e5-4f22-bf74-1241c4ff102d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:59:04 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-ffe01310-bb34-4fad-acad-82f259529aed tempest-VolumesSnapshotListTestJSON-419168158 None] Lock "cinder-61380c71-f5d5-46d4-8dbb-e6f6d8c33840-delete_snapshot" released by "delete_snapshot" :: held 4.674s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:59:04 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8694e2c4-c5b9-44f3-b4e9-8fa26a1d4ec4 tempest-VolumesActionsTest-1837607340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfaafb20-67e5-4f22-bf74-1241c4ff102d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:59:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1925166774',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da7b69b4-4951-4ca0-887c-011595e943b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed1443b4096a41ceb58964e938e1fa7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:59:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:59:05Z,use_quota=True,user_id='3a282a052d074757a0a2984e7a52b4ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:59:04 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8694e2c4-c5b9-44f3-b4e9-8fa26a1d4ec4 tempest-VolumesActionsTest-1837607340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6ec9d4a-be65-4f8a-be68-fadb23b66274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:59:04 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8694e2c4-c5b9-44f3-b4e9-8fa26a1d4ec4 tempest-VolumesActionsTest-1837607340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6ec9d4a-be65-4f8a-be68-fadb23b66274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:59:04 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8694e2c4-c5b9-44f3-b4e9-8fa26a1d4ec4 tempest-VolumesActionsTest-1837607340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24a18298-6157-4e8a-86a3-016f5f325c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:59:04 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8694e2c4-c5b9-44f3-b4e9-8fa26a1d4ec4 tempest-VolumesActionsTest-1837607340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24a18298-6157-4e8a-86a3-016f5f325c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da7b69b4-4951-4ca0-887c-011595e943b0', 'volume_name': 'volume-da7b69b4-4951-4ca0-887c-011595e943b0', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:59:04 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8694e2c4-c5b9-44f3-b4e9-8fa26a1d4ec4 tempest-VolumesActionsTest-1837607340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0498f50-e184-4e3f-8a1b-19db678a0ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:59:04 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8694e2c4-c5b9-44f3-b4e9-8fa26a1d4ec4 tempest-VolumesActionsTest-1837607340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0498f50-e184-4e3f-8a1b-19db678a0ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:59:04 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8694e2c4-c5b9-44f3-b4e9-8fa26a1d4ec4 tempest-VolumesActionsTest-1837607340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4565782b-8dec-4686-9c93-8a46fe3f225e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:59:04 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-8694e2c4-c5b9-44f3-b4e9-8fa26a1d4ec4 tempest-VolumesActionsTest-1837607340 None] Volume da7b69b4-4951-4ca0-887c-011595e943b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da7b69b4-4951-4ca0-887c-011595e943b0', 'volume_size': 1}
Jun 15 15:59:04 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-8694e2c4-c5b9-44f3-b4e9-8fa26a1d4ec4 tempest-VolumesActionsTest-1837607340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:59:04 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-8694e2c4-c5b9-44f3-b4e9-8fa26a1d4ec4 tempest-VolumesActionsTest-1837607340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:59:04 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-8694e2c4-c5b9-44f3-b4e9-8fa26a1d4ec4 tempest-VolumesActionsTest-1837607340 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:59:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1925166774',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da7b69b4-4951-4ca0-887c-011595e943b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed1443b4096a41ceb58964e938e1fa7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:59:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:59:05Z,use_quota=True,user_id='3a282a052d074757a0a2984e7a52b4ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 15:59:04 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-8694e2c4-c5b9-44f3-b4e9-8fa26a1d4ec4 tempest-VolumesActionsTest-1837607340 None] Creating volume da7b69b4-4951-4ca0-887c-011595e943b0 {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 15:59:04 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-8694e2c4-c5b9-44f3-b4e9-8fa26a1d4ec4 tempest-VolumesActionsTest-1837607340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:59:04 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-8694e2c4-c5b9-44f3-b4e9-8fa26a1d4ec4 tempest-VolumesActionsTest-1837607340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:59:04 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-8694e2c4-c5b9-44f3-b4e9-8fa26a1d4ec4 tempest-VolumesActionsTest-1837607340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:59:04 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-8694e2c4-c5b9-44f3-b4e9-8fa26a1d4ec4 tempest-VolumesActionsTest-1837607340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:59:04 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-8694e2c4-c5b9-44f3-b4e9-8fa26a1d4ec4 tempest-VolumesActionsTest-1837607340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:59:04 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-8694e2c4-c5b9-44f3-b4e9-8fa26a1d4ec4 tempest-VolumesActionsTest-1837607340 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 15:59:04 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-8694e2c4-c5b9-44f3-b4e9-8fa26a1d4ec4 tempest-VolumesActionsTest-1837607340 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 15:59:04 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-8694e2c4-c5b9-44f3-b4e9-8fa26a1d4ec4 tempest-VolumesActionsTest-1837607340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-da7b69b4-4951-4ca0-887c-011595e943b0 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:59:04 devstack sudo[103480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-da7b69b4-4951-4ca0-887c-011595e943b0 1073741824
Jun 15 15:59:04 devstack sudo[103480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:59:05 devstack sudo[103478]: pam_unix(sudo:session): session closed for user root
Jun 15 15:59:05 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-21fec74f-6d0e-4e30-903b-20a3832f24f3 tempest-AttachVolumeTestJSON-1078769545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.770s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:59:05 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-21fec74f-6d0e-4e30-903b-20a3832f24f3 tempest-AttachVolumeTestJSON-1078769545 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:59:05 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-21fec74f-6d0e-4e30-903b-20a3832f24f3 tempest-AttachVolumeTestJSON-1078769545 None] Deleted volume successfully.
Jun 15 15:59:05 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-21fec74f-6d0e-4e30-903b-20a3832f24f3 tempest-AttachVolumeTestJSON-1078769545 None] Lock "cinder-d4bbff89-5683-4813-b637-be5c34e4089b-delete_volume" released by "delete_volume" :: held 3.491s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:59:05 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-bae31a62-04b1-461e-a848-1f8ff9e29d40 tempest-AttachVolumeTestJSON-1078769545 None] Acquiring lock "cinder-db6d9905-80b8-41d1-af9c-350ec887547a-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:59:05 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-bae31a62-04b1-461e-a848-1f8ff9e29d40 tempest-AttachVolumeTestJSON-1078769545 None] Lock "cinder-db6d9905-80b8-41d1-af9c-350ec887547a-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:59:05 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-bae31a62-04b1-461e-a848-1f8ff9e29d40 tempest-AttachVolumeTestJSON-1078769545 None] Acquiring lock "cinder-quobyte-db6d9905-80b8-41d1-af9c-350ec887547a" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:59:05 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-bae31a62-04b1-461e-a848-1f8ff9e29d40 tempest-AttachVolumeTestJSON-1078769545 None] Lock "cinder-quobyte-db6d9905-80b8-41d1-af9c-350ec887547a" acquired by "delete_volume" :: waited 0.041s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:59:05 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-59e9b6c6-06ba-44fc-ab3e-9f5040ea20b2 tempest-VolumesSnapshotListTestJSON-419168158 None] Acquiring lock "cinder-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:59:05 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[719a7172-7323-4ff2-b433-5ac032938f48]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:59:05 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-bae31a62-04b1-461e-a848-1f8ff9e29d40 tempest-AttachVolumeTestJSON-1078769545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-db6d9905-80b8-41d1-af9c-350ec887547a {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:59:05 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-59e9b6c6-06ba-44fc-ab3e-9f5040ea20b2 tempest-VolumesSnapshotListTestJSON-419168158 None] Lock "cinder-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:59:05 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-59e9b6c6-06ba-44fc-ab3e-9f5040ea20b2 tempest-VolumesSnapshotListTestJSON-419168158 None] Acquiring lock "cinder-quobyte-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:59:05 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-59e9b6c6-06ba-44fc-ab3e-9f5040ea20b2 tempest-VolumesSnapshotListTestJSON-419168158 None] Lock "cinder-quobyte-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6" acquired by "delete_volume" :: waited 0.033s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:59:05 devstack sudo[103493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-db6d9905-80b8-41d1-af9c-350ec887547a
Jun 15 15:59:05 devstack sudo[103493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:59:05 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fdd0eed-0502-4ec1-b413-385fb4089744]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:59:05 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-59e9b6c6-06ba-44fc-ab3e-9f5040ea20b2 tempest-VolumesSnapshotListTestJSON-419168158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:59:06 devstack sudo[103496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6
Jun 15 15:59:06 devstack sudo[103496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:59:06 devstack sudo[103480]: pam_unix(sudo:session): session closed for user root
Jun 15 15:59:06 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-8694e2c4-c5b9-44f3-b4e9-8fa26a1d4ec4 tempest-VolumesActionsTest-1837607340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-da7b69b4-4951-4ca0-887c-011595e943b0 1073741824" returned: 0 in 1.345s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:59:06 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-8694e2c4-c5b9-44f3-b4e9-8fa26a1d4ec4 tempest-VolumesActionsTest-1837607340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-da7b69b4-4951-4ca0-887c-011595e943b0 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:59:06 devstack sudo[103498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-da7b69b4-4951-4ca0-887c-011595e943b0
Jun 15 15:59:06 devstack sudo[103498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:59:06 devstack sudo[103496]: pam_unix(sudo:session): session closed for user root
Jun 15 15:59:06 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-59e9b6c6-06ba-44fc-ab3e-9f5040ea20b2 tempest-VolumesSnapshotListTestJSON-419168158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6" returned: 0 in 1.027s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:59:06 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-59e9b6c6-06ba-44fc-ab3e-9f5040ea20b2 tempest-VolumesSnapshotListTestJSON-419168158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:59:07 devstack sudo[103508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6
Jun 15 15:59:07 devstack sudo[103508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:59:07 devstack sudo[103493]: pam_unix(sudo:session): session closed for user root
Jun 15 15:59:07 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-bae31a62-04b1-461e-a848-1f8ff9e29d40 tempest-AttachVolumeTestJSON-1078769545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-db6d9905-80b8-41d1-af9c-350ec887547a" returned: 0 in 1.358s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:59:07 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-bae31a62-04b1-461e-a848-1f8ff9e29d40 tempest-AttachVolumeTestJSON-1078769545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-db6d9905-80b8-41d1-af9c-350ec887547a {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:59:07 devstack sudo[103498]: pam_unix(sudo:session): session closed for user root
Jun 15 15:59:07 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-8694e2c4-c5b9-44f3-b4e9-8fa26a1d4ec4 tempest-VolumesActionsTest-1837607340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-da7b69b4-4951-4ca0-887c-011595e943b0" returned: 0 in 0.897s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:59:07 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-8694e2c4-c5b9-44f3-b4e9-8fa26a1d4ec4 tempest-VolumesActionsTest-1837607340 None] <== create_volume: return (2320ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 15:59:07 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-8694e2c4-c5b9-44f3-b4e9-8fa26a1d4ec4 tempest-VolumesActionsTest-1837607340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.323s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:59:07 devstack sudo[103511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-db6d9905-80b8-41d1-af9c-350ec887547a
Jun 15 15:59:07 devstack sudo[103511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:59:07 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8694e2c4-c5b9-44f3-b4e9-8fa26a1d4ec4 tempest-VolumesActionsTest-1837607340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4565782b-8dec-4686-9c93-8a46fe3f225e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da7b69b4-4951-4ca0-887c-011595e943b0', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:59:07 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8694e2c4-c5b9-44f3-b4e9-8fa26a1d4ec4 tempest-VolumesActionsTest-1837607340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (692be997-069a-49f4-8bb9-4fe4cd1e2542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:59:07 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-8694e2c4-c5b9-44f3-b4e9-8fa26a1d4ec4 tempest-VolumesActionsTest-1837607340 None] Volume volume-da7b69b4-4951-4ca0-887c-011595e943b0 (da7b69b4-4951-4ca0-887c-011595e943b0): created successfully
Jun 15 15:59:07 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8694e2c4-c5b9-44f3-b4e9-8fa26a1d4ec4 tempest-VolumesActionsTest-1837607340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (692be997-069a-49f4-8bb9-4fe4cd1e2542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:59:07 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8694e2c4-c5b9-44f3-b4e9-8fa26a1d4ec4 tempest-VolumesActionsTest-1837607340 None] Flow 'volume_create_manager' (ed9faeb5-feba-4566-ada2-862ecc431ef4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:59:07 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-8694e2c4-c5b9-44f3-b4e9-8fa26a1d4ec4 tempest-VolumesActionsTest-1837607340 None] Created volume successfully.
Jun 15 15:59:07 devstack sudo[103508]: pam_unix(sudo:session): session closed for user root
Jun 15 15:59:07 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-59e9b6c6-06ba-44fc-ab3e-9f5040ea20b2 tempest-VolumesSnapshotListTestJSON-419168158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6" returned: 0 in 0.683s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:59:07 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-59e9b6c6-06ba-44fc-ab3e-9f5040ea20b2 tempest-VolumesSnapshotListTestJSON-419168158 None] Lock "cinder-quobyte-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6" released by "delete_volume" :: held 1.805s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:59:07 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-59e9b6c6-06ba-44fc-ab3e-9f5040ea20b2 tempest-VolumesSnapshotListTestJSON-419168158 None] Created reservations ['adb94420-6766-4ab2-a0f6-3a9cecffbb06', '5bf28758-6562-4e89-b6da-1ac74450771e', 'c2a4d761-0c4c-434c-8083-6f5660432562', '293871bc-fdb0-43da-aab7-12bd13ff6de7'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:59:07 devstack sudo[103511]: pam_unix(sudo:session): session closed for user root
Jun 15 15:59:07 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-bae31a62-04b1-461e-a848-1f8ff9e29d40 tempest-AttachVolumeTestJSON-1078769545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-db6d9905-80b8-41d1-af9c-350ec887547a" returned: 0 in 0.763s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:59:07 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-59e9b6c6-06ba-44fc-ab3e-9f5040ea20b2 tempest-VolumesSnapshotListTestJSON-419168158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:59:07 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-59e9b6c6-06ba-44fc-ab3e-9f5040ea20b2 tempest-VolumesSnapshotListTestJSON-419168158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:59:07 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-59e9b6c6-06ba-44fc-ab3e-9f5040ea20b2 tempest-VolumesSnapshotListTestJSON-419168158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:59:07 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-59e9b6c6-06ba-44fc-ab3e-9f5040ea20b2 tempest-VolumesSnapshotListTestJSON-419168158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:59:07 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-59e9b6c6-06ba-44fc-ab3e-9f5040ea20b2 tempest-VolumesSnapshotListTestJSON-419168158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:59:07 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-59e9b6c6-06ba-44fc-ab3e-9f5040ea20b2 tempest-VolumesSnapshotListTestJSON-419168158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:59:07 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-bae31a62-04b1-461e-a848-1f8ff9e29d40 tempest-AttachVolumeTestJSON-1078769545 None] Lock "cinder-quobyte-db6d9905-80b8-41d1-af9c-350ec887547a" released by "delete_volume" :: held 2.295s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:59:07 devstack sudo[103515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:59:07 devstack sudo[103515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:59:08 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-d1899c03-5436-470e-9874-9682e0d318d4 tempest-VolumesActionsTest-1837607340 None] Acquiring lock "cinder-da7b69b4-4951-4ca0-887c-011595e943b0" by "attach_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:59:08 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-d1899c03-5436-470e-9874-9682e0d318d4 tempest-VolumesActionsTest-1837607340 None] Lock "cinder-da7b69b4-4951-4ca0-887c-011595e943b0" acquired by "attach_volume" :: waited 0.075s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:59:08 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-bae31a62-04b1-461e-a848-1f8ff9e29d40 tempest-AttachVolumeTestJSON-1078769545 None] Created reservations ['94187565-901c-4a74-afdd-45ca5f4a7fa2', 'fbc258fe-f5f4-4381-8f2a-f34afad91e5d', 'e9980b1f-5288-44cd-8988-188b06735cf2', 'd8e6719d-1850-43e0-bac3-a4aa20444b86'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:59:08 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-bae31a62-04b1-461e-a848-1f8ff9e29d40 tempest-AttachVolumeTestJSON-1078769545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:59:08 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-bae31a62-04b1-461e-a848-1f8ff9e29d40 tempest-AttachVolumeTestJSON-1078769545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:59:08 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-bae31a62-04b1-461e-a848-1f8ff9e29d40 tempest-AttachVolumeTestJSON-1078769545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:59:08 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-bae31a62-04b1-461e-a848-1f8ff9e29d40 tempest-AttachVolumeTestJSON-1078769545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:59:08 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-bae31a62-04b1-461e-a848-1f8ff9e29d40 tempest-AttachVolumeTestJSON-1078769545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:59:08 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-bae31a62-04b1-461e-a848-1f8ff9e29d40 tempest-AttachVolumeTestJSON-1078769545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:59:08 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-d1899c03-5436-470e-9874-9682e0d318d4 tempest-VolumesActionsTest-1837607340 None] Attaching volume da7b69b4-4951-4ca0-887c-011595e943b0 to instance af1607a5-09db-4cfe-afee-457a2697565f at mountpoint /dev/vdb on host None.
Jun 15 15:59:08 devstack sudo[103517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:59:08 devstack sudo[103517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:59:08 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-d1899c03-5436-470e-9874-9682e0d318d4 tempest-VolumesActionsTest-1837607340 None] Attach volume completed successfully.
Jun 15 15:59:08 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-d1899c03-5436-470e-9874-9682e0d318d4 tempest-VolumesActionsTest-1837607340 None] Lock "cinder-da7b69b4-4951-4ca0-887c-011595e943b0" released by "attach_volume" :: held 0.319s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:59:09 devstack sudo[103515]: pam_unix(sudo:session): session closed for user root
Jun 15 15:59:09 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-59e9b6c6-06ba-44fc-ab3e-9f5040ea20b2 tempest-VolumesSnapshotListTestJSON-419168158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 1.337s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:59:09 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-59e9b6c6-06ba-44fc-ab3e-9f5040ea20b2 tempest-VolumesSnapshotListTestJSON-419168158 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:59:09 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-59e9b6c6-06ba-44fc-ab3e-9f5040ea20b2 tempest-VolumesSnapshotListTestJSON-419168158 None] Deleted volume successfully.
Jun 15 15:59:09 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-14d21dad-cd3a-4e94-bc15-752173a20d3a tempest-AttachVolumeTestJSON-1078769545 None] Acquiring lock "cinder-1adab084-fb1f-46dc-b4f4-85e870d73f81-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:59:09 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-14d21dad-cd3a-4e94-bc15-752173a20d3a tempest-AttachVolumeTestJSON-1078769545 None] Lock "cinder-1adab084-fb1f-46dc-b4f4-85e870d73f81-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:59:09 devstack sudo[103517]: pam_unix(sudo:session): session closed for user root
Jun 15 15:59:09 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-bae31a62-04b1-461e-a848-1f8ff9e29d40 tempest-AttachVolumeTestJSON-1078769545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 1.072s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:59:09 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-bae31a62-04b1-461e-a848-1f8ff9e29d40 tempest-AttachVolumeTestJSON-1078769545 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:59:09 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-59e9b6c6-06ba-44fc-ab3e-9f5040ea20b2 tempest-VolumesSnapshotListTestJSON-419168158 None] Lock "cinder-1a63d4ea-7d03-4655-9da9-2cd03b99c0b6-delete_volume" released by "delete_volume" :: held 3.598s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:59:09 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-bae31a62-04b1-461e-a848-1f8ff9e29d40 tempest-AttachVolumeTestJSON-1078769545 None] Deleted volume successfully.
Jun 15 15:59:09 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-bae31a62-04b1-461e-a848-1f8ff9e29d40 tempest-AttachVolumeTestJSON-1078769545 None] Lock "cinder-db6d9905-80b8-41d1-af9c-350ec887547a-delete_volume" released by "delete_volume" :: held 3.929s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:59:09 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-14d21dad-cd3a-4e94-bc15-752173a20d3a tempest-AttachVolumeTestJSON-1078769545 None] Acquiring lock "cinder-quobyte-1adab084-fb1f-46dc-b4f4-85e870d73f81" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:59:09 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-14d21dad-cd3a-4e94-bc15-752173a20d3a tempest-AttachVolumeTestJSON-1078769545 None] Lock "cinder-quobyte-1adab084-fb1f-46dc-b4f4-85e870d73f81" acquired by "delete_volume" :: waited 0.041s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:59:09 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff1eb2d-e252-44dd-9c74-ddc225eadd1b]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:59:09 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-14d21dad-cd3a-4e94-bc15-752173a20d3a tempest-AttachVolumeTestJSON-1078769545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1adab084-fb1f-46dc-b4f4-85e870d73f81 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:59:09 devstack sudo[103521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1adab084-fb1f-46dc-b4f4-85e870d73f81
Jun 15 15:59:09 devstack sudo[103521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:59:09 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-0df8a5b8-feb6-4c0f-baf9-b68a8f4df886 tempest-VolumesActionsTest-794746475 None] Terminate volume connection completed successfully.
Jun 15 15:59:10 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-0df8a5b8-feb6-4c0f-baf9-b68a8f4df886 tempest-VolumesActionsTest-794746475 None] Acquiring lock "cinder-da7b69b4-4951-4ca0-887c-011595e943b0-detach_volume" by "detach_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:59:10 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-0df8a5b8-feb6-4c0f-baf9-b68a8f4df886 tempest-VolumesActionsTest-794746475 None] Lock "cinder-da7b69b4-4951-4ca0-887c-011595e943b0-detach_volume" acquired by "detach_volume" :: waited 0.031s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:59:10 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-0df8a5b8-feb6-4c0f-baf9-b68a8f4df886 tempest-VolumesActionsTest-794746475 None] Detaching volume da7b69b4-4951-4ca0-887c-011595e943b0 from instance af1607a5-09db-4cfe-afee-457a2697565f.
Jun 15 15:59:10 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-0df8a5b8-feb6-4c0f-baf9-b68a8f4df886 tempest-VolumesActionsTest-794746475 None] Detach volume completed successfully.
Jun 15 15:59:10 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-0df8a5b8-feb6-4c0f-baf9-b68a8f4df886 tempest-VolumesActionsTest-794746475 None] Lock "cinder-da7b69b4-4951-4ca0-887c-011595e943b0-detach_volume" released by "detach_volume" :: held 0.176s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:59:10 devstack sudo[103521]: pam_unix(sudo:session): session closed for user root
Jun 15 15:59:10 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-14d21dad-cd3a-4e94-bc15-752173a20d3a tempest-AttachVolumeTestJSON-1078769545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1adab084-fb1f-46dc-b4f4-85e870d73f81" returned: 0 in 1.012s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:59:10 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-14d21dad-cd3a-4e94-bc15-752173a20d3a tempest-AttachVolumeTestJSON-1078769545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1adab084-fb1f-46dc-b4f4-85e870d73f81 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:59:10 devstack sudo[103527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1adab084-fb1f-46dc-b4f4-85e870d73f81
Jun 15 15:59:10 devstack sudo[103527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:59:11 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-0f6061c3-7be2-48ac-a3e9-a0ec2773d0fa tempest-VolumesActionsTest-1837607340 None] Acquiring lock "cinder-da7b69b4-4951-4ca0-887c-011595e943b0-detach_volume" by "detach_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:59:11 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-0f6061c3-7be2-48ac-a3e9-a0ec2773d0fa tempest-VolumesActionsTest-1837607340 None] Lock "cinder-da7b69b4-4951-4ca0-887c-011595e943b0-detach_volume" acquired by "detach_volume" :: waited 0.032s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:59:11 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-0f6061c3-7be2-48ac-a3e9-a0ec2773d0fa tempest-VolumesActionsTest-1837607340 None] Volume detach called, but volume not attached.
Jun 15 15:59:11 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-0f6061c3-7be2-48ac-a3e9-a0ec2773d0fa tempest-VolumesActionsTest-1837607340 None] Lock "cinder-da7b69b4-4951-4ca0-887c-011595e943b0-detach_volume" released by "detach_volume" :: held 0.052s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:59:11 devstack sudo[103527]: pam_unix(sudo:session): session closed for user root
Jun 15 15:59:11 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-14d21dad-cd3a-4e94-bc15-752173a20d3a tempest-AttachVolumeTestJSON-1078769545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1adab084-fb1f-46dc-b4f4-85e870d73f81" returned: 0 in 0.750s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:59:11 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-14d21dad-cd3a-4e94-bc15-752173a20d3a tempest-AttachVolumeTestJSON-1078769545 None] Lock "cinder-quobyte-1adab084-fb1f-46dc-b4f4-85e870d73f81" released by "delete_volume" :: held 1.819s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:59:11 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-14d21dad-cd3a-4e94-bc15-752173a20d3a tempest-AttachVolumeTestJSON-1078769545 None] Created reservations ['71ee2604-d15a-4e73-aee4-bfadcc7e9780', '778a1591-bb71-4f3c-a168-40a1319cfaa3', 'c2078164-329d-42ad-bef1-1d40fc06ad7a', 'edf5ce9a-7873-48cd-b7b1-3bb6c2a703f7'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:59:11 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-14d21dad-cd3a-4e94-bc15-752173a20d3a tempest-AttachVolumeTestJSON-1078769545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:59:11 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-14d21dad-cd3a-4e94-bc15-752173a20d3a tempest-AttachVolumeTestJSON-1078769545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:59:11 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-14d21dad-cd3a-4e94-bc15-752173a20d3a tempest-AttachVolumeTestJSON-1078769545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:59:11 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-14d21dad-cd3a-4e94-bc15-752173a20d3a tempest-AttachVolumeTestJSON-1078769545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:59:11 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-14d21dad-cd3a-4e94-bc15-752173a20d3a tempest-AttachVolumeTestJSON-1078769545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:59:11 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-14d21dad-cd3a-4e94-bc15-752173a20d3a tempest-AttachVolumeTestJSON-1078769545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:59:11 devstack sudo[103530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:59:11 devstack sudo[103530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:59:11 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-5e53edfc-d216-4866-8ed4-a5a5454cfb35 tempest-VolumesActionsTest-1837607340 None] Acquiring lock "cinder-da7b69b4-4951-4ca0-887c-011595e943b0-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:59:11 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-5e53edfc-d216-4866-8ed4-a5a5454cfb35 tempest-VolumesActionsTest-1837607340 None] Lock "cinder-da7b69b4-4951-4ca0-887c-011595e943b0-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:59:12 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-5e53edfc-d216-4866-8ed4-a5a5454cfb35 tempest-VolumesActionsTest-1837607340 None] Acquiring lock "cinder-quobyte-da7b69b4-4951-4ca0-887c-011595e943b0" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:59:12 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-5e53edfc-d216-4866-8ed4-a5a5454cfb35 tempest-VolumesActionsTest-1837607340 None] Lock "cinder-quobyte-da7b69b4-4951-4ca0-887c-011595e943b0" acquired by "delete_volume" :: waited 0.031s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:59:12 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d3b949-f5f9-4320-b823-38f95f4044a7]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:59:12 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5e53edfc-d216-4866-8ed4-a5a5454cfb35 tempest-VolumesActionsTest-1837607340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-da7b69b4-4951-4ca0-887c-011595e943b0 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:59:12 devstack sudo[103532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-da7b69b4-4951-4ca0-887c-011595e943b0
Jun 15 15:59:12 devstack sudo[103532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:59:12 devstack sudo[103530]: pam_unix(sudo:session): session closed for user root
Jun 15 15:59:12 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-14d21dad-cd3a-4e94-bc15-752173a20d3a tempest-AttachVolumeTestJSON-1078769545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.932s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:59:12 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-14d21dad-cd3a-4e94-bc15-752173a20d3a tempest-AttachVolumeTestJSON-1078769545 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:59:12 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-14d21dad-cd3a-4e94-bc15-752173a20d3a tempest-AttachVolumeTestJSON-1078769545 None] Deleted volume successfully.
Jun 15 15:59:12 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-14d21dad-cd3a-4e94-bc15-752173a20d3a tempest-AttachVolumeTestJSON-1078769545 None] Lock "cinder-1adab084-fb1f-46dc-b4f4-85e870d73f81-delete_volume" released by "delete_volume" :: held 3.075s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:59:13 devstack sudo[103532]: pam_unix(sudo:session): session closed for user root
Jun 15 15:59:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5e53edfc-d216-4866-8ed4-a5a5454cfb35 tempest-VolumesActionsTest-1837607340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-da7b69b4-4951-4ca0-887c-011595e943b0" returned: 0 in 1.154s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:59:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5e53edfc-d216-4866-8ed4-a5a5454cfb35 tempest-VolumesActionsTest-1837607340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-da7b69b4-4951-4ca0-887c-011595e943b0 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:59:13 devstack sudo[103538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-da7b69b4-4951-4ca0-887c-011595e943b0
Jun 15 15:59:13 devstack sudo[103538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:59:14 devstack sudo[103538]: pam_unix(sudo:session): session closed for user root
Jun 15 15:59:14 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5e53edfc-d216-4866-8ed4-a5a5454cfb35 tempest-VolumesActionsTest-1837607340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-da7b69b4-4951-4ca0-887c-011595e943b0" returned: 0 in 0.859s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:59:14 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-5e53edfc-d216-4866-8ed4-a5a5454cfb35 tempest-VolumesActionsTest-1837607340 None] Lock "cinder-quobyte-da7b69b4-4951-4ca0-887c-011595e943b0" released by "delete_volume" :: held 2.095s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:59:14 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-5e53edfc-d216-4866-8ed4-a5a5454cfb35 tempest-VolumesActionsTest-1837607340 None] Created reservations ['8fd3242f-5d50-4136-ab3f-a9de2385a0b8', '3c03a90b-d3e9-4bc4-b0ef-da45c68be470', '6205d5d9-cb6e-4e30-b417-d391492c7b66', '5ae24300-5c94-4ec0-9b16-07c0462b5ee2'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:59:14 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-5e53edfc-d216-4866-8ed4-a5a5454cfb35 tempest-VolumesActionsTest-1837607340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:59:14 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-5e53edfc-d216-4866-8ed4-a5a5454cfb35 tempest-VolumesActionsTest-1837607340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:59:14 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-5e53edfc-d216-4866-8ed4-a5a5454cfb35 tempest-VolumesActionsTest-1837607340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:59:14 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-5e53edfc-d216-4866-8ed4-a5a5454cfb35 tempest-VolumesActionsTest-1837607340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:59:14 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-5e53edfc-d216-4866-8ed4-a5a5454cfb35 tempest-VolumesActionsTest-1837607340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:59:14 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5e53edfc-d216-4866-8ed4-a5a5454cfb35 tempest-VolumesActionsTest-1837607340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:59:14 devstack sudo[103563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:59:14 devstack sudo[103563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:59:15 devstack sudo[103563]: pam_unix(sudo:session): session closed for user root
Jun 15 15:59:15 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5e53edfc-d216-4866-8ed4-a5a5454cfb35 tempest-VolumesActionsTest-1837607340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.722s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:59:15 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-5e53edfc-d216-4866-8ed4-a5a5454cfb35 tempest-VolumesActionsTest-1837607340 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:59:15 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-5e53edfc-d216-4866-8ed4-a5a5454cfb35 tempest-VolumesActionsTest-1837607340 None] Deleted volume successfully.
Jun 15 15:59:15 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-5e53edfc-d216-4866-8ed4-a5a5454cfb35 tempest-VolumesActionsTest-1837607340 None] Lock "cinder-da7b69b4-4951-4ca0-887c-011595e943b0-delete_volume" released by "delete_volume" :: held 3.214s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:59:21 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [req-272a48d2-b79a-4ecb-a1d0-13d16c9c65aa req-feffda00-60c6-47f3-8848-6bdc7a34416f tempest-VolumesGetTestJSON-1790958658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 15:59:21 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [req-272a48d2-b79a-4ecb-a1d0-13d16c9c65aa req-feffda00-60c6-47f3-8848-6bdc7a34416f tempest-VolumesGetTestJSON-1790958658 None] Flow 'volume_create_manager' (6f98a324-3563-4556-bf04-a94168e13fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:59:21 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [req-272a48d2-b79a-4ecb-a1d0-13d16c9c65aa req-feffda00-60c6-47f3-8848-6bdc7a34416f tempest-VolumesGetTestJSON-1790958658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (820aebff-97c6-4bf1-a532-2275ee032f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:59:21 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [req-272a48d2-b79a-4ecb-a1d0-13d16c9c65aa req-feffda00-60c6-47f3-8848-6bdc7a34416f tempest-VolumesGetTestJSON-1790958658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (820aebff-97c6-4bf1-a532-2275ee032f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:59:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1674659770',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfd15886-6346-4dec-bf8c-95c257a57049,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e44faf5c469f42e0a8c2d73cbe777343',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:59:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:59:21Z,use_quota=True,user_id='7f3d0d1a13e547df9e86e1d92d8fa564',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:59:21 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [req-272a48d2-b79a-4ecb-a1d0-13d16c9c65aa req-feffda00-60c6-47f3-8848-6bdc7a34416f tempest-VolumesGetTestJSON-1790958658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21c525ee-6c9a-41c2-8e6c-5dd4d9c1481c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:59:21 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [req-272a48d2-b79a-4ecb-a1d0-13d16c9c65aa req-feffda00-60c6-47f3-8848-6bdc7a34416f tempest-VolumesGetTestJSON-1790958658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21c525ee-6c9a-41c2-8e6c-5dd4d9c1481c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:59:21 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [req-272a48d2-b79a-4ecb-a1d0-13d16c9c65aa req-feffda00-60c6-47f3-8848-6bdc7a34416f tempest-VolumesGetTestJSON-1790958658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6344af42-e5e6-442a-a161-7aee2a3c0ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:59:21 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [req-272a48d2-b79a-4ecb-a1d0-13d16c9c65aa req-feffda00-60c6-47f3-8848-6bdc7a34416f tempest-VolumesGetTestJSON-1790958658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6344af42-e5e6-442a-a161-7aee2a3c0ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfd15886-6346-4dec-bf8c-95c257a57049', 'volume_name': 'volume-dfd15886-6346-4dec-bf8c-95c257a57049', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:59:21 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [req-272a48d2-b79a-4ecb-a1d0-13d16c9c65aa req-feffda00-60c6-47f3-8848-6bdc7a34416f tempest-VolumesGetTestJSON-1790958658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b54a366a-3811-445f-90c1-b446e1f6bbc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:59:21 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [req-272a48d2-b79a-4ecb-a1d0-13d16c9c65aa req-feffda00-60c6-47f3-8848-6bdc7a34416f tempest-VolumesGetTestJSON-1790958658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b54a366a-3811-445f-90c1-b446e1f6bbc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:59:21 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [req-272a48d2-b79a-4ecb-a1d0-13d16c9c65aa req-feffda00-60c6-47f3-8848-6bdc7a34416f tempest-VolumesGetTestJSON-1790958658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c561e2e-5197-4969-aaba-8fa188fdc9d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:59:21 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [req-272a48d2-b79a-4ecb-a1d0-13d16c9c65aa req-feffda00-60c6-47f3-8848-6bdc7a34416f tempest-VolumesGetTestJSON-1790958658 None] Volume dfd15886-6346-4dec-bf8c-95c257a57049: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfd15886-6346-4dec-bf8c-95c257a57049', 'volume_size': 1}
Jun 15 15:59:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [req-272a48d2-b79a-4ecb-a1d0-13d16c9c65aa req-feffda00-60c6-47f3-8848-6bdc7a34416f tempest-VolumesGetTestJSON-1790958658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:59:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [req-272a48d2-b79a-4ecb-a1d0-13d16c9c65aa req-feffda00-60c6-47f3-8848-6bdc7a34416f tempest-VolumesGetTestJSON-1790958658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:59:21 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [req-272a48d2-b79a-4ecb-a1d0-13d16c9c65aa req-feffda00-60c6-47f3-8848-6bdc7a34416f tempest-VolumesGetTestJSON-1790958658 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:59:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1674659770',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfd15886-6346-4dec-bf8c-95c257a57049,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e44faf5c469f42e0a8c2d73cbe777343',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:59:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:59:21Z,use_quota=True,user_id='7f3d0d1a13e547df9e86e1d92d8fa564',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 15:59:21 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [req-272a48d2-b79a-4ecb-a1d0-13d16c9c65aa req-feffda00-60c6-47f3-8848-6bdc7a34416f tempest-VolumesGetTestJSON-1790958658 None] Creating volume dfd15886-6346-4dec-bf8c-95c257a57049 {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 15:59:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [req-272a48d2-b79a-4ecb-a1d0-13d16c9c65aa req-feffda00-60c6-47f3-8848-6bdc7a34416f tempest-VolumesGetTestJSON-1790958658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:59:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [req-272a48d2-b79a-4ecb-a1d0-13d16c9c65aa req-feffda00-60c6-47f3-8848-6bdc7a34416f tempest-VolumesGetTestJSON-1790958658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:59:21 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [req-272a48d2-b79a-4ecb-a1d0-13d16c9c65aa req-feffda00-60c6-47f3-8848-6bdc7a34416f tempest-VolumesGetTestJSON-1790958658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:59:21 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [req-272a48d2-b79a-4ecb-a1d0-13d16c9c65aa req-feffda00-60c6-47f3-8848-6bdc7a34416f tempest-VolumesGetTestJSON-1790958658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:59:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [req-272a48d2-b79a-4ecb-a1d0-13d16c9c65aa req-feffda00-60c6-47f3-8848-6bdc7a34416f tempest-VolumesGetTestJSON-1790958658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:59:21 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [req-272a48d2-b79a-4ecb-a1d0-13d16c9c65aa req-feffda00-60c6-47f3-8848-6bdc7a34416f tempest-VolumesGetTestJSON-1790958658 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 15:59:21 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [req-272a48d2-b79a-4ecb-a1d0-13d16c9c65aa req-feffda00-60c6-47f3-8848-6bdc7a34416f tempest-VolumesGetTestJSON-1790958658 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 15:59:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-272a48d2-b79a-4ecb-a1d0-13d16c9c65aa req-feffda00-60c6-47f3-8848-6bdc7a34416f tempest-VolumesGetTestJSON-1790958658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-dfd15886-6346-4dec-bf8c-95c257a57049 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:59:21 devstack sudo[103607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-dfd15886-6346-4dec-bf8c-95c257a57049 1073741824
Jun 15 15:59:21 devstack sudo[103607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:59:22 devstack sudo[103607]: pam_unix(sudo:session): session closed for user root
Jun 15 15:59:22 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-272a48d2-b79a-4ecb-a1d0-13d16c9c65aa req-feffda00-60c6-47f3-8848-6bdc7a34416f tempest-VolumesGetTestJSON-1790958658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-dfd15886-6346-4dec-bf8c-95c257a57049 1073741824" returned: 0 in 0.854s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:59:22 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-272a48d2-b79a-4ecb-a1d0-13d16c9c65aa req-feffda00-60c6-47f3-8848-6bdc7a34416f tempest-VolumesGetTestJSON-1790958658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-dfd15886-6346-4dec-bf8c-95c257a57049 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:59:22 devstack sudo[103613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-dfd15886-6346-4dec-bf8c-95c257a57049
Jun 15 15:59:22 devstack sudo[103613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:59:22 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-6af63f98-ad7d-40a5-b540-55826c85a5f7 tempest-VolumesActionsTest-1837607340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 15:59:22 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6af63f98-ad7d-40a5-b540-55826c85a5f7 tempest-VolumesActionsTest-1837607340 None] Flow 'volume_create_manager' (7cb21781-82ef-4827-9652-ad45625946e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:59:22 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6af63f98-ad7d-40a5-b540-55826c85a5f7 tempest-VolumesActionsTest-1837607340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46ce770e-a13a-43a3-924c-e254ce6f416a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:59:22 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6af63f98-ad7d-40a5-b540-55826c85a5f7 tempest-VolumesActionsTest-1837607340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46ce770e-a13a-43a3-924c-e254ce6f416a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:59:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1627861457',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eae3884a-3838-4c4d-ad32-ceed5128dcd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed1443b4096a41ceb58964e938e1fa7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:59:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:59:23Z,use_quota=True,user_id='3a282a052d074757a0a2984e7a52b4ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:59:22 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6af63f98-ad7d-40a5-b540-55826c85a5f7 tempest-VolumesActionsTest-1837607340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bf600de-0bfa-4f74-9b2a-3cce2aefe6a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:59:22 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6af63f98-ad7d-40a5-b540-55826c85a5f7 tempest-VolumesActionsTest-1837607340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bf600de-0bfa-4f74-9b2a-3cce2aefe6a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:59:22 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6af63f98-ad7d-40a5-b540-55826c85a5f7 tempest-VolumesActionsTest-1837607340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6854d64-712a-4bb9-aa53-f1db29748ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:59:22 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6af63f98-ad7d-40a5-b540-55826c85a5f7 tempest-VolumesActionsTest-1837607340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6854d64-712a-4bb9-aa53-f1db29748ae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eae3884a-3838-4c4d-ad32-ceed5128dcd9', 'volume_name': 'volume-eae3884a-3838-4c4d-ad32-ceed5128dcd9', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:59:22 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6af63f98-ad7d-40a5-b540-55826c85a5f7 tempest-VolumesActionsTest-1837607340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b6aab18-7647-4c7c-b5f4-9524e3e69acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:59:23 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6af63f98-ad7d-40a5-b540-55826c85a5f7 tempest-VolumesActionsTest-1837607340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b6aab18-7647-4c7c-b5f4-9524e3e69acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:59:23 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6af63f98-ad7d-40a5-b540-55826c85a5f7 tempest-VolumesActionsTest-1837607340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edeb784d-e596-4165-b6cb-b50bacfb5a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:59:23 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-6af63f98-ad7d-40a5-b540-55826c85a5f7 tempest-VolumesActionsTest-1837607340 None] Volume eae3884a-3838-4c4d-ad32-ceed5128dcd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eae3884a-3838-4c4d-ad32-ceed5128dcd9', 'volume_size': 1}
Jun 15 15:59:23 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6af63f98-ad7d-40a5-b540-55826c85a5f7 tempest-VolumesActionsTest-1837607340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:59:23 devstack sudo[103613]: pam_unix(sudo:session): session closed for user root
Jun 15 15:59:23 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-272a48d2-b79a-4ecb-a1d0-13d16c9c65aa req-feffda00-60c6-47f3-8848-6bdc7a34416f tempest-VolumesGetTestJSON-1790958658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-dfd15886-6346-4dec-bf8c-95c257a57049" returned: 0 in 0.714s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:59:23 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [req-272a48d2-b79a-4ecb-a1d0-13d16c9c65aa req-feffda00-60c6-47f3-8848-6bdc7a34416f tempest-VolumesGetTestJSON-1790958658 None] <== create_volume: return (1634ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 15:59:23 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [req-272a48d2-b79a-4ecb-a1d0-13d16c9c65aa req-feffda00-60c6-47f3-8848-6bdc7a34416f tempest-VolumesGetTestJSON-1790958658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.637s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:59:23 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6af63f98-ad7d-40a5-b540-55826c85a5f7 tempest-VolumesActionsTest-1837607340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.172s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:59:23 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6af63f98-ad7d-40a5-b540-55826c85a5f7 tempest-VolumesActionsTest-1837607340 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:59:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1627861457',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eae3884a-3838-4c4d-ad32-ceed5128dcd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed1443b4096a41ceb58964e938e1fa7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:59:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:59:23Z,use_quota=True,user_id='3a282a052d074757a0a2984e7a52b4ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 15:59:23 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-6af63f98-ad7d-40a5-b540-55826c85a5f7 tempest-VolumesActionsTest-1837607340 None] Creating volume eae3884a-3838-4c4d-ad32-ceed5128dcd9 {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 15:59:23 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6af63f98-ad7d-40a5-b540-55826c85a5f7 tempest-VolumesActionsTest-1837607340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:59:23 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6af63f98-ad7d-40a5-b540-55826c85a5f7 tempest-VolumesActionsTest-1837607340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:59:23 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6af63f98-ad7d-40a5-b540-55826c85a5f7 tempest-VolumesActionsTest-1837607340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:59:23 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6af63f98-ad7d-40a5-b540-55826c85a5f7 tempest-VolumesActionsTest-1837607340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:59:23 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6af63f98-ad7d-40a5-b540-55826c85a5f7 tempest-VolumesActionsTest-1837607340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:59:23 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6af63f98-ad7d-40a5-b540-55826c85a5f7 tempest-VolumesActionsTest-1837607340 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 15:59:23 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-6af63f98-ad7d-40a5-b540-55826c85a5f7 tempest-VolumesActionsTest-1837607340 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 15:59:23 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6af63f98-ad7d-40a5-b540-55826c85a5f7 tempest-VolumesActionsTest-1837607340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-eae3884a-3838-4c4d-ad32-ceed5128dcd9 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:59:23 devstack sudo[103622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-eae3884a-3838-4c4d-ad32-ceed5128dcd9 1073741824
Jun 15 15:59:23 devstack sudo[103622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:59:23 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [req-272a48d2-b79a-4ecb-a1d0-13d16c9c65aa req-feffda00-60c6-47f3-8848-6bdc7a34416f tempest-VolumesGetTestJSON-1790958658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c561e2e-5197-4969-aaba-8fa188fdc9d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfd15886-6346-4dec-bf8c-95c257a57049', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:59:23 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [req-272a48d2-b79a-4ecb-a1d0-13d16c9c65aa req-feffda00-60c6-47f3-8848-6bdc7a34416f tempest-VolumesGetTestJSON-1790958658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06fc71dd-65aa-4ef7-b02c-e0e7d79bf06c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:59:23 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [req-272a48d2-b79a-4ecb-a1d0-13d16c9c65aa req-feffda00-60c6-47f3-8848-6bdc7a34416f tempest-VolumesGetTestJSON-1790958658 None] Volume volume-dfd15886-6346-4dec-bf8c-95c257a57049 (dfd15886-6346-4dec-bf8c-95c257a57049): created successfully
Jun 15 15:59:23 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [req-272a48d2-b79a-4ecb-a1d0-13d16c9c65aa req-feffda00-60c6-47f3-8848-6bdc7a34416f tempest-VolumesGetTestJSON-1790958658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06fc71dd-65aa-4ef7-b02c-e0e7d79bf06c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:59:23 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [req-272a48d2-b79a-4ecb-a1d0-13d16c9c65aa req-feffda00-60c6-47f3-8848-6bdc7a34416f tempest-VolumesGetTestJSON-1790958658 None] Flow 'volume_create_manager' (6f98a324-3563-4556-bf04-a94168e13fc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:59:23 devstack cinder-volume[91863]: INFO cinder.volume.manager [req-272a48d2-b79a-4ecb-a1d0-13d16c9c65aa req-feffda00-60c6-47f3-8848-6bdc7a34416f tempest-VolumesGetTestJSON-1790958658 None] Created volume successfully.
Jun 15 15:59:23 devstack cinder-volume[91863]: DEBUG cinder.coordination [req-001b90b3-ad0f-4ef4-bdc2-ca734d57a2e4 req-1b0073ea-dbe7-4dae-8cec-38b910b316e1 tempest-VolumesGetTestJSON-1790958658 None] Acquiring lock "cinder-dfd15886-6346-4dec-bf8c-95c257a57049-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:59:24 devstack cinder-volume[91863]: DEBUG cinder.coordination [req-001b90b3-ad0f-4ef4-bdc2-ca734d57a2e4 req-1b0073ea-dbe7-4dae-8cec-38b910b316e1 tempest-VolumesGetTestJSON-1790958658 None] Lock "cinder-dfd15886-6346-4dec-bf8c-95c257a57049-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:59:24 devstack cinder-volume[91863]: DEBUG cinder.coordination [req-001b90b3-ad0f-4ef4-bdc2-ca734d57a2e4 req-1b0073ea-dbe7-4dae-8cec-38b910b316e1 tempest-VolumesGetTestJSON-1790958658 None] Acquiring lock "cinder-quobyte-dfd15886-6346-4dec-bf8c-95c257a57049" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:59:24 devstack cinder-volume[91863]: DEBUG cinder.coordination [req-001b90b3-ad0f-4ef4-bdc2-ca734d57a2e4 req-1b0073ea-dbe7-4dae-8cec-38b910b316e1 tempest-VolumesGetTestJSON-1790958658 None] Lock "cinder-quobyte-dfd15886-6346-4dec-bf8c-95c257a57049" acquired by "delete_volume" :: waited 0.024s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:59:24 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a214aac-d90e-4ebd-b339-cb7217984c40]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:59:24 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-001b90b3-ad0f-4ef4-bdc2-ca734d57a2e4 req-1b0073ea-dbe7-4dae-8cec-38b910b316e1 tempest-VolumesGetTestJSON-1790958658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-dfd15886-6346-4dec-bf8c-95c257a57049 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:59:24 devstack sudo[103628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-dfd15886-6346-4dec-bf8c-95c257a57049
Jun 15 15:59:24 devstack sudo[103628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:59:24 devstack sudo[103622]: pam_unix(sudo:session): session closed for user root
Jun 15 15:59:24 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6af63f98-ad7d-40a5-b540-55826c85a5f7 tempest-VolumesActionsTest-1837607340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-eae3884a-3838-4c4d-ad32-ceed5128dcd9 1073741824" returned: 0 in 1.015s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:59:24 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6af63f98-ad7d-40a5-b540-55826c85a5f7 tempest-VolumesActionsTest-1837607340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-eae3884a-3838-4c4d-ad32-ceed5128dcd9 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:59:24 devstack sudo[103630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-eae3884a-3838-4c4d-ad32-ceed5128dcd9
Jun 15 15:59:24 devstack sudo[103630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:59:24 devstack sudo[103630]: pam_unix(sudo:session): session closed for user root
Jun 15 15:59:24 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6af63f98-ad7d-40a5-b540-55826c85a5f7 tempest-VolumesActionsTest-1837607340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-eae3884a-3838-4c4d-ad32-ceed5128dcd9" returned: 0 in 0.674s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:59:24 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6af63f98-ad7d-40a5-b540-55826c85a5f7 tempest-VolumesActionsTest-1837607340 None] <== create_volume: return (1742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 15:59:24 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6af63f98-ad7d-40a5-b540-55826c85a5f7 tempest-VolumesActionsTest-1837607340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.749s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:59:24 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6af63f98-ad7d-40a5-b540-55826c85a5f7 tempest-VolumesActionsTest-1837607340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edeb784d-e596-4165-b6cb-b50bacfb5a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eae3884a-3838-4c4d-ad32-ceed5128dcd9', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:59:24 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6af63f98-ad7d-40a5-b540-55826c85a5f7 tempest-VolumesActionsTest-1837607340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1324f4e-3fb7-4843-8239-2b0e0cf251e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:59:24 devstack sudo[103628]: pam_unix(sudo:session): session closed for user root
Jun 15 15:59:24 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-001b90b3-ad0f-4ef4-bdc2-ca734d57a2e4 req-1b0073ea-dbe7-4dae-8cec-38b910b316e1 tempest-VolumesGetTestJSON-1790958658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-dfd15886-6346-4dec-bf8c-95c257a57049" returned: 0 in 0.876s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:59:24 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-001b90b3-ad0f-4ef4-bdc2-ca734d57a2e4 req-1b0073ea-dbe7-4dae-8cec-38b910b316e1 tempest-VolumesGetTestJSON-1790958658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-dfd15886-6346-4dec-bf8c-95c257a57049 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:59:24 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-6af63f98-ad7d-40a5-b540-55826c85a5f7 tempest-VolumesActionsTest-1837607340 None] Volume volume-eae3884a-3838-4c4d-ad32-ceed5128dcd9 (eae3884a-3838-4c4d-ad32-ceed5128dcd9): created successfully
Jun 15 15:59:24 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6af63f98-ad7d-40a5-b540-55826c85a5f7 tempest-VolumesActionsTest-1837607340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1324f4e-3fb7-4843-8239-2b0e0cf251e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:59:25 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6af63f98-ad7d-40a5-b540-55826c85a5f7 tempest-VolumesActionsTest-1837607340 None] Flow 'volume_create_manager' (7cb21781-82ef-4827-9652-ad45625946e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:59:25 devstack sudo[103637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-dfd15886-6346-4dec-bf8c-95c257a57049
Jun 15 15:59:25 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-6af63f98-ad7d-40a5-b540-55826c85a5f7 tempest-VolumesActionsTest-1837607340 None] Created volume successfully.
Jun 15 15:59:25 devstack sudo[103637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:59:25 devstack sudo[103637]: pam_unix(sudo:session): session closed for user root
Jun 15 15:59:25 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-001b90b3-ad0f-4ef4-bdc2-ca734d57a2e4 req-1b0073ea-dbe7-4dae-8cec-38b910b316e1 tempest-VolumesGetTestJSON-1790958658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-dfd15886-6346-4dec-bf8c-95c257a57049" returned: 0 in 0.628s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:59:25 devstack cinder-volume[91863]: DEBUG cinder.coordination [req-001b90b3-ad0f-4ef4-bdc2-ca734d57a2e4 req-1b0073ea-dbe7-4dae-8cec-38b910b316e1 tempest-VolumesGetTestJSON-1790958658 None] Lock "cinder-quobyte-dfd15886-6346-4dec-bf8c-95c257a57049" released by "delete_volume" :: held 1.552s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:59:25 devstack cinder-volume[91863]: DEBUG cinder.quota [req-001b90b3-ad0f-4ef4-bdc2-ca734d57a2e4 req-1b0073ea-dbe7-4dae-8cec-38b910b316e1 tempest-VolumesGetTestJSON-1790958658 None] Created reservations ['8c4469c3-3845-4daf-baaa-e156d75391b3', '015a96f3-0d11-452a-bfc3-7adbc14997d8', 'bebdd799-04f8-4a10-9a02-bf5dff7330dd', 'deef1bf1-c759-446c-b6e7-26f1c0e5aae7'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:59:25 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [req-001b90b3-ad0f-4ef4-bdc2-ca734d57a2e4 req-1b0073ea-dbe7-4dae-8cec-38b910b316e1 tempest-VolumesGetTestJSON-1790958658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:59:25 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [req-001b90b3-ad0f-4ef4-bdc2-ca734d57a2e4 req-1b0073ea-dbe7-4dae-8cec-38b910b316e1 tempest-VolumesGetTestJSON-1790958658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:59:25 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [req-001b90b3-ad0f-4ef4-bdc2-ca734d57a2e4 req-1b0073ea-dbe7-4dae-8cec-38b910b316e1 tempest-VolumesGetTestJSON-1790958658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:59:25 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [req-001b90b3-ad0f-4ef4-bdc2-ca734d57a2e4 req-1b0073ea-dbe7-4dae-8cec-38b910b316e1 tempest-VolumesGetTestJSON-1790958658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:59:25 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [req-001b90b3-ad0f-4ef4-bdc2-ca734d57a2e4 req-1b0073ea-dbe7-4dae-8cec-38b910b316e1 tempest-VolumesGetTestJSON-1790958658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:59:25 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-001b90b3-ad0f-4ef4-bdc2-ca734d57a2e4 req-1b0073ea-dbe7-4dae-8cec-38b910b316e1 tempest-VolumesGetTestJSON-1790958658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:59:25 devstack sudo[103641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:59:25 devstack sudo[103641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:59:26 devstack sudo[103641]: pam_unix(sudo:session): session closed for user root
Jun 15 15:59:26 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-001b90b3-ad0f-4ef4-bdc2-ca734d57a2e4 req-1b0073ea-dbe7-4dae-8cec-38b910b316e1 tempest-VolumesGetTestJSON-1790958658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.642s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:59:26 devstack cinder-volume[91863]: DEBUG cinder.manager [req-001b90b3-ad0f-4ef4-bdc2-ca734d57a2e4 req-1b0073ea-dbe7-4dae-8cec-38b910b316e1 tempest-VolumesGetTestJSON-1790958658 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:59:26 devstack cinder-volume[91863]: INFO cinder.volume.manager [req-001b90b3-ad0f-4ef4-bdc2-ca734d57a2e4 req-1b0073ea-dbe7-4dae-8cec-38b910b316e1 tempest-VolumesGetTestJSON-1790958658 None] Deleted volume successfully.
Jun 15 15:59:26 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-b143ac8e-b715-4f5c-be0a-6ab1f2a7ff72 tempest-VolumesActionsTest-794746475 None] Acquiring lock "cinder-eae3884a-3838-4c4d-ad32-ceed5128dcd9-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:59:26 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-b143ac8e-b715-4f5c-be0a-6ab1f2a7ff72 tempest-VolumesActionsTest-794746475 None] Lock "cinder-eae3884a-3838-4c4d-ad32-ceed5128dcd9-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:59:26 devstack cinder-volume[91863]: DEBUG cinder.coordination [req-001b90b3-ad0f-4ef4-bdc2-ca734d57a2e4 req-1b0073ea-dbe7-4dae-8cec-38b910b316e1 tempest-VolumesGetTestJSON-1790958658 None] Lock "cinder-dfd15886-6346-4dec-bf8c-95c257a57049-delete_volume" released by "delete_volume" :: held 2.439s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:59:26 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-b143ac8e-b715-4f5c-be0a-6ab1f2a7ff72 tempest-VolumesActionsTest-794746475 None] Acquiring lock "cinder-quobyte-eae3884a-3838-4c4d-ad32-ceed5128dcd9" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:59:26 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-b143ac8e-b715-4f5c-be0a-6ab1f2a7ff72 tempest-VolumesActionsTest-794746475 None] Lock "cinder-quobyte-eae3884a-3838-4c4d-ad32-ceed5128dcd9" acquired by "delete_volume" :: waited 0.019s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:59:26 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5469746c-db18-4b06-8219-0238ffcbc425]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:59:26 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-b143ac8e-b715-4f5c-be0a-6ab1f2a7ff72 tempest-VolumesActionsTest-794746475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-eae3884a-3838-4c4d-ad32-ceed5128dcd9 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:59:26 devstack sudo[103644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-eae3884a-3838-4c4d-ad32-ceed5128dcd9
Jun 15 15:59:26 devstack sudo[103644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:59:27 devstack sudo[103644]: pam_unix(sudo:session): session closed for user root
Jun 15 15:59:27 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-b143ac8e-b715-4f5c-be0a-6ab1f2a7ff72 tempest-VolumesActionsTest-794746475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-eae3884a-3838-4c4d-ad32-ceed5128dcd9" returned: 0 in 0.794s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:59:27 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-b143ac8e-b715-4f5c-be0a-6ab1f2a7ff72 tempest-VolumesActionsTest-794746475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-eae3884a-3838-4c4d-ad32-ceed5128dcd9 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:59:27 devstack sudo[103649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-eae3884a-3838-4c4d-ad32-ceed5128dcd9
Jun 15 15:59:27 devstack sudo[103649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:59:28 devstack sudo[103649]: pam_unix(sudo:session): session closed for user root
Jun 15 15:59:28 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-b143ac8e-b715-4f5c-be0a-6ab1f2a7ff72 tempest-VolumesActionsTest-794746475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-eae3884a-3838-4c4d-ad32-ceed5128dcd9" returned: 0 in 0.713s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:59:28 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-b143ac8e-b715-4f5c-be0a-6ab1f2a7ff72 tempest-VolumesActionsTest-794746475 None] Lock "cinder-quobyte-eae3884a-3838-4c4d-ad32-ceed5128dcd9" released by "delete_volume" :: held 1.560s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:59:28 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-b143ac8e-b715-4f5c-be0a-6ab1f2a7ff72 tempest-VolumesActionsTest-794746475 None] Created reservations ['fc47748b-9e6c-45b1-b650-09d80790d821', 'e384b25d-2646-4114-910e-c34eae79eefb', 'dc3320df-fbee-4245-a56d-d11d8de372ef', '819fb722-ba09-48eb-acd7-6140cfa77748'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:59:28 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-b143ac8e-b715-4f5c-be0a-6ab1f2a7ff72 tempest-VolumesActionsTest-794746475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:59:28 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-b143ac8e-b715-4f5c-be0a-6ab1f2a7ff72 tempest-VolumesActionsTest-794746475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:59:28 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-b143ac8e-b715-4f5c-be0a-6ab1f2a7ff72 tempest-VolumesActionsTest-794746475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:59:28 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-b143ac8e-b715-4f5c-be0a-6ab1f2a7ff72 tempest-VolumesActionsTest-794746475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:59:28 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-b143ac8e-b715-4f5c-be0a-6ab1f2a7ff72 tempest-VolumesActionsTest-794746475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:59:28 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-b143ac8e-b715-4f5c-be0a-6ab1f2a7ff72 tempest-VolumesActionsTest-794746475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:59:28 devstack sudo[103652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:59:28 devstack sudo[103652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:59:28 devstack sudo[103652]: pam_unix(sudo:session): session closed for user root
Jun 15 15:59:28 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-b143ac8e-b715-4f5c-be0a-6ab1f2a7ff72 tempest-VolumesActionsTest-794746475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.619s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:59:28 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-b143ac8e-b715-4f5c-be0a-6ab1f2a7ff72 tempest-VolumesActionsTest-794746475 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:59:28 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-b143ac8e-b715-4f5c-be0a-6ab1f2a7ff72 tempest-VolumesActionsTest-794746475 None] Deleted volume successfully.
Jun 15 15:59:28 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-b143ac8e-b715-4f5c-be0a-6ab1f2a7ff72 tempest-VolumesActionsTest-794746475 None] Lock "cinder-eae3884a-3838-4c4d-ad32-ceed5128dcd9-delete_volume" released by "delete_volume" :: held 2.443s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:59:29 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-b524cd7c-5eb4-4d00-b420-15efe2d6288f tempest-VolumesActionsTest-1837607340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 15:59:29 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-b524cd7c-5eb4-4d00-b420-15efe2d6288f tempest-VolumesActionsTest-1837607340 None] Flow 'volume_create_manager' (2e8504f9-312d-4eae-9f8b-15d22bce3a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:59:29 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-b524cd7c-5eb4-4d00-b420-15efe2d6288f tempest-VolumesActionsTest-1837607340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffb9c249-ab18-4ce8-a2ab-f756b8d0bbcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:59:29 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-b524cd7c-5eb4-4d00-b420-15efe2d6288f tempest-VolumesActionsTest-1837607340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffb9c249-ab18-4ce8-a2ab-f756b8d0bbcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:59:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-389985731',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bced835b-d58c-49ec-86d2-607b24e49dc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed1443b4096a41ceb58964e938e1fa7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:59:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:59:29Z,use_quota=True,user_id='3a282a052d074757a0a2984e7a52b4ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:59:29 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-b524cd7c-5eb4-4d00-b420-15efe2d6288f tempest-VolumesActionsTest-1837607340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43c253d5-bccf-424c-b10f-dcc9cf83ff4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:59:29 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-b524cd7c-5eb4-4d00-b420-15efe2d6288f tempest-VolumesActionsTest-1837607340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43c253d5-bccf-424c-b10f-dcc9cf83ff4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:59:29 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-b524cd7c-5eb4-4d00-b420-15efe2d6288f tempest-VolumesActionsTest-1837607340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (233bc7b6-bb8f-4c06-8671-04c8c78134e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:59:29 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-b524cd7c-5eb4-4d00-b420-15efe2d6288f tempest-VolumesActionsTest-1837607340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (233bc7b6-bb8f-4c06-8671-04c8c78134e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bced835b-d58c-49ec-86d2-607b24e49dc3', 'volume_name': 'volume-bced835b-d58c-49ec-86d2-607b24e49dc3', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:59:29 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-b524cd7c-5eb4-4d00-b420-15efe2d6288f tempest-VolumesActionsTest-1837607340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc282232-0a90-4e68-86b3-422f19a6ba1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:59:29 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-b524cd7c-5eb4-4d00-b420-15efe2d6288f tempest-VolumesActionsTest-1837607340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc282232-0a90-4e68-86b3-422f19a6ba1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:59:29 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-b524cd7c-5eb4-4d00-b420-15efe2d6288f tempest-VolumesActionsTest-1837607340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8089d55c-7a89-41fd-a46d-7f7552cca855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:59:29 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-b524cd7c-5eb4-4d00-b420-15efe2d6288f tempest-VolumesActionsTest-1837607340 None] Volume bced835b-d58c-49ec-86d2-607b24e49dc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bced835b-d58c-49ec-86d2-607b24e49dc3', 'volume_size': 1}
Jun 15 15:59:29 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-b524cd7c-5eb4-4d00-b420-15efe2d6288f tempest-VolumesActionsTest-1837607340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:59:29 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-b524cd7c-5eb4-4d00-b420-15efe2d6288f tempest-VolumesActionsTest-1837607340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:59:29 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-b524cd7c-5eb4-4d00-b420-15efe2d6288f tempest-VolumesActionsTest-1837607340 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:59:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-389985731',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bced835b-d58c-49ec-86d2-607b24e49dc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed1443b4096a41ceb58964e938e1fa7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:59:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:59:29Z,use_quota=True,user_id='3a282a052d074757a0a2984e7a52b4ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 15:59:29 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-b524cd7c-5eb4-4d00-b420-15efe2d6288f tempest-VolumesActionsTest-1837607340 None] Creating volume bced835b-d58c-49ec-86d2-607b24e49dc3 {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 15:59:29 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-b524cd7c-5eb4-4d00-b420-15efe2d6288f tempest-VolumesActionsTest-1837607340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:59:29 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-b524cd7c-5eb4-4d00-b420-15efe2d6288f tempest-VolumesActionsTest-1837607340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:59:29 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-b524cd7c-5eb4-4d00-b420-15efe2d6288f tempest-VolumesActionsTest-1837607340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:59:29 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-b524cd7c-5eb4-4d00-b420-15efe2d6288f tempest-VolumesActionsTest-1837607340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:59:29 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-b524cd7c-5eb4-4d00-b420-15efe2d6288f tempest-VolumesActionsTest-1837607340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:59:29 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-b524cd7c-5eb4-4d00-b420-15efe2d6288f tempest-VolumesActionsTest-1837607340 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 15:59:29 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-b524cd7c-5eb4-4d00-b420-15efe2d6288f tempest-VolumesActionsTest-1837607340 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 15:59:29 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-b524cd7c-5eb4-4d00-b420-15efe2d6288f tempest-VolumesActionsTest-1837607340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-bced835b-d58c-49ec-86d2-607b24e49dc3 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:59:29 devstack sudo[103655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-bced835b-d58c-49ec-86d2-607b24e49dc3 1073741824
Jun 15 15:59:29 devstack sudo[103655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:59:30 devstack sudo[103655]: pam_unix(sudo:session): session closed for user root
Jun 15 15:59:30 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-b524cd7c-5eb4-4d00-b420-15efe2d6288f tempest-VolumesActionsTest-1837607340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-bced835b-d58c-49ec-86d2-607b24e49dc3 1073741824" returned: 0 in 0.906s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:59:30 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-b524cd7c-5eb4-4d00-b420-15efe2d6288f tempest-VolumesActionsTest-1837607340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-bced835b-d58c-49ec-86d2-607b24e49dc3 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:59:30 devstack sudo[103661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-bced835b-d58c-49ec-86d2-607b24e49dc3
Jun 15 15:59:30 devstack sudo[103661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:59:30 devstack sudo[103661]: pam_unix(sudo:session): session closed for user root
Jun 15 15:59:30 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-b524cd7c-5eb4-4d00-b420-15efe2d6288f tempest-VolumesActionsTest-1837607340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-bced835b-d58c-49ec-86d2-607b24e49dc3" returned: 0 in 0.604s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:59:30 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-b524cd7c-5eb4-4d00-b420-15efe2d6288f tempest-VolumesActionsTest-1837607340 None] <== create_volume: return (1558ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 15:59:30 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-b524cd7c-5eb4-4d00-b420-15efe2d6288f tempest-VolumesActionsTest-1837607340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.561s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:59:30 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-b524cd7c-5eb4-4d00-b420-15efe2d6288f tempest-VolumesActionsTest-1837607340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8089d55c-7a89-41fd-a46d-7f7552cca855) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bced835b-d58c-49ec-86d2-607b24e49dc3', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:59:30 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-b524cd7c-5eb4-4d00-b420-15efe2d6288f tempest-VolumesActionsTest-1837607340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (777670f5-2c24-4ed9-a7ed-52ee6a9045d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:59:30 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-b524cd7c-5eb4-4d00-b420-15efe2d6288f tempest-VolumesActionsTest-1837607340 None] Volume volume-bced835b-d58c-49ec-86d2-607b24e49dc3 (bced835b-d58c-49ec-86d2-607b24e49dc3): created successfully
Jun 15 15:59:30 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-b524cd7c-5eb4-4d00-b420-15efe2d6288f tempest-VolumesActionsTest-1837607340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (777670f5-2c24-4ed9-a7ed-52ee6a9045d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:59:30 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-b524cd7c-5eb4-4d00-b420-15efe2d6288f tempest-VolumesActionsTest-1837607340 None] Flow 'volume_create_manager' (2e8504f9-312d-4eae-9f8b-15d22bce3a1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:59:31 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-b524cd7c-5eb4-4d00-b420-15efe2d6288f tempest-VolumesActionsTest-1837607340 None] Created volume successfully.
Jun 15 15:59:31 devstack cinder-volume[91863]: DEBUG oslo_service.periodic_task [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 15:59:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:59:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:59:31 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:59:31 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:59:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:59:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:59:31 devstack sudo[103664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:59:31 devstack sudo[103664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:59:31 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-2fb8523b-bc34-4786-a164-4ddd8a0aaf55 tempest-BackendsCapabilitiesAdminTestsJSON-1511026976 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7578392028809, 'free_capacity_gb': 1775.7578392028809, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=91863) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Jun 15 15:59:31 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-be16a30e-efd4-44ac-8f67-7af23a6adabd tempest-BackendsCapabilitiesAdminTestsJSON-1511026976 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7578392028809, 'free_capacity_gb': 1775.7578392028809, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=91863) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Jun 15 15:59:31 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-480f60a2-f694-4991-91b0-91096abff3c6 tempest-VolumesActionsTest-794746475 None] Acquiring lock "cinder-bced835b-d58c-49ec-86d2-607b24e49dc3-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:59:31 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-480f60a2-f694-4991-91b0-91096abff3c6 tempest-VolumesActionsTest-794746475 None] Lock "cinder-bced835b-d58c-49ec-86d2-607b24e49dc3-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:59:31 devstack sudo[103664]: pam_unix(sudo:session): session closed for user root
Jun 15 15:59:31 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-480f60a2-f694-4991-91b0-91096abff3c6 tempest-VolumesActionsTest-794746475 None] Acquiring lock "cinder-quobyte-bced835b-d58c-49ec-86d2-607b24e49dc3" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:59:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.767s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:59:31 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:59:31 devstack cinder-volume[91863]: DEBUG oslo_service.periodic_task [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Running periodic task VolumeManager._thread_info {{(pid=91863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 15:59:31 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] thread count: 28 {{(pid=91863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 15 15:59:31 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] thread info: [<_MainThread(MainThread, started 131088232640640)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131088122704576)>, <Thread(Thread-3 (stat_writer), started daemon 131088123058112)>, <Thread(Rabbit-heartbeat, started daemon 131088121268864)>, <Thread(Thread-5 (_runner), started daemon 131088121904192)>, <Thread(Thread-7 (_runner), started daemon 131088122037248)>, <Thread(fd_logger, started daemon 131088119630784)>, <Thread(privsep_reader, started daemon 131088119781440)>, <Thread(tpool_thread_0, started daemon 131088111617728)>, <Thread(tpool_thread_1, started daemon 131088103225024)>, <Thread(tpool_thread_2, started daemon 131088094832320)>, <Thread(tpool_thread_3, started daemon 131088086439616)>, <Thread(tpool_thread_4, started daemon 131088078046912)>, <Thread(tpool_thread_5, started daemon 131088069654208)>, <Thread(tpool_thread_6, started daemon 131088061261504)>, <Thread(tpool_thread_7, started daemon 131088052868800)>, <Thread(tpool_thread_8, started daemon 131088044476096)>, <Thread(tpool_thread_9, started daemon 131088036083392)>, <Thread(tpool_thread_10, started daemon 131088027690688)>, <Thread(tpool_thread_11, started daemon 131088019297984)>, <Thread(tpool_thread_12, started daemon 131088010905280)>, <Thread(tpool_thread_13, started daemon 131088002512576)>, <Thread(tpool_thread_14, started daemon 131087994119872)>, <Thread(tpool_thread_15, started daemon 131087985727168)>, <Thread(tpool_thread_16, started daemon 131087977334464)>, <Thread(tpool_thread_17, started daemon 131087968941760)>, <Thread(tpool_thread_18, started daemon 131087960549056)>, <Thread(tpool_thread_19, started daemon 131087952156352)>] {{(pid=91863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 15 15:59:31 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-480f60a2-f694-4991-91b0-91096abff3c6 tempest-VolumesActionsTest-794746475 None] Lock "cinder-quobyte-bced835b-d58c-49ec-86d2-607b24e49dc3" acquired by "delete_volume" :: waited 0.027s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:59:31 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[35518390-9144-423f-b79d-76133c73e424]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:59:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-480f60a2-f694-4991-91b0-91096abff3c6 tempest-VolumesActionsTest-794746475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-bced835b-d58c-49ec-86d2-607b24e49dc3 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:59:32 devstack sudo[103667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-bced835b-d58c-49ec-86d2-607b24e49dc3
Jun 15 15:59:32 devstack sudo[103667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:59:32 devstack sudo[103667]: pam_unix(sudo:session): session closed for user root
Jun 15 15:59:32 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-480f60a2-f694-4991-91b0-91096abff3c6 tempest-VolumesActionsTest-794746475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-bced835b-d58c-49ec-86d2-607b24e49dc3" returned: 0 in 0.863s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:59:32 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-480f60a2-f694-4991-91b0-91096abff3c6 tempest-VolumesActionsTest-794746475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-bced835b-d58c-49ec-86d2-607b24e49dc3 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:59:32 devstack sudo[103672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-bced835b-d58c-49ec-86d2-607b24e49dc3
Jun 15 15:59:32 devstack sudo[103672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:59:33 devstack sudo[103672]: pam_unix(sudo:session): session closed for user root
Jun 15 15:59:33 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-480f60a2-f694-4991-91b0-91096abff3c6 tempest-VolumesActionsTest-794746475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-bced835b-d58c-49ec-86d2-607b24e49dc3" returned: 0 in 0.731s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:59:33 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-480f60a2-f694-4991-91b0-91096abff3c6 tempest-VolumesActionsTest-794746475 None] Lock "cinder-quobyte-bced835b-d58c-49ec-86d2-607b24e49dc3" released by "delete_volume" :: held 1.642s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:59:33 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-480f60a2-f694-4991-91b0-91096abff3c6 tempest-VolumesActionsTest-794746475 None] Created reservations ['4bbeafa3-a682-4241-bdda-4c99ea3117ef', '9bf9cf52-c003-4b18-8e1e-82489cbf51a7', 'e7b09c3c-1abe-4315-898d-3d12973a6772', '19b0d27b-eb5d-45fd-b587-1d77ff53e12b'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:59:33 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-480f60a2-f694-4991-91b0-91096abff3c6 tempest-VolumesActionsTest-794746475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:59:33 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-480f60a2-f694-4991-91b0-91096abff3c6 tempest-VolumesActionsTest-794746475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:59:33 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-480f60a2-f694-4991-91b0-91096abff3c6 tempest-VolumesActionsTest-794746475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:59:33 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-480f60a2-f694-4991-91b0-91096abff3c6 tempest-VolumesActionsTest-794746475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:59:33 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-480f60a2-f694-4991-91b0-91096abff3c6 tempest-VolumesActionsTest-794746475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:59:33 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-480f60a2-f694-4991-91b0-91096abff3c6 tempest-VolumesActionsTest-794746475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:59:33 devstack sudo[103675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:59:33 devstack sudo[103675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:59:34 devstack sudo[103675]: pam_unix(sudo:session): session closed for user root
Jun 15 15:59:34 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-480f60a2-f694-4991-91b0-91096abff3c6 tempest-VolumesActionsTest-794746475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.969s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:59:34 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-480f60a2-f694-4991-91b0-91096abff3c6 tempest-VolumesActionsTest-794746475 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:59:34 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-480f60a2-f694-4991-91b0-91096abff3c6 tempest-VolumesActionsTest-794746475 None] Deleted volume successfully.
Jun 15 15:59:34 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-480f60a2-f694-4991-91b0-91096abff3c6 tempest-VolumesActionsTest-794746475 None] Lock "cinder-bced835b-d58c-49ec-86d2-607b24e49dc3-delete_volume" released by "delete_volume" :: held 2.898s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:59:34 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-0aa5e4f7-a587-458b-980a-578dbfa0cdaf tempest-VolumesActionsTest-1837607340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 15:59:34 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-0aa5e4f7-a587-458b-980a-578dbfa0cdaf tempest-VolumesActionsTest-1837607340 None] Flow 'volume_create_manager' (007ac86f-6747-4fff-90c8-e8259ebee244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:59:34 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-0aa5e4f7-a587-458b-980a-578dbfa0cdaf tempest-VolumesActionsTest-1837607340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20fbe150-b05f-4749-83dc-c8310d264685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:59:34 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-0aa5e4f7-a587-458b-980a-578dbfa0cdaf tempest-VolumesActionsTest-1837607340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20fbe150-b05f-4749-83dc-c8310d264685) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:59:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1101950875',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d40750f-040c-4d8f-bb52-4d72b446d939,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed1443b4096a41ceb58964e938e1fa7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:59:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:59:35Z,use_quota=True,user_id='3a282a052d074757a0a2984e7a52b4ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:59:34 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-0aa5e4f7-a587-458b-980a-578dbfa0cdaf tempest-VolumesActionsTest-1837607340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25848b2a-c443-420a-9724-821c27a49443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:59:34 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-0aa5e4f7-a587-458b-980a-578dbfa0cdaf tempest-VolumesActionsTest-1837607340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25848b2a-c443-420a-9724-821c27a49443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:59:34 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-0aa5e4f7-a587-458b-980a-578dbfa0cdaf tempest-VolumesActionsTest-1837607340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f56ebd33-cdd3-42c0-8e01-fa673949cc88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:59:34 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-0aa5e4f7-a587-458b-980a-578dbfa0cdaf tempest-VolumesActionsTest-1837607340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f56ebd33-cdd3-42c0-8e01-fa673949cc88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d40750f-040c-4d8f-bb52-4d72b446d939', 'volume_name': 'volume-7d40750f-040c-4d8f-bb52-4d72b446d939', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:59:34 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-0aa5e4f7-a587-458b-980a-578dbfa0cdaf tempest-VolumesActionsTest-1837607340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcb70673-9c46-4607-917b-e2608cbda32b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:59:34 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-0aa5e4f7-a587-458b-980a-578dbfa0cdaf tempest-VolumesActionsTest-1837607340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcb70673-9c46-4607-917b-e2608cbda32b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:59:34 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-0aa5e4f7-a587-458b-980a-578dbfa0cdaf tempest-VolumesActionsTest-1837607340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f8b6a0c-0982-4783-b080-3beea726fa10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:59:34 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-0aa5e4f7-a587-458b-980a-578dbfa0cdaf tempest-VolumesActionsTest-1837607340 None] Volume 7d40750f-040c-4d8f-bb52-4d72b446d939: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d40750f-040c-4d8f-bb52-4d72b446d939', 'volume_size': 1}
Jun 15 15:59:34 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-0aa5e4f7-a587-458b-980a-578dbfa0cdaf tempest-VolumesActionsTest-1837607340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:59:34 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-0aa5e4f7-a587-458b-980a-578dbfa0cdaf tempest-VolumesActionsTest-1837607340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:59:34 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-0aa5e4f7-a587-458b-980a-578dbfa0cdaf tempest-VolumesActionsTest-1837607340 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:59:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1101950875',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d40750f-040c-4d8f-bb52-4d72b446d939,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed1443b4096a41ceb58964e938e1fa7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:59:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:59:35Z,use_quota=True,user_id='3a282a052d074757a0a2984e7a52b4ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 15:59:34 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-0aa5e4f7-a587-458b-980a-578dbfa0cdaf tempest-VolumesActionsTest-1837607340 None] Creating volume 7d40750f-040c-4d8f-bb52-4d72b446d939 {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 15:59:34 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-0aa5e4f7-a587-458b-980a-578dbfa0cdaf tempest-VolumesActionsTest-1837607340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:59:34 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-0aa5e4f7-a587-458b-980a-578dbfa0cdaf tempest-VolumesActionsTest-1837607340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:59:34 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-0aa5e4f7-a587-458b-980a-578dbfa0cdaf tempest-VolumesActionsTest-1837607340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:59:34 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-0aa5e4f7-a587-458b-980a-578dbfa0cdaf tempest-VolumesActionsTest-1837607340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:59:34 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-0aa5e4f7-a587-458b-980a-578dbfa0cdaf tempest-VolumesActionsTest-1837607340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:59:34 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-0aa5e4f7-a587-458b-980a-578dbfa0cdaf tempest-VolumesActionsTest-1837607340 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 15:59:34 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-0aa5e4f7-a587-458b-980a-578dbfa0cdaf tempest-VolumesActionsTest-1837607340 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 15:59:34 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-0aa5e4f7-a587-458b-980a-578dbfa0cdaf tempest-VolumesActionsTest-1837607340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-7d40750f-040c-4d8f-bb52-4d72b446d939 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:59:35 devstack sudo[103715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-7d40750f-040c-4d8f-bb52-4d72b446d939 1073741824
Jun 15 15:59:35 devstack sudo[103715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:59:36 devstack sudo[103715]: pam_unix(sudo:session): session closed for user root
Jun 15 15:59:36 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-0aa5e4f7-a587-458b-980a-578dbfa0cdaf tempest-VolumesActionsTest-1837607340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-7d40750f-040c-4d8f-bb52-4d72b446d939 1073741824" returned: 0 in 1.022s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:59:36 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-0aa5e4f7-a587-458b-980a-578dbfa0cdaf tempest-VolumesActionsTest-1837607340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-7d40750f-040c-4d8f-bb52-4d72b446d939 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:59:36 devstack sudo[103721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-7d40750f-040c-4d8f-bb52-4d72b446d939
Jun 15 15:59:36 devstack sudo[103721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:59:36 devstack sudo[103721]: pam_unix(sudo:session): session closed for user root
Jun 15 15:59:36 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-0aa5e4f7-a587-458b-980a-578dbfa0cdaf tempest-VolumesActionsTest-1837607340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-7d40750f-040c-4d8f-bb52-4d72b446d939" returned: 0 in 0.709s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:59:36 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-0aa5e4f7-a587-458b-980a-578dbfa0cdaf tempest-VolumesActionsTest-1837607340 None] <== create_volume: return (1788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 15:59:36 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-0aa5e4f7-a587-458b-980a-578dbfa0cdaf tempest-VolumesActionsTest-1837607340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.792s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:59:36 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-0aa5e4f7-a587-458b-980a-578dbfa0cdaf tempest-VolumesActionsTest-1837607340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f8b6a0c-0982-4783-b080-3beea726fa10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d40750f-040c-4d8f-bb52-4d72b446d939', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:59:36 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-0aa5e4f7-a587-458b-980a-578dbfa0cdaf tempest-VolumesActionsTest-1837607340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b94d3271-7b80-4b16-805f-3974c82f7352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:59:36 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-0aa5e4f7-a587-458b-980a-578dbfa0cdaf tempest-VolumesActionsTest-1837607340 None] Volume volume-7d40750f-040c-4d8f-bb52-4d72b446d939 (7d40750f-040c-4d8f-bb52-4d72b446d939): created successfully
Jun 15 15:59:36 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-0aa5e4f7-a587-458b-980a-578dbfa0cdaf tempest-VolumesActionsTest-1837607340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b94d3271-7b80-4b16-805f-3974c82f7352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:59:36 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-0aa5e4f7-a587-458b-980a-578dbfa0cdaf tempest-VolumesActionsTest-1837607340 None] Flow 'volume_create_manager' (007ac86f-6747-4fff-90c8-e8259ebee244) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:59:36 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-0aa5e4f7-a587-458b-980a-578dbfa0cdaf tempest-VolumesActionsTest-1837607340 None] Created volume successfully.
Jun 15 15:59:37 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-2d468581-27a6-4b30-8aac-8b4f4a34c383 tempest-VolumesActionsTest-794746475 None] Acquiring lock "cinder-7d40750f-040c-4d8f-bb52-4d72b446d939-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:59:37 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-2d468581-27a6-4b30-8aac-8b4f4a34c383 tempest-VolumesActionsTest-794746475 None] Lock "cinder-7d40750f-040c-4d8f-bb52-4d72b446d939-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:59:37 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-2d468581-27a6-4b30-8aac-8b4f4a34c383 tempest-VolumesActionsTest-794746475 None] Acquiring lock "cinder-quobyte-7d40750f-040c-4d8f-bb52-4d72b446d939" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:59:37 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-2d468581-27a6-4b30-8aac-8b4f4a34c383 tempest-VolumesActionsTest-794746475 None] Lock "cinder-quobyte-7d40750f-040c-4d8f-bb52-4d72b446d939" acquired by "delete_volume" :: waited 0.015s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:59:37 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc37d00-7b4d-45ce-ba27-37b08c939439]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:59:37 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-2d468581-27a6-4b30-8aac-8b4f4a34c383 tempest-VolumesActionsTest-794746475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-7d40750f-040c-4d8f-bb52-4d72b446d939 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:59:37 devstack sudo[103724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-7d40750f-040c-4d8f-bb52-4d72b446d939
Jun 15 15:59:37 devstack sudo[103724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:59:38 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-ddab88b6-f278-435f-ab06-ca2b73464015 tempest-GroupSnapshotsV319Test-447552809 None] Group tempest-GroupSnapshotsV319Test-Group-723301369: creating
Jun 15 15:59:38 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-ddab88b6-f278-435f-ab06-ca2b73464015 tempest-GroupSnapshotsV319Test-447552809 None] Group tempest-GroupSnapshotsV319Test-Group-723301369: created successfully
Jun 15 15:59:38 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-ddab88b6-f278-435f-ab06-ca2b73464015 tempest-GroupSnapshotsV319Test-447552809 None] Create group completed successfully.
Jun 15 15:59:38 devstack sudo[103724]: pam_unix(sudo:session): session closed for user root
Jun 15 15:59:38 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-2d468581-27a6-4b30-8aac-8b4f4a34c383 tempest-VolumesActionsTest-794746475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-7d40750f-040c-4d8f-bb52-4d72b446d939" returned: 0 in 0.922s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:59:38 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-2d468581-27a6-4b30-8aac-8b4f4a34c383 tempest-VolumesActionsTest-794746475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-7d40750f-040c-4d8f-bb52-4d72b446d939 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:59:38 devstack sudo[103729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-7d40750f-040c-4d8f-bb52-4d72b446d939
Jun 15 15:59:38 devstack sudo[103729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:59:39 devstack sudo[103729]: pam_unix(sudo:session): session closed for user root
Jun 15 15:59:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-2d468581-27a6-4b30-8aac-8b4f4a34c383 tempest-VolumesActionsTest-794746475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-7d40750f-040c-4d8f-bb52-4d72b446d939" returned: 0 in 0.715s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:59:39 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-2d468581-27a6-4b30-8aac-8b4f4a34c383 tempest-VolumesActionsTest-794746475 None] Lock "cinder-quobyte-7d40750f-040c-4d8f-bb52-4d72b446d939" released by "delete_volume" :: held 1.698s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:59:39 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-2d468581-27a6-4b30-8aac-8b4f4a34c383 tempest-VolumesActionsTest-794746475 None] Created reservations ['64e413e7-a58e-4be6-b028-d5d7dc32703b', '67a7ba1b-7ec9-46ce-99ae-711bdafa821e', '66e9babf-d67d-47cb-b79e-e28ed9c15952', 'bb827657-41d6-49da-ad86-23323c14fa3d'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:59:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-2d468581-27a6-4b30-8aac-8b4f4a34c383 tempest-VolumesActionsTest-794746475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:59:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-2d468581-27a6-4b30-8aac-8b4f4a34c383 tempest-VolumesActionsTest-794746475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:59:39 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-2d468581-27a6-4b30-8aac-8b4f4a34c383 tempest-VolumesActionsTest-794746475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:59:39 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-2d468581-27a6-4b30-8aac-8b4f4a34c383 tempest-VolumesActionsTest-794746475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:59:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-2d468581-27a6-4b30-8aac-8b4f4a34c383 tempest-VolumesActionsTest-794746475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:59:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-2d468581-27a6-4b30-8aac-8b4f4a34c383 tempest-VolumesActionsTest-794746475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:59:39 devstack sudo[103732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:59:39 devstack sudo[103732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:59:40 devstack sudo[103732]: pam_unix(sudo:session): session closed for user root
Jun 15 15:59:40 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-2d468581-27a6-4b30-8aac-8b4f4a34c383 tempest-VolumesActionsTest-794746475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.761s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:59:40 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-2d468581-27a6-4b30-8aac-8b4f4a34c383 tempest-VolumesActionsTest-794746475 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:59:40 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-2d468581-27a6-4b30-8aac-8b4f4a34c383 tempest-VolumesActionsTest-794746475 None] Deleted volume successfully.
Jun 15 15:59:40 devstack cinder-volume[91863]: DEBUG dbcounter [-] [91863] Writing DB stats cinder:SELECT=99,cinder:DELETE=6,cinder:UPDATE=122,cinder:INSERT=25 {{(pid=91863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 15:59:40 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-2d468581-27a6-4b30-8aac-8b4f4a34c383 tempest-VolumesActionsTest-794746475 None] Lock "cinder-7d40750f-040c-4d8f-bb52-4d72b446d939-delete_volume" released by "delete_volume" :: held 2.713s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:59:40 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-eaebbe94-09c1-42ee-9d3f-ef23b3c827d5 tempest-VolumesActionsTest-1837607340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 15:59:40 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-eaebbe94-09c1-42ee-9d3f-ef23b3c827d5 tempest-VolumesActionsTest-1837607340 None] Flow 'volume_create_manager' (bed482d0-5fb1-4611-b34d-52a9a8ea5a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:59:40 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-eaebbe94-09c1-42ee-9d3f-ef23b3c827d5 tempest-VolumesActionsTest-1837607340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bc1eba3-5f37-4567-bd91-c6c2327fbdf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:59:40 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-eaebbe94-09c1-42ee-9d3f-ef23b3c827d5 tempest-VolumesActionsTest-1837607340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bc1eba3-5f37-4567-bd91-c6c2327fbdf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:59:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-343689228',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6912601a-a544-41c5-ae11-519386a2fd6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed1443b4096a41ceb58964e938e1fa7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:59:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:59:40Z,use_quota=True,user_id='3a282a052d074757a0a2984e7a52b4ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:59:40 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-eaebbe94-09c1-42ee-9d3f-ef23b3c827d5 tempest-VolumesActionsTest-1837607340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25d4ff4f-8bf5-4d26-92ba-d62522849fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:59:40 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-eaebbe94-09c1-42ee-9d3f-ef23b3c827d5 tempest-VolumesActionsTest-1837607340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25d4ff4f-8bf5-4d26-92ba-d62522849fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:59:40 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-eaebbe94-09c1-42ee-9d3f-ef23b3c827d5 tempest-VolumesActionsTest-1837607340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a784eb9-5751-43be-90d5-508519b28639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:59:40 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-eaebbe94-09c1-42ee-9d3f-ef23b3c827d5 tempest-VolumesActionsTest-1837607340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a784eb9-5751-43be-90d5-508519b28639) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6912601a-a544-41c5-ae11-519386a2fd6c', 'volume_name': 'volume-6912601a-a544-41c5-ae11-519386a2fd6c', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:59:40 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-eaebbe94-09c1-42ee-9d3f-ef23b3c827d5 tempest-VolumesActionsTest-1837607340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e54cc76c-6aa4-4f2d-86db-29fbaa433ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:59:40 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-eaebbe94-09c1-42ee-9d3f-ef23b3c827d5 tempest-VolumesActionsTest-1837607340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e54cc76c-6aa4-4f2d-86db-29fbaa433ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:59:40 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-eaebbe94-09c1-42ee-9d3f-ef23b3c827d5 tempest-VolumesActionsTest-1837607340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5b2c94e-3329-4629-891b-79d30b7e7b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:59:40 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-eaebbe94-09c1-42ee-9d3f-ef23b3c827d5 tempest-VolumesActionsTest-1837607340 None] Volume 6912601a-a544-41c5-ae11-519386a2fd6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6912601a-a544-41c5-ae11-519386a2fd6c', 'volume_size': 1}
Jun 15 15:59:40 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-eaebbe94-09c1-42ee-9d3f-ef23b3c827d5 tempest-VolumesActionsTest-1837607340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:59:40 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-eaebbe94-09c1-42ee-9d3f-ef23b3c827d5 tempest-VolumesActionsTest-1837607340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:59:40 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-eaebbe94-09c1-42ee-9d3f-ef23b3c827d5 tempest-VolumesActionsTest-1837607340 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:59:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-343689228',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6912601a-a544-41c5-ae11-519386a2fd6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed1443b4096a41ceb58964e938e1fa7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:59:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:59:40Z,use_quota=True,user_id='3a282a052d074757a0a2984e7a52b4ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 15:59:40 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-eaebbe94-09c1-42ee-9d3f-ef23b3c827d5 tempest-VolumesActionsTest-1837607340 None] Creating volume 6912601a-a544-41c5-ae11-519386a2fd6c {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 15:59:40 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-eaebbe94-09c1-42ee-9d3f-ef23b3c827d5 tempest-VolumesActionsTest-1837607340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:59:40 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-eaebbe94-09c1-42ee-9d3f-ef23b3c827d5 tempest-VolumesActionsTest-1837607340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:59:40 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-eaebbe94-09c1-42ee-9d3f-ef23b3c827d5 tempest-VolumesActionsTest-1837607340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:59:40 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-eaebbe94-09c1-42ee-9d3f-ef23b3c827d5 tempest-VolumesActionsTest-1837607340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:59:40 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-eaebbe94-09c1-42ee-9d3f-ef23b3c827d5 tempest-VolumesActionsTest-1837607340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:59:40 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-eaebbe94-09c1-42ee-9d3f-ef23b3c827d5 tempest-VolumesActionsTest-1837607340 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 15:59:40 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-eaebbe94-09c1-42ee-9d3f-ef23b3c827d5 tempest-VolumesActionsTest-1837607340 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 15:59:40 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-eaebbe94-09c1-42ee-9d3f-ef23b3c827d5 tempest-VolumesActionsTest-1837607340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-6912601a-a544-41c5-ae11-519386a2fd6c 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:59:40 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba089943-649e-4c42-aca1-37e25a6cd796 tempest-GroupSnapshotsV319Test-447552809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 15:59:40 devstack sudo[103737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-6912601a-a544-41c5-ae11-519386a2fd6c 1073741824
Jun 15 15:59:40 devstack sudo[103737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:59:40 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-ba089943-649e-4c42-aca1-37e25a6cd796 tempest-GroupSnapshotsV319Test-447552809 None] Flow 'volume_create_manager' (761a7d5f-c77c-43d9-a6db-a4631f29f4b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:59:40 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-ba089943-649e-4c42-aca1-37e25a6cd796 tempest-GroupSnapshotsV319Test-447552809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff616b93-76c0-4879-9ca6-4813cff751dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:59:40 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-ba089943-649e-4c42-aca1-37e25a6cd796 tempest-GroupSnapshotsV319Test-447552809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff616b93-76c0-4879-9ca6-4813cff751dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:59:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-399805899',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d59f5857-5aa5-4bc0-99d1-d3773531c431,host='devstack@QuobyteHD#QuobyteHD',id=8b24e445-9606-4f33-8933-e8bcca4b442e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c743bc13de074a8ca3691f61fbe41dbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:59:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:59:40Z,use_quota=True,user_id='47507152ad744003908cb913a577c1b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7034d36-dd2a-45da-a0e1-a5330468b945),volume_type_id=a7034d36-dd2a-45da-a0e1-a5330468b945)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:59:40 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-ba089943-649e-4c42-aca1-37e25a6cd796 tempest-GroupSnapshotsV319Test-447552809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae342d7c-dd1a-4e5e-9334-e0b22c81881c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:59:40 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-ba089943-649e-4c42-aca1-37e25a6cd796 tempest-GroupSnapshotsV319Test-447552809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae342d7c-dd1a-4e5e-9334-e0b22c81881c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:59:40 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-ba089943-649e-4c42-aca1-37e25a6cd796 tempest-GroupSnapshotsV319Test-447552809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27afdd5e-dbf1-42cc-a967-0711225384a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:59:40 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-ba089943-649e-4c42-aca1-37e25a6cd796 tempest-GroupSnapshotsV319Test-447552809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27afdd5e-dbf1-42cc-a967-0711225384a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b24e445-9606-4f33-8933-e8bcca4b442e', 'volume_name': 'volume-8b24e445-9606-4f33-8933-e8bcca4b442e', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:59:40 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-ba089943-649e-4c42-aca1-37e25a6cd796 tempest-GroupSnapshotsV319Test-447552809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7513d6d-6da4-4915-8c26-8a044c2c93c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:59:40 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-ba089943-649e-4c42-aca1-37e25a6cd796 tempest-GroupSnapshotsV319Test-447552809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7513d6d-6da4-4915-8c26-8a044c2c93c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:59:40 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-ba089943-649e-4c42-aca1-37e25a6cd796 tempest-GroupSnapshotsV319Test-447552809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af03ba25-94cc-4d9d-84f3-52d880025417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:59:40 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-ba089943-649e-4c42-aca1-37e25a6cd796 tempest-GroupSnapshotsV319Test-447552809 None] Volume 8b24e445-9606-4f33-8933-e8bcca4b442e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b24e445-9606-4f33-8933-e8bcca4b442e', 'volume_size': 1}
Jun 15 15:59:40 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-ba089943-649e-4c42-aca1-37e25a6cd796 tempest-GroupSnapshotsV319Test-447552809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:59:41 devstack sudo[103737]: pam_unix(sudo:session): session closed for user root
Jun 15 15:59:41 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-eaebbe94-09c1-42ee-9d3f-ef23b3c827d5 tempest-VolumesActionsTest-1837607340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-6912601a-a544-41c5-ae11-519386a2fd6c 1073741824" returned: 0 in 0.948s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:59:41 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-eaebbe94-09c1-42ee-9d3f-ef23b3c827d5 tempest-VolumesActionsTest-1837607340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-6912601a-a544-41c5-ae11-519386a2fd6c {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:59:41 devstack sudo[103743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-6912601a-a544-41c5-ae11-519386a2fd6c
Jun 15 15:59:41 devstack sudo[103743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:59:41 devstack sudo[103743]: pam_unix(sudo:session): session closed for user root
Jun 15 15:59:41 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-eaebbe94-09c1-42ee-9d3f-ef23b3c827d5 tempest-VolumesActionsTest-1837607340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-6912601a-a544-41c5-ae11-519386a2fd6c" returned: 0 in 0.651s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:59:41 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-eaebbe94-09c1-42ee-9d3f-ef23b3c827d5 tempest-VolumesActionsTest-1837607340 None] <== create_volume: return (1637ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 15:59:41 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-eaebbe94-09c1-42ee-9d3f-ef23b3c827d5 tempest-VolumesActionsTest-1837607340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.643s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:59:41 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-ba089943-649e-4c42-aca1-37e25a6cd796 tempest-GroupSnapshotsV319Test-447552809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.526s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:59:41 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-ba089943-649e-4c42-aca1-37e25a6cd796 tempest-GroupSnapshotsV319Test-447552809 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=d59f5857-5aa5-4bc0-99d1-d3773531c431,created_at=2026-06-15T13:59:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-399805899',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d59f5857-5aa5-4bc0-99d1-d3773531c431,host='devstack@QuobyteHD#QuobyteHD',id=8b24e445-9606-4f33-8933-e8bcca4b442e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c743bc13de074a8ca3691f61fbe41dbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:59:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:59:40Z,use_quota=True,user_id='47507152ad744003908cb913a577c1b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7034d36-dd2a-45da-a0e1-a5330468b945),volume_type_id=a7034d36-dd2a-45da-a0e1-a5330468b945)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 15:59:41 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-ba089943-649e-4c42-aca1-37e25a6cd796 tempest-GroupSnapshotsV319Test-447552809 None] Creating volume 8b24e445-9606-4f33-8933-e8bcca4b442e {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 15:59:41 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-ba089943-649e-4c42-aca1-37e25a6cd796 tempest-GroupSnapshotsV319Test-447552809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:59:41 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-ba089943-649e-4c42-aca1-37e25a6cd796 tempest-GroupSnapshotsV319Test-447552809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:59:41 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-ba089943-649e-4c42-aca1-37e25a6cd796 tempest-GroupSnapshotsV319Test-447552809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:59:41 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-ba089943-649e-4c42-aca1-37e25a6cd796 tempest-GroupSnapshotsV319Test-447552809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:59:41 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-ba089943-649e-4c42-aca1-37e25a6cd796 tempest-GroupSnapshotsV319Test-447552809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:59:41 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-ba089943-649e-4c42-aca1-37e25a6cd796 tempest-GroupSnapshotsV319Test-447552809 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 15:59:41 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-ba089943-649e-4c42-aca1-37e25a6cd796 tempest-GroupSnapshotsV319Test-447552809 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 15:59:41 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ba089943-649e-4c42-aca1-37e25a6cd796 tempest-GroupSnapshotsV319Test-447552809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8b24e445-9606-4f33-8933-e8bcca4b442e 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:59:42 devstack sudo[103748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8b24e445-9606-4f33-8933-e8bcca4b442e 1073741824
Jun 15 15:59:42 devstack sudo[103748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:59:42 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-eaebbe94-09c1-42ee-9d3f-ef23b3c827d5 tempest-VolumesActionsTest-1837607340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5b2c94e-3329-4629-891b-79d30b7e7b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6912601a-a544-41c5-ae11-519386a2fd6c', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:59:42 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-eaebbe94-09c1-42ee-9d3f-ef23b3c827d5 tempest-VolumesActionsTest-1837607340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (019b7601-9007-4384-9acf-85c8e6c29317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:59:42 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-eaebbe94-09c1-42ee-9d3f-ef23b3c827d5 tempest-VolumesActionsTest-1837607340 None] Volume volume-6912601a-a544-41c5-ae11-519386a2fd6c (6912601a-a544-41c5-ae11-519386a2fd6c): created successfully
Jun 15 15:59:42 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-eaebbe94-09c1-42ee-9d3f-ef23b3c827d5 tempest-VolumesActionsTest-1837607340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (019b7601-9007-4384-9acf-85c8e6c29317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:59:42 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-eaebbe94-09c1-42ee-9d3f-ef23b3c827d5 tempest-VolumesActionsTest-1837607340 None] Flow 'volume_create_manager' (bed482d0-5fb1-4611-b34d-52a9a8ea5a7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:59:42 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-eaebbe94-09c1-42ee-9d3f-ef23b3c827d5 tempest-VolumesActionsTest-1837607340 None] Created volume successfully.
Jun 15 15:59:42 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-b019eb65-33a2-4a08-8d70-45eeab18f6c9 tempest-VolumesActionsTest-794746475 None] Acquiring lock "cinder-6912601a-a544-41c5-ae11-519386a2fd6c-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:59:42 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-b019eb65-33a2-4a08-8d70-45eeab18f6c9 tempest-VolumesActionsTest-794746475 None] Lock "cinder-6912601a-a544-41c5-ae11-519386a2fd6c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:59:42 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-b019eb65-33a2-4a08-8d70-45eeab18f6c9 tempest-VolumesActionsTest-794746475 None] Acquiring lock "cinder-quobyte-6912601a-a544-41c5-ae11-519386a2fd6c" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:59:42 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-b019eb65-33a2-4a08-8d70-45eeab18f6c9 tempest-VolumesActionsTest-794746475 None] Lock "cinder-quobyte-6912601a-a544-41c5-ae11-519386a2fd6c" acquired by "delete_volume" :: waited 0.020s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:59:42 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[16b94a22-adf5-4c64-adff-82570c8ff307]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:59:42 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-b019eb65-33a2-4a08-8d70-45eeab18f6c9 tempest-VolumesActionsTest-794746475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-6912601a-a544-41c5-ae11-519386a2fd6c {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:59:42 devstack sudo[103753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-6912601a-a544-41c5-ae11-519386a2fd6c
Jun 15 15:59:42 devstack sudo[103753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:59:42 devstack sudo[103748]: pam_unix(sudo:session): session closed for user root
Jun 15 15:59:42 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ba089943-649e-4c42-aca1-37e25a6cd796 tempest-GroupSnapshotsV319Test-447552809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8b24e445-9606-4f33-8933-e8bcca4b442e 1073741824" returned: 0 in 0.929s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:59:42 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ba089943-649e-4c42-aca1-37e25a6cd796 tempest-GroupSnapshotsV319Test-447552809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8b24e445-9606-4f33-8933-e8bcca4b442e {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:59:42 devstack sudo[103756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8b24e445-9606-4f33-8933-e8bcca4b442e
Jun 15 15:59:42 devstack sudo[103756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:59:43 devstack sudo[103753]: pam_unix(sudo:session): session closed for user root
Jun 15 15:59:43 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-b019eb65-33a2-4a08-8d70-45eeab18f6c9 tempest-VolumesActionsTest-794746475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-6912601a-a544-41c5-ae11-519386a2fd6c" returned: 0 in 0.813s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:59:43 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-b019eb65-33a2-4a08-8d70-45eeab18f6c9 tempest-VolumesActionsTest-794746475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-6912601a-a544-41c5-ae11-519386a2fd6c {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:59:43 devstack sudo[103761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-6912601a-a544-41c5-ae11-519386a2fd6c
Jun 15 15:59:43 devstack sudo[103761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:59:43 devstack sudo[103756]: pam_unix(sudo:session): session closed for user root
Jun 15 15:59:43 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ba089943-649e-4c42-aca1-37e25a6cd796 tempest-GroupSnapshotsV319Test-447552809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8b24e445-9606-4f33-8933-e8bcca4b442e" returned: 0 in 0.630s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:59:43 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-ba089943-649e-4c42-aca1-37e25a6cd796 tempest-GroupSnapshotsV319Test-447552809 None] <== create_volume: return (1605ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 15:59:43 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-ba089943-649e-4c42-aca1-37e25a6cd796 tempest-GroupSnapshotsV319Test-447552809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.608s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:59:43 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-ba089943-649e-4c42-aca1-37e25a6cd796 tempest-GroupSnapshotsV319Test-447552809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af03ba25-94cc-4d9d-84f3-52d880025417) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b24e445-9606-4f33-8933-e8bcca4b442e', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:59:43 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-ba089943-649e-4c42-aca1-37e25a6cd796 tempest-GroupSnapshotsV319Test-447552809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (122ab67a-6cb4-47a8-9554-5eff0d09f99f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:59:43 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-ba089943-649e-4c42-aca1-37e25a6cd796 tempest-GroupSnapshotsV319Test-447552809 None] Volume volume-8b24e445-9606-4f33-8933-e8bcca4b442e (8b24e445-9606-4f33-8933-e8bcca4b442e): created successfully
Jun 15 15:59:43 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-ba089943-649e-4c42-aca1-37e25a6cd796 tempest-GroupSnapshotsV319Test-447552809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (122ab67a-6cb4-47a8-9554-5eff0d09f99f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:59:43 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-ba089943-649e-4c42-aca1-37e25a6cd796 tempest-GroupSnapshotsV319Test-447552809 None] Flow 'volume_create_manager' (761a7d5f-c77c-43d9-a6db-a4631f29f4b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:59:43 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-ba089943-649e-4c42-aca1-37e25a6cd796 tempest-GroupSnapshotsV319Test-447552809 None] Created volume successfully.
Jun 15 15:59:44 devstack sudo[103761]: pam_unix(sudo:session): session closed for user root
Jun 15 15:59:44 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-b019eb65-33a2-4a08-8d70-45eeab18f6c9 tempest-VolumesActionsTest-794746475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-6912601a-a544-41c5-ae11-519386a2fd6c" returned: 0 in 0.684s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:59:44 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-b019eb65-33a2-4a08-8d70-45eeab18f6c9 tempest-VolumesActionsTest-794746475 None] Lock "cinder-quobyte-6912601a-a544-41c5-ae11-519386a2fd6c" released by "delete_volume" :: held 1.544s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:59:44 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-b019eb65-33a2-4a08-8d70-45eeab18f6c9 tempest-VolumesActionsTest-794746475 None] Created reservations ['7c895124-0d19-4df2-b54e-ef9f88cdfa80', 'c0f26f93-ace0-4b52-8e96-a80e698e437e', 'c9431a9e-1b08-4084-8c8f-80525353b9a2', '8c76e444-7d35-41bf-a255-05b534c12d92'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:59:44 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-b019eb65-33a2-4a08-8d70-45eeab18f6c9 tempest-VolumesActionsTest-794746475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:59:44 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-b019eb65-33a2-4a08-8d70-45eeab18f6c9 tempest-VolumesActionsTest-794746475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:59:44 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-b019eb65-33a2-4a08-8d70-45eeab18f6c9 tempest-VolumesActionsTest-794746475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:59:44 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-b019eb65-33a2-4a08-8d70-45eeab18f6c9 tempest-VolumesActionsTest-794746475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:59:44 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-b019eb65-33a2-4a08-8d70-45eeab18f6c9 tempest-VolumesActionsTest-794746475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:59:44 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-b019eb65-33a2-4a08-8d70-45eeab18f6c9 tempest-VolumesActionsTest-794746475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:59:44 devstack sudo[103765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:59:44 devstack sudo[103765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:59:44 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-48843b0a-3cf5-4e0a-ad6a-f6647b62627f tempest-GroupSnapshotsV319Test-447552809 None] GroupSnapshot 5c2e03f8-c486-4788-a06e-48e1e8c06943: creating.
Jun 15 15:59:44 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-48843b0a-3cf5-4e0a-ad6a-f6647b62627f tempest-GroupSnapshotsV319Test-447552809 None] Group snapshot 5c2e03f8-c486-4788-a06e-48e1e8c06943: creating. {{(pid=91863) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jun 15 15:59:44 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-48843b0a-3cf5-4e0a-ad6a-f6647b62627f tempest-GroupSnapshotsV319Test-447552809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:59:44 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-48843b0a-3cf5-4e0a-ad6a-f6647b62627f tempest-GroupSnapshotsV319Test-447552809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:59:44 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-48843b0a-3cf5-4e0a-ad6a-f6647b62627f tempest-GroupSnapshotsV319Test-447552809 None] Creating offline snapshot 08d33595-aafe-4eb2-aa92-07c7bc2520a5 of volume 8b24e445-9606-4f33-8933-e8bcca4b442e {{(pid=91863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 15 15:59:44 devstack sudo[103765]: pam_unix(sudo:session): session closed for user root
Jun 15 15:59:44 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-b019eb65-33a2-4a08-8d70-45eeab18f6c9 tempest-VolumesActionsTest-794746475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.631s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:59:44 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-b019eb65-33a2-4a08-8d70-45eeab18f6c9 tempest-VolumesActionsTest-794746475 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:59:44 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-b019eb65-33a2-4a08-8d70-45eeab18f6c9 tempest-VolumesActionsTest-794746475 None] Deleted volume successfully.
Jun 15 15:59:44 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[743f072f-bcc2-4f0e-870d-efa7b14b0bb2]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:59:44 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-48843b0a-3cf5-4e0a-ad6a-f6647b62627f tempest-GroupSnapshotsV319Test-447552809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8b24e445-9606-4f33-8933-e8bcca4b442e {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:59:44 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-b019eb65-33a2-4a08-8d70-45eeab18f6c9 tempest-VolumesActionsTest-794746475 None] Lock "cinder-6912601a-a544-41c5-ae11-519386a2fd6c-delete_volume" released by "delete_volume" :: held 2.403s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:59:45 devstack sudo[103769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8b24e445-9606-4f33-8933-e8bcca4b442e
Jun 15 15:59:45 devstack sudo[103769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:59:45 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f23459a-fcd7-456d-8699-d5c39cf528c1 tempest-VolumesActionsTest-1837607340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 15:59:45 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5f23459a-fcd7-456d-8699-d5c39cf528c1 tempest-VolumesActionsTest-1837607340 None] Flow 'volume_create_manager' (b7dd763c-d01a-48b2-a0a6-17bcfe4050f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:59:45 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5f23459a-fcd7-456d-8699-d5c39cf528c1 tempest-VolumesActionsTest-1837607340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (110256e4-9fe4-4bb7-9acf-8211cadabafb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:59:45 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5f23459a-fcd7-456d-8699-d5c39cf528c1 tempest-VolumesActionsTest-1837607340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (110256e4-9fe4-4bb7-9acf-8211cadabafb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:59:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-915172725',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09ba05f3-ee75-4e30-8fc1-c2c664b0b6a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed1443b4096a41ceb58964e938e1fa7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:59:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:59:45Z,use_quota=True,user_id='3a282a052d074757a0a2984e7a52b4ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:59:45 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5f23459a-fcd7-456d-8699-d5c39cf528c1 tempest-VolumesActionsTest-1837607340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a4f5435-8b45-41fe-af10-2aefa30e286a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:59:45 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5f23459a-fcd7-456d-8699-d5c39cf528c1 tempest-VolumesActionsTest-1837607340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a4f5435-8b45-41fe-af10-2aefa30e286a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:59:45 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5f23459a-fcd7-456d-8699-d5c39cf528c1 tempest-VolumesActionsTest-1837607340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05cae7e5-79e2-4626-b1c1-9d00b21ad6a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:59:45 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5f23459a-fcd7-456d-8699-d5c39cf528c1 tempest-VolumesActionsTest-1837607340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05cae7e5-79e2-4626-b1c1-9d00b21ad6a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09ba05f3-ee75-4e30-8fc1-c2c664b0b6a4', 'volume_name': 'volume-09ba05f3-ee75-4e30-8fc1-c2c664b0b6a4', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:59:45 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5f23459a-fcd7-456d-8699-d5c39cf528c1 tempest-VolumesActionsTest-1837607340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e76add5-eef9-49e7-817e-e267922d68c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:59:45 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5f23459a-fcd7-456d-8699-d5c39cf528c1 tempest-VolumesActionsTest-1837607340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e76add5-eef9-49e7-817e-e267922d68c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:59:45 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5f23459a-fcd7-456d-8699-d5c39cf528c1 tempest-VolumesActionsTest-1837607340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4367babb-4432-42a1-91ef-966733e11b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:59:45 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-5f23459a-fcd7-456d-8699-d5c39cf528c1 tempest-VolumesActionsTest-1837607340 None] Volume 09ba05f3-ee75-4e30-8fc1-c2c664b0b6a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09ba05f3-ee75-4e30-8fc1-c2c664b0b6a4', 'volume_size': 1}
Jun 15 15:59:45 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-5f23459a-fcd7-456d-8699-d5c39cf528c1 tempest-VolumesActionsTest-1837607340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:59:45 devstack sudo[103769]: pam_unix(sudo:session): session closed for user root
Jun 15 15:59:45 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-48843b0a-3cf5-4e0a-ad6a-f6647b62627f tempest-GroupSnapshotsV319Test-447552809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8b24e445-9606-4f33-8933-e8bcca4b442e" returned: 0 in 0.820s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:59:45 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-48843b0a-3cf5-4e0a-ad6a-f6647b62627f tempest-GroupSnapshotsV319Test-447552809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8b24e445-9606-4f33-8933-e8bcca4b442e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8b24e445-9606-4f33-8933-e8bcca4b442e.08d33595-aafe-4eb2-aa92-07c7bc2520a5 1G {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:59:45 devstack sudo[103774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8b24e445-9606-4f33-8933-e8bcca4b442e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8b24e445-9606-4f33-8933-e8bcca4b442e.08d33595-aafe-4eb2-aa92-07c7bc2520a5 1G
Jun 15 15:59:45 devstack sudo[103774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:59:46 devstack sudo[103774]: pam_unix(sudo:session): session closed for user root
Jun 15 15:59:46 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-48843b0a-3cf5-4e0a-ad6a-f6647b62627f tempest-GroupSnapshotsV319Test-447552809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8b24e445-9606-4f33-8933-e8bcca4b442e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8b24e445-9606-4f33-8933-e8bcca4b442e.08d33595-aafe-4eb2-aa92-07c7bc2520a5 1G" returned: 0 in 0.761s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:59:46 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-48843b0a-3cf5-4e0a-ad6a-f6647b62627f tempest-GroupSnapshotsV319Test-447552809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b24e445-9606-4f33-8933-e8bcca4b442e -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8b24e445-9606-4f33-8933-e8bcca4b442e.08d33595-aafe-4eb2-aa92-07c7bc2520a5 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:59:46 devstack sudo[103779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b24e445-9606-4f33-8933-e8bcca4b442e -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8b24e445-9606-4f33-8933-e8bcca4b442e.08d33595-aafe-4eb2-aa92-07c7bc2520a5
Jun 15 15:59:46 devstack sudo[103779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:59:47 devstack sudo[103779]: pam_unix(sudo:session): session closed for user root
Jun 15 15:59:47 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-48843b0a-3cf5-4e0a-ad6a-f6647b62627f tempest-GroupSnapshotsV319Test-447552809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b24e445-9606-4f33-8933-e8bcca4b442e -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8b24e445-9606-4f33-8933-e8bcca4b442e.08d33595-aafe-4eb2-aa92-07c7bc2520a5" returned: 0 in 0.746s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:59:47 devstack cinder-volume[91863]: WARNING cinder.volume.drivers.remotefs [None req-48843b0a-3cf5-4e0a-ad6a-f6647b62627f tempest-GroupSnapshotsV319Test-447552809 None] /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8b24e445-9606-4f33-8933-e8bcca4b442e.08d33595-aafe-4eb2-aa92-07c7bc2520a5 is being set with open permissions: ugo+rw: NotImplementedError
Jun 15 15:59:47 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-48843b0a-3cf5-4e0a-ad6a-f6647b62627f tempest-GroupSnapshotsV319Test-447552809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8b24e445-9606-4f33-8933-e8bcca4b442e.08d33595-aafe-4eb2-aa92-07c7bc2520a5 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:59:47 devstack sudo[103784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8b24e445-9606-4f33-8933-e8bcca4b442e.08d33595-aafe-4eb2-aa92-07c7bc2520a5
Jun 15 15:59:47 devstack sudo[103784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:59:47 devstack sudo[103784]: pam_unix(sudo:session): session closed for user root
Jun 15 15:59:47 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-48843b0a-3cf5-4e0a-ad6a-f6647b62627f tempest-GroupSnapshotsV319Test-447552809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8b24e445-9606-4f33-8933-e8bcca4b442e.08d33595-aafe-4eb2-aa92-07c7bc2520a5" returned: 0 in 0.665s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:59:47 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-48843b0a-3cf5-4e0a-ad6a-f6647b62627f tempest-GroupSnapshotsV319Test-447552809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8b24e445-9606-4f33-8933-e8bcca4b442e.info {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:59:47 devstack sudo[103789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8b24e445-9606-4f33-8933-e8bcca4b442e.info
Jun 15 15:59:47 devstack sudo[103789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:59:48 devstack sudo[103789]: pam_unix(sudo:session): session closed for user root
Jun 15 15:59:48 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-48843b0a-3cf5-4e0a-ad6a-f6647b62627f tempest-GroupSnapshotsV319Test-447552809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8b24e445-9606-4f33-8933-e8bcca4b442e.info" returned: 0 in 0.620s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:59:48 devstack cinder-volume[91863]: WARNING cinder.volume.drivers.remotefs [None req-48843b0a-3cf5-4e0a-ad6a-f6647b62627f tempest-GroupSnapshotsV319Test-447552809 None] /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8b24e445-9606-4f33-8933-e8bcca4b442e.info is being set with open permissions: ugo+rw: NotImplementedError
Jun 15 15:59:48 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-48843b0a-3cf5-4e0a-ad6a-f6647b62627f tempest-GroupSnapshotsV319Test-447552809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8b24e445-9606-4f33-8933-e8bcca4b442e.info {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:59:48 devstack sudo[103807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8b24e445-9606-4f33-8933-e8bcca4b442e.info
Jun 15 15:59:48 devstack sudo[103807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:59:49 devstack sudo[103807]: pam_unix(sudo:session): session closed for user root
Jun 15 15:59:49 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-48843b0a-3cf5-4e0a-ad6a-f6647b62627f tempest-GroupSnapshotsV319Test-447552809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8b24e445-9606-4f33-8933-e8bcca4b442e.info" returned: 0 in 0.609s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:59:49 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-48843b0a-3cf5-4e0a-ad6a-f6647b62627f tempest-GroupSnapshotsV319Test-447552809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.325s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:59:49 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-5f23459a-fcd7-456d-8699-d5c39cf528c1 tempest-VolumesActionsTest-1837607340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.830s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:59:49 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-5f23459a-fcd7-456d-8699-d5c39cf528c1 tempest-VolumesActionsTest-1837607340 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T13:59:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-915172725',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09ba05f3-ee75-4e30-8fc1-c2c664b0b6a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed1443b4096a41ceb58964e938e1fa7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T13:59:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T13:59:45Z,use_quota=True,user_id='3a282a052d074757a0a2984e7a52b4ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 15:59:49 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-5f23459a-fcd7-456d-8699-d5c39cf528c1 tempest-VolumesActionsTest-1837607340 None] Creating volume 09ba05f3-ee75-4e30-8fc1-c2c664b0b6a4 {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 15:59:49 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-5f23459a-fcd7-456d-8699-d5c39cf528c1 tempest-VolumesActionsTest-1837607340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:59:49 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-5f23459a-fcd7-456d-8699-d5c39cf528c1 tempest-VolumesActionsTest-1837607340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:59:49 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-5f23459a-fcd7-456d-8699-d5c39cf528c1 tempest-VolumesActionsTest-1837607340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:59:49 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-5f23459a-fcd7-456d-8699-d5c39cf528c1 tempest-VolumesActionsTest-1837607340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:59:49 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-5f23459a-fcd7-456d-8699-d5c39cf528c1 tempest-VolumesActionsTest-1837607340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:59:49 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-5f23459a-fcd7-456d-8699-d5c39cf528c1 tempest-VolumesActionsTest-1837607340 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 15:59:49 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-5f23459a-fcd7-456d-8699-d5c39cf528c1 tempest-VolumesActionsTest-1837607340 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 15:59:49 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5f23459a-fcd7-456d-8699-d5c39cf528c1 tempest-VolumesActionsTest-1837607340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-09ba05f3-ee75-4e30-8fc1-c2c664b0b6a4 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:59:49 devstack sudo[103810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-09ba05f3-ee75-4e30-8fc1-c2c664b0b6a4 1073741824
Jun 15 15:59:49 devstack sudo[103810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:59:49 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-48843b0a-3cf5-4e0a-ad6a-f6647b62627f tempest-GroupSnapshotsV319Test-447552809 None] group_snapshot 5c2e03f8-c486-4788-a06e-48e1e8c06943: created successfully
Jun 15 15:59:50 devstack sudo[103810]: pam_unix(sudo:session): session closed for user root
Jun 15 15:59:50 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5f23459a-fcd7-456d-8699-d5c39cf528c1 tempest-VolumesActionsTest-1837607340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-09ba05f3-ee75-4e30-8fc1-c2c664b0b6a4 1073741824" returned: 0 in 0.801s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:59:50 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5f23459a-fcd7-456d-8699-d5c39cf528c1 tempest-VolumesActionsTest-1837607340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-09ba05f3-ee75-4e30-8fc1-c2c664b0b6a4 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:59:50 devstack sudo[103816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-09ba05f3-ee75-4e30-8fc1-c2c664b0b6a4
Jun 15 15:59:50 devstack sudo[103816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:59:50 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-fac32998-f0c4-462f-918e-2a562677a9fa tempest-GroupSnapshotsV319Test-447552809 None] group_snapshot 5c2e03f8-c486-4788-a06e-48e1e8c06943: deleting
Jun 15 15:59:50 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-fac32998-f0c4-462f-918e-2a562677a9fa tempest-GroupSnapshotsV319Test-447552809 None] group_snapshot 5c2e03f8-c486-4788-a06e-48e1e8c06943: deleting {{(pid=91863) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jun 15 15:59:50 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-fac32998-f0c4-462f-918e-2a562677a9fa tempest-GroupSnapshotsV319Test-447552809 None] Acquiring lock "cinder-quobyte-8b24e445-9606-4f33-8933-e8bcca4b442e" by "delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:59:50 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-fac32998-f0c4-462f-918e-2a562677a9fa tempest-GroupSnapshotsV319Test-447552809 None] Lock "cinder-quobyte-8b24e445-9606-4f33-8933-e8bcca4b442e" acquired by "delete_snapshot" :: waited 0.029s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:59:50 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-fac32998-f0c4-462f-918e-2a562677a9fa tempest-GroupSnapshotsV319Test-447552809 None] Acquiring lock "cinder-quobyte-08d33595-aafe-4eb2-aa92-07c7bc2520a5" by "_delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:59:50 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-fac32998-f0c4-462f-918e-2a562677a9fa tempest-GroupSnapshotsV319Test-447552809 None] Lock "cinder-quobyte-08d33595-aafe-4eb2-aa92-07c7bc2520a5" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:59:50 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-fac32998-f0c4-462f-918e-2a562677a9fa tempest-GroupSnapshotsV319Test-447552809 None] Deleting offline snapshot 08d33595-aafe-4eb2-aa92-07c7bc2520a5 of volume 8b24e445-9606-4f33-8933-e8bcca4b442e {{(pid=91863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 15 15:59:50 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-fac32998-f0c4-462f-918e-2a562677a9fa tempest-GroupSnapshotsV319Test-447552809 None] snapshot_file for this snap is: volume-8b24e445-9606-4f33-8933-e8bcca4b442e.08d33595-aafe-4eb2-aa92-07c7bc2520a5 {{(pid=91863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 15 15:59:50 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e0fd30b-e0a1-458e-b4f3-ea6c19bf3fed]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:59:50 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-fac32998-f0c4-462f-918e-2a562677a9fa tempest-GroupSnapshotsV319Test-447552809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8b24e445-9606-4f33-8933-e8bcca4b442e.08d33595-aafe-4eb2-aa92-07c7bc2520a5 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:59:50 devstack sudo[103816]: pam_unix(sudo:session): session closed for user root
Jun 15 15:59:50 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5f23459a-fcd7-456d-8699-d5c39cf528c1 tempest-VolumesActionsTest-1837607340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-09ba05f3-ee75-4e30-8fc1-c2c664b0b6a4" returned: 0 in 0.659s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:59:50 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-5f23459a-fcd7-456d-8699-d5c39cf528c1 tempest-VolumesActionsTest-1837607340 None] <== create_volume: return (1514ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 15:59:50 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-5f23459a-fcd7-456d-8699-d5c39cf528c1 tempest-VolumesActionsTest-1837607340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.517s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:59:50 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5f23459a-fcd7-456d-8699-d5c39cf528c1 tempest-VolumesActionsTest-1837607340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4367babb-4432-42a1-91ef-966733e11b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09ba05f3-ee75-4e30-8fc1-c2c664b0b6a4', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:59:50 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5f23459a-fcd7-456d-8699-d5c39cf528c1 tempest-VolumesActionsTest-1837607340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9357555d-2826-4386-bb00-fde04bc44f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 15:59:50 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-5f23459a-fcd7-456d-8699-d5c39cf528c1 tempest-VolumesActionsTest-1837607340 None] Volume volume-09ba05f3-ee75-4e30-8fc1-c2c664b0b6a4 (09ba05f3-ee75-4e30-8fc1-c2c664b0b6a4): created successfully
Jun 15 15:59:50 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5f23459a-fcd7-456d-8699-d5c39cf528c1 tempest-VolumesActionsTest-1837607340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9357555d-2826-4386-bb00-fde04bc44f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 15:59:50 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5f23459a-fcd7-456d-8699-d5c39cf528c1 tempest-VolumesActionsTest-1837607340 None] Flow 'volume_create_manager' (b7dd763c-d01a-48b2-a0a6-17bcfe4050f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 15:59:50 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-5f23459a-fcd7-456d-8699-d5c39cf528c1 tempest-VolumesActionsTest-1837607340 None] Created volume successfully.
Jun 15 15:59:50 devstack sudo[103819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8b24e445-9606-4f33-8933-e8bcca4b442e.08d33595-aafe-4eb2-aa92-07c7bc2520a5
Jun 15 15:59:50 devstack sudo[103819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:59:51 devstack sudo[103819]: pam_unix(sudo:session): session closed for user root
Jun 15 15:59:51 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-fac32998-f0c4-462f-918e-2a562677a9fa tempest-GroupSnapshotsV319Test-447552809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8b24e445-9606-4f33-8933-e8bcca4b442e.08d33595-aafe-4eb2-aa92-07c7bc2520a5" returned: 0 in 0.723s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:59:51 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-fac32998-f0c4-462f-918e-2a562677a9fa tempest-GroupSnapshotsV319Test-447552809 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b24e445-9606-4f33-8933-e8bcca4b442e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 15:59:51 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b691632-4b74-44ed-850d-c7aa31576bb0]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:59:51 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-fac32998-f0c4-462f-918e-2a562677a9fa tempest-GroupSnapshotsV319Test-447552809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8b24e445-9606-4f33-8933-e8bcca4b442e {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:59:51 devstack sudo[103830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8b24e445-9606-4f33-8933-e8bcca4b442e
Jun 15 15:59:51 devstack sudo[103830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:59:52 devstack sudo[103830]: pam_unix(sudo:session): session closed for user root
Jun 15 15:59:52 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-fac32998-f0c4-462f-918e-2a562677a9fa tempest-GroupSnapshotsV319Test-447552809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8b24e445-9606-4f33-8933-e8bcca4b442e" returned: 0 in 0.757s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:59:52 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-fac32998-f0c4-462f-918e-2a562677a9fa tempest-GroupSnapshotsV319Test-447552809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8b24e445-9606-4f33-8933-e8bcca4b442e.08d33595-aafe-4eb2-aa92-07c7bc2520a5 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:59:52 devstack sudo[103835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8b24e445-9606-4f33-8933-e8bcca4b442e.08d33595-aafe-4eb2-aa92-07c7bc2520a5
Jun 15 15:59:52 devstack sudo[103835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:59:52 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-97faf90a-401f-451c-9d9e-1e209299da8d tempest-VolumesActionsTest-1837607340 None] Acquiring lock "cinder-09ba05f3-ee75-4e30-8fc1-c2c664b0b6a4-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:59:52 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-97faf90a-401f-451c-9d9e-1e209299da8d tempest-VolumesActionsTest-1837607340 None] Lock "cinder-09ba05f3-ee75-4e30-8fc1-c2c664b0b6a4-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:59:52 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-97faf90a-401f-451c-9d9e-1e209299da8d tempest-VolumesActionsTest-1837607340 None] Acquiring lock "cinder-quobyte-09ba05f3-ee75-4e30-8fc1-c2c664b0b6a4" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:59:52 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-97faf90a-401f-451c-9d9e-1e209299da8d tempest-VolumesActionsTest-1837607340 None] Lock "cinder-quobyte-09ba05f3-ee75-4e30-8fc1-c2c664b0b6a4" acquired by "delete_volume" :: waited 0.015s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:59:52 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8da20fa-1dcd-4b09-99a9-04498a246a3d]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:59:52 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-97faf90a-401f-451c-9d9e-1e209299da8d tempest-VolumesActionsTest-1837607340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-09ba05f3-ee75-4e30-8fc1-c2c664b0b6a4 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:59:52 devstack sudo[103837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-09ba05f3-ee75-4e30-8fc1-c2c664b0b6a4
Jun 15 15:59:52 devstack sudo[103837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:59:53 devstack sudo[103835]: pam_unix(sudo:session): session closed for user root
Jun 15 15:59:53 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-fac32998-f0c4-462f-918e-2a562677a9fa tempest-GroupSnapshotsV319Test-447552809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8b24e445-9606-4f33-8933-e8bcca4b442e.08d33595-aafe-4eb2-aa92-07c7bc2520a5" returned: 0 in 0.893s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:59:53 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-fac32998-f0c4-462f-918e-2a562677a9fa tempest-GroupSnapshotsV319Test-447552809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8b24e445-9606-4f33-8933-e8bcca4b442e.08d33595-aafe-4eb2-aa92-07c7bc2520a5 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:59:53 devstack sudo[103888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8b24e445-9606-4f33-8933-e8bcca4b442e.08d33595-aafe-4eb2-aa92-07c7bc2520a5
Jun 15 15:59:53 devstack sudo[103888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:59:53 devstack sudo[103837]: pam_unix(sudo:session): session closed for user root
Jun 15 15:59:53 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-97faf90a-401f-451c-9d9e-1e209299da8d tempest-VolumesActionsTest-1837607340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-09ba05f3-ee75-4e30-8fc1-c2c664b0b6a4" returned: 0 in 1.201s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:59:53 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-97faf90a-401f-451c-9d9e-1e209299da8d tempest-VolumesActionsTest-1837607340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-09ba05f3-ee75-4e30-8fc1-c2c664b0b6a4 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:59:53 devstack sudo[103905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-09ba05f3-ee75-4e30-8fc1-c2c664b0b6a4
Jun 15 15:59:53 devstack sudo[103905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:59:54 devstack sudo[103888]: pam_unix(sudo:session): session closed for user root
Jun 15 15:59:54 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-fac32998-f0c4-462f-918e-2a562677a9fa tempest-GroupSnapshotsV319Test-447552809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8b24e445-9606-4f33-8933-e8bcca4b442e.08d33595-aafe-4eb2-aa92-07c7bc2520a5" returned: 0 in 1.005s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:59:54 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-fac32998-f0c4-462f-918e-2a562677a9fa tempest-GroupSnapshotsV319Test-447552809 None] Lock "cinder-quobyte-08d33595-aafe-4eb2-aa92-07c7bc2520a5" released by "_delete_snapshot" :: held 3.524s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:59:54 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-fac32998-f0c4-462f-918e-2a562677a9fa tempest-GroupSnapshotsV319Test-447552809 None] Lock "cinder-quobyte-8b24e445-9606-4f33-8933-e8bcca4b442e" released by "delete_snapshot" :: held 3.562s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:59:54 devstack cinder-volume[91863]: WARNING cinder.quota [None req-fac32998-f0c4-462f-918e-2a562677a9fa tempest-GroupSnapshotsV319Test-447552809 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1247934551 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1247934551, it is now deprecated. Please use the default quota class for default quota.
Jun 15 15:59:54 devstack cinder-volume[91863]: WARNING cinder.quota [None req-fac32998-f0c4-462f-918e-2a562677a9fa tempest-GroupSnapshotsV319Test-447552809 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1247934551 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1247934551, it is now deprecated. Please use the default quota class for default quota.
Jun 15 15:59:54 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-fac32998-f0c4-462f-918e-2a562677a9fa tempest-GroupSnapshotsV319Test-447552809 None] Created reservations ['8b25a872-a1f7-4b69-8c01-757ceb945740', 'eb4176e8-a6e2-43e8-a5bb-0e4ae23b8943', '3d07c9a8-f7d3-4224-89e3-29adafd9bdef', 'bfd07e45-2740-4793-9a19-72cce6ac5c52'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:59:54 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-fac32998-f0c4-462f-918e-2a562677a9fa tempest-GroupSnapshotsV319Test-447552809 None] group_snapshot 5c2e03f8-c486-4788-a06e-48e1e8c06943: deleted successfully
Jun 15 15:59:54 devstack sudo[103905]: pam_unix(sudo:session): session closed for user root
Jun 15 15:59:54 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-97faf90a-401f-451c-9d9e-1e209299da8d tempest-VolumesActionsTest-1837607340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-09ba05f3-ee75-4e30-8fc1-c2c664b0b6a4" returned: 0 in 0.781s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:59:54 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-97faf90a-401f-451c-9d9e-1e209299da8d tempest-VolumesActionsTest-1837607340 None] Lock "cinder-quobyte-09ba05f3-ee75-4e30-8fc1-c2c664b0b6a4" released by "delete_volume" :: held 2.022s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:59:54 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-97faf90a-401f-451c-9d9e-1e209299da8d tempest-VolumesActionsTest-1837607340 None] Created reservations ['598221c2-d50b-417c-a910-edb5dc2f3077', 'f1be6b63-47f0-44e0-9564-f9c55b1ac316', '3fa303b7-48bd-45e9-b0ec-911fb2b8ed7f', '05d7fa3e-5cbf-44bf-9f7e-0c296feca888'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:59:54 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-97faf90a-401f-451c-9d9e-1e209299da8d tempest-VolumesActionsTest-1837607340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:59:54 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-97faf90a-401f-451c-9d9e-1e209299da8d tempest-VolumesActionsTest-1837607340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:59:54 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-97faf90a-401f-451c-9d9e-1e209299da8d tempest-VolumesActionsTest-1837607340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:59:54 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-97faf90a-401f-451c-9d9e-1e209299da8d tempest-VolumesActionsTest-1837607340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:59:54 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-97faf90a-401f-451c-9d9e-1e209299da8d tempest-VolumesActionsTest-1837607340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:59:54 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-97faf90a-401f-451c-9d9e-1e209299da8d tempest-VolumesActionsTest-1837607340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:59:54 devstack sudo[103916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:59:54 devstack sudo[103916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:59:55 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-0c3d0c8e-0319-4677-a53c-e04859b95252 tempest-GroupSnapshotsV319Test-447552809 None] Acquiring lock "cinder-quobyte-8b24e445-9606-4f33-8933-e8bcca4b442e" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 15:59:55 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-0c3d0c8e-0319-4677-a53c-e04859b95252 tempest-GroupSnapshotsV319Test-447552809 None] Lock "cinder-quobyte-8b24e445-9606-4f33-8933-e8bcca4b442e" acquired by "delete_volume" :: waited 0.039s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 15:59:55 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b114c1d7-45be-4c3e-87e5-785dd1363bdd]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 15:59:55 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-0c3d0c8e-0319-4677-a53c-e04859b95252 tempest-GroupSnapshotsV319Test-447552809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8b24e445-9606-4f33-8933-e8bcca4b442e {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:59:55 devstack sudo[103916]: pam_unix(sudo:session): session closed for user root
Jun 15 15:59:55 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-97faf90a-401f-451c-9d9e-1e209299da8d tempest-VolumesActionsTest-1837607340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.803s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:59:55 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-97faf90a-401f-451c-9d9e-1e209299da8d tempest-VolumesActionsTest-1837607340 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:59:55 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-97faf90a-401f-451c-9d9e-1e209299da8d tempest-VolumesActionsTest-1837607340 None] Deleted volume successfully.
Jun 15 15:59:55 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-97faf90a-401f-451c-9d9e-1e209299da8d tempest-VolumesActionsTest-1837607340 None] Lock "cinder-09ba05f3-ee75-4e30-8fc1-c2c664b0b6a4-delete_volume" released by "delete_volume" :: held 3.065s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:59:55 devstack sudo[103919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8b24e445-9606-4f33-8933-e8bcca4b442e
Jun 15 15:59:55 devstack sudo[103919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:59:56 devstack sudo[103919]: pam_unix(sudo:session): session closed for user root
Jun 15 15:59:56 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-0c3d0c8e-0319-4677-a53c-e04859b95252 tempest-GroupSnapshotsV319Test-447552809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8b24e445-9606-4f33-8933-e8bcca4b442e" returned: 0 in 0.858s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:59:56 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-0c3d0c8e-0319-4677-a53c-e04859b95252 tempest-GroupSnapshotsV319Test-447552809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8b24e445-9606-4f33-8933-e8bcca4b442e {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:59:56 devstack sudo[103924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8b24e445-9606-4f33-8933-e8bcca4b442e
Jun 15 15:59:56 devstack sudo[103924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:59:56 devstack sudo[103924]: pam_unix(sudo:session): session closed for user root
Jun 15 15:59:56 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-0c3d0c8e-0319-4677-a53c-e04859b95252 tempest-GroupSnapshotsV319Test-447552809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-8b24e445-9606-4f33-8933-e8bcca4b442e" returned: 0 in 0.832s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:59:56 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-0c3d0c8e-0319-4677-a53c-e04859b95252 tempest-GroupSnapshotsV319Test-447552809 None] Lock "cinder-quobyte-8b24e445-9606-4f33-8933-e8bcca4b442e" released by "delete_volume" :: held 1.823s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 15:59:57 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-0c3d0c8e-0319-4677-a53c-e04859b95252 tempest-GroupSnapshotsV319Test-447552809 None] Created reservations ['f11cf851-2165-4ac9-9372-50a9f91dba4e'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:59:57 devstack cinder-volume[91863]: WARNING cinder.quota [None req-0c3d0c8e-0319-4677-a53c-e04859b95252 tempest-GroupSnapshotsV319Test-447552809 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1247934551 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1247934551, it is now deprecated. Please use the default quota class for default quota.
Jun 15 15:59:57 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-0c3d0c8e-0319-4677-a53c-e04859b95252 tempest-GroupSnapshotsV319Test-447552809 None] Created reservations ['6f75087f-425d-4068-a047-6fbd42170380', 'a15d3bee-cdcc-4a04-a53c-42eef283d2ab', '335604e4-db36-43a5-bcd3-93a65c47049e', 'b8f3509f-86bb-4310-802e-270bea9728df'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 15:59:57 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-0c3d0c8e-0319-4677-a53c-e04859b95252 tempest-GroupSnapshotsV319Test-447552809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 15:59:57 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-0c3d0c8e-0319-4677-a53c-e04859b95252 tempest-GroupSnapshotsV319Test-447552809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 15:59:57 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-0c3d0c8e-0319-4677-a53c-e04859b95252 tempest-GroupSnapshotsV319Test-447552809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 15:59:57 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-0c3d0c8e-0319-4677-a53c-e04859b95252 tempest-GroupSnapshotsV319Test-447552809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 15:59:57 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-0c3d0c8e-0319-4677-a53c-e04859b95252 tempest-GroupSnapshotsV319Test-447552809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 15:59:57 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-0c3d0c8e-0319-4677-a53c-e04859b95252 tempest-GroupSnapshotsV319Test-447552809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 15:59:57 devstack sudo[103927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 15:59:57 devstack sudo[103927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 15:59:58 devstack sudo[103927]: pam_unix(sudo:session): session closed for user root
Jun 15 15:59:58 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-0c3d0c8e-0319-4677-a53c-e04859b95252 tempest-GroupSnapshotsV319Test-447552809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 1.207s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 15:59:58 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-0c3d0c8e-0319-4677-a53c-e04859b95252 tempest-GroupSnapshotsV319Test-447552809 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 15:59:58 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-0c3d0c8e-0319-4677-a53c-e04859b95252 tempest-GroupSnapshotsV319Test-447552809 None] Delete group completed successfully.
Jun 15 16:00:07 devstack cinder-volume[91863]: DEBUG dbcounter [-] [91863] Writing DB stats cinder:INSERT=40,cinder:UPDATE=143,cinder:SELECT=104,cinder:DELETE=11 {{(pid=91863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 16:00:07 devstack cinder-volume[91863]: DEBUG dbcounter [-] [91863] Writing DB stats cinder:SELECT=39,cinder:UPDATE=40,cinder:DELETE=3,cinder:INSERT=9 {{(pid=91863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 16:00:08 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-50423731-6bb5-4fca-91da-fa9c1bc1d5cc tempest-SnapshotMetadataTestJSON-1107938519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 16:00:08 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-50423731-6bb5-4fca-91da-fa9c1bc1d5cc tempest-SnapshotMetadataTestJSON-1107938519 None] Flow 'volume_create_manager' (c6c11df5-fea5-4448-8519-f7bba35e2f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:00:08 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-50423731-6bb5-4fca-91da-fa9c1bc1d5cc tempest-SnapshotMetadataTestJSON-1107938519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6623232-6133-41b9-b04d-9025e09f507f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:00:08 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-50423731-6bb5-4fca-91da-fa9c1bc1d5cc tempest-SnapshotMetadataTestJSON-1107938519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6623232-6133-41b9-b04d-9025e09f507f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:00:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1370603929',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d817a0d-a968-45b2-a173-5e8e3e6074d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11dac6ec9f4d48b1b1777cc28408b95b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:00:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:00:09Z,use_quota=True,user_id='0411d7a001a948eb88d89aa67fc065d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:00:08 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-50423731-6bb5-4fca-91da-fa9c1bc1d5cc tempest-SnapshotMetadataTestJSON-1107938519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0d091b9-47fe-4f34-8bd4-2e0e19d13388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:00:08 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-50423731-6bb5-4fca-91da-fa9c1bc1d5cc tempest-SnapshotMetadataTestJSON-1107938519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0d091b9-47fe-4f34-8bd4-2e0e19d13388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:00:08 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-50423731-6bb5-4fca-91da-fa9c1bc1d5cc tempest-SnapshotMetadataTestJSON-1107938519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f3afbd0-b0ce-43a0-9e1b-1dcace6fbd42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:00:08 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-50423731-6bb5-4fca-91da-fa9c1bc1d5cc tempest-SnapshotMetadataTestJSON-1107938519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f3afbd0-b0ce-43a0-9e1b-1dcace6fbd42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d817a0d-a968-45b2-a173-5e8e3e6074d2', 'volume_name': 'volume-4d817a0d-a968-45b2-a173-5e8e3e6074d2', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:00:08 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-50423731-6bb5-4fca-91da-fa9c1bc1d5cc tempest-SnapshotMetadataTestJSON-1107938519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52f3ddb7-56f0-4ffa-b9d6-f408897cdf2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:00:08 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-50423731-6bb5-4fca-91da-fa9c1bc1d5cc tempest-SnapshotMetadataTestJSON-1107938519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52f3ddb7-56f0-4ffa-b9d6-f408897cdf2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:00:08 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-50423731-6bb5-4fca-91da-fa9c1bc1d5cc tempest-SnapshotMetadataTestJSON-1107938519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85a35236-d73f-4249-a594-3ef1aff682fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:00:08 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-50423731-6bb5-4fca-91da-fa9c1bc1d5cc tempest-SnapshotMetadataTestJSON-1107938519 None] Volume 4d817a0d-a968-45b2-a173-5e8e3e6074d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d817a0d-a968-45b2-a173-5e8e3e6074d2', 'volume_size': 1}
Jun 15 16:00:08 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-50423731-6bb5-4fca-91da-fa9c1bc1d5cc tempest-SnapshotMetadataTestJSON-1107938519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:00:08 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-50423731-6bb5-4fca-91da-fa9c1bc1d5cc tempest-SnapshotMetadataTestJSON-1107938519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:00:08 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-50423731-6bb5-4fca-91da-fa9c1bc1d5cc tempest-SnapshotMetadataTestJSON-1107938519 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:00:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1370603929',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d817a0d-a968-45b2-a173-5e8e3e6074d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11dac6ec9f4d48b1b1777cc28408b95b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:00:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:00:09Z,use_quota=True,user_id='0411d7a001a948eb88d89aa67fc065d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 16:00:08 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-50423731-6bb5-4fca-91da-fa9c1bc1d5cc tempest-SnapshotMetadataTestJSON-1107938519 None] Creating volume 4d817a0d-a968-45b2-a173-5e8e3e6074d2 {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 16:00:08 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-50423731-6bb5-4fca-91da-fa9c1bc1d5cc tempest-SnapshotMetadataTestJSON-1107938519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:00:08 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-50423731-6bb5-4fca-91da-fa9c1bc1d5cc tempest-SnapshotMetadataTestJSON-1107938519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:00:08 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-50423731-6bb5-4fca-91da-fa9c1bc1d5cc tempest-SnapshotMetadataTestJSON-1107938519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:00:08 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-50423731-6bb5-4fca-91da-fa9c1bc1d5cc tempest-SnapshotMetadataTestJSON-1107938519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:00:08 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-50423731-6bb5-4fca-91da-fa9c1bc1d5cc tempest-SnapshotMetadataTestJSON-1107938519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:00:08 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-50423731-6bb5-4fca-91da-fa9c1bc1d5cc tempest-SnapshotMetadataTestJSON-1107938519 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 16:00:08 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-50423731-6bb5-4fca-91da-fa9c1bc1d5cc tempest-SnapshotMetadataTestJSON-1107938519 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 16:00:08 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-50423731-6bb5-4fca-91da-fa9c1bc1d5cc tempest-SnapshotMetadataTestJSON-1107938519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4d817a0d-a968-45b2-a173-5e8e3e6074d2 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:00:08 devstack sudo[103969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4d817a0d-a968-45b2-a173-5e8e3e6074d2 1073741824
Jun 15 16:00:08 devstack sudo[103969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:00:09 devstack sudo[103969]: pam_unix(sudo:session): session closed for user root
Jun 15 16:00:09 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-50423731-6bb5-4fca-91da-fa9c1bc1d5cc tempest-SnapshotMetadataTestJSON-1107938519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4d817a0d-a968-45b2-a173-5e8e3e6074d2 1073741824" returned: 0 in 0.797s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:00:09 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-50423731-6bb5-4fca-91da-fa9c1bc1d5cc tempest-SnapshotMetadataTestJSON-1107938519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4d817a0d-a968-45b2-a173-5e8e3e6074d2 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:00:09 devstack sudo[103975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4d817a0d-a968-45b2-a173-5e8e3e6074d2
Jun 15 16:00:09 devstack sudo[103975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:00:10 devstack sudo[103975]: pam_unix(sudo:session): session closed for user root
Jun 15 16:00:10 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-50423731-6bb5-4fca-91da-fa9c1bc1d5cc tempest-SnapshotMetadataTestJSON-1107938519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4d817a0d-a968-45b2-a173-5e8e3e6074d2" returned: 0 in 0.604s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:00:10 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-50423731-6bb5-4fca-91da-fa9c1bc1d5cc tempest-SnapshotMetadataTestJSON-1107938519 None] <== create_volume: return (1452ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 16:00:10 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-50423731-6bb5-4fca-91da-fa9c1bc1d5cc tempest-SnapshotMetadataTestJSON-1107938519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.455s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:00:10 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-50423731-6bb5-4fca-91da-fa9c1bc1d5cc tempest-SnapshotMetadataTestJSON-1107938519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85a35236-d73f-4249-a594-3ef1aff682fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d817a0d-a968-45b2-a173-5e8e3e6074d2', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:00:10 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-50423731-6bb5-4fca-91da-fa9c1bc1d5cc tempest-SnapshotMetadataTestJSON-1107938519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12bbc9b8-5675-4ea3-a2fb-9b092549453a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:00:10 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-50423731-6bb5-4fca-91da-fa9c1bc1d5cc tempest-SnapshotMetadataTestJSON-1107938519 None] Volume volume-4d817a0d-a968-45b2-a173-5e8e3e6074d2 (4d817a0d-a968-45b2-a173-5e8e3e6074d2): created successfully
Jun 15 16:00:10 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-50423731-6bb5-4fca-91da-fa9c1bc1d5cc tempest-SnapshotMetadataTestJSON-1107938519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12bbc9b8-5675-4ea3-a2fb-9b092549453a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:00:10 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-50423731-6bb5-4fca-91da-fa9c1bc1d5cc tempest-SnapshotMetadataTestJSON-1107938519 None] Flow 'volume_create_manager' (c6c11df5-fea5-4448-8519-f7bba35e2f1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:00:10 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-50423731-6bb5-4fca-91da-fa9c1bc1d5cc tempest-SnapshotMetadataTestJSON-1107938519 None] Created volume successfully.
Jun 15 16:00:10 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-94ae10e8-05da-40fd-94e6-87eec80b7f12 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 16:00:10 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-94ae10e8-05da-40fd-94e6-87eec80b7f12 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] Flow 'volume_create_manager' (4153f5a9-b88a-4fbf-afa0-5a185906c70b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:00:10 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-94ae10e8-05da-40fd-94e6-87eec80b7f12 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d61bc31f-1313-4829-b4d0-592e730951f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:00:10 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-94ae10e8-05da-40fd-94e6-87eec80b7f12 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d61bc31f-1313-4829-b4d0-592e730951f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:00:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-628275015',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05a73b34-99b1-4d70-8cbe-c6e49ab18d52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c0acafb8cde4423addb9559a68af5aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:00:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:00:11Z,use_quota=True,user_id='172c0bd83a3944dab9d6d65909005a03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:00:10 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-94ae10e8-05da-40fd-94e6-87eec80b7f12 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d2b6913-7b36-42f9-bbe7-3fb7642c7e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:00:11 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-94ae10e8-05da-40fd-94e6-87eec80b7f12 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d2b6913-7b36-42f9-bbe7-3fb7642c7e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:00:11 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-94ae10e8-05da-40fd-94e6-87eec80b7f12 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c41fb2c7-cb8e-474e-8de7-f402350186da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:00:11 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-94ae10e8-05da-40fd-94e6-87eec80b7f12 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c41fb2c7-cb8e-474e-8de7-f402350186da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05a73b34-99b1-4d70-8cbe-c6e49ab18d52', 'volume_name': 'volume-05a73b34-99b1-4d70-8cbe-c6e49ab18d52', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:00:11 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-94ae10e8-05da-40fd-94e6-87eec80b7f12 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e10e015-77c7-42b9-8a59-621055112b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:00:11 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-94ae10e8-05da-40fd-94e6-87eec80b7f12 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e10e015-77c7-42b9-8a59-621055112b4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:00:11 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-94ae10e8-05da-40fd-94e6-87eec80b7f12 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c8e298d-d46d-426e-bec4-4f9149f434e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:00:11 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-94ae10e8-05da-40fd-94e6-87eec80b7f12 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] Volume 05a73b34-99b1-4d70-8cbe-c6e49ab18d52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05a73b34-99b1-4d70-8cbe-c6e49ab18d52', 'volume_size': 1}
Jun 15 16:00:11 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-94ae10e8-05da-40fd-94e6-87eec80b7f12 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:00:11 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-94ae10e8-05da-40fd-94e6-87eec80b7f12 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:00:11 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-94ae10e8-05da-40fd-94e6-87eec80b7f12 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:00:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-628275015',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05a73b34-99b1-4d70-8cbe-c6e49ab18d52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c0acafb8cde4423addb9559a68af5aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:00:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:00:11Z,use_quota=True,user_id='172c0bd83a3944dab9d6d65909005a03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 16:00:11 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-94ae10e8-05da-40fd-94e6-87eec80b7f12 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] Creating volume 05a73b34-99b1-4d70-8cbe-c6e49ab18d52 {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 16:00:11 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-94ae10e8-05da-40fd-94e6-87eec80b7f12 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:00:11 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-94ae10e8-05da-40fd-94e6-87eec80b7f12 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:00:11 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-94ae10e8-05da-40fd-94e6-87eec80b7f12 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:00:11 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-94ae10e8-05da-40fd-94e6-87eec80b7f12 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:00:11 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-94ae10e8-05da-40fd-94e6-87eec80b7f12 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:00:11 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-94ae10e8-05da-40fd-94e6-87eec80b7f12 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 16:00:11 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-94ae10e8-05da-40fd-94e6-87eec80b7f12 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 16:00:11 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-94ae10e8-05da-40fd-94e6-87eec80b7f12 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-05a73b34-99b1-4d70-8cbe-c6e49ab18d52 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:00:11 devstack sudo[103978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-05a73b34-99b1-4d70-8cbe-c6e49ab18d52 1073741824
Jun 15 16:00:11 devstack sudo[103978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:00:11 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-58292e4f-e192-444d-8ccb-2210811039dd tempest-SnapshotMetadataTestJSON-1107938519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:00:11 devstack sudo[103978]: pam_unix(sudo:session): session closed for user root
Jun 15 16:00:11 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-94ae10e8-05da-40fd-94e6-87eec80b7f12 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-05a73b34-99b1-4d70-8cbe-c6e49ab18d52 1073741824" returned: 0 in 0.800s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:00:11 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-94ae10e8-05da-40fd-94e6-87eec80b7f12 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-05a73b34-99b1-4d70-8cbe-c6e49ab18d52 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:00:11 devstack sudo[103983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-05a73b34-99b1-4d70-8cbe-c6e49ab18d52
Jun 15 16:00:11 devstack sudo[103983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:00:12 devstack sudo[103983]: pam_unix(sudo:session): session closed for user root
Jun 15 16:00:12 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-94ae10e8-05da-40fd-94e6-87eec80b7f12 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-05a73b34-99b1-4d70-8cbe-c6e49ab18d52" returned: 0 in 0.569s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:00:12 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-94ae10e8-05da-40fd-94e6-87eec80b7f12 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] <== create_volume: return (1408ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 16:00:12 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-94ae10e8-05da-40fd-94e6-87eec80b7f12 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.411s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:00:12 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-58292e4f-e192-444d-8ccb-2210811039dd tempest-SnapshotMetadataTestJSON-1107938519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.281s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:00:12 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-94ae10e8-05da-40fd-94e6-87eec80b7f12 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c8e298d-d46d-426e-bec4-4f9149f434e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05a73b34-99b1-4d70-8cbe-c6e49ab18d52', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:00:12 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-94ae10e8-05da-40fd-94e6-87eec80b7f12 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e572e40-b031-4e46-b49e-04f01fbf3402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:00:12 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-58292e4f-e192-444d-8ccb-2210811039dd tempest-SnapshotMetadataTestJSON-1107938519 None] Creating offline snapshot 266103be-ba5e-4858-ad52-cda59712aab5 of volume 4d817a0d-a968-45b2-a173-5e8e3e6074d2 {{(pid=91863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 15 16:00:12 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-94ae10e8-05da-40fd-94e6-87eec80b7f12 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] Volume volume-05a73b34-99b1-4d70-8cbe-c6e49ab18d52 (05a73b34-99b1-4d70-8cbe-c6e49ab18d52): created successfully
Jun 15 16:00:12 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-94ae10e8-05da-40fd-94e6-87eec80b7f12 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e572e40-b031-4e46-b49e-04f01fbf3402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:00:12 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-94ae10e8-05da-40fd-94e6-87eec80b7f12 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] Flow 'volume_create_manager' (4153f5a9-b88a-4fbf-afa0-5a185906c70b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:00:12 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[152d82bc-f09c-4642-a853-08702106872d]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:00:12 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-58292e4f-e192-444d-8ccb-2210811039dd tempest-SnapshotMetadataTestJSON-1107938519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4d817a0d-a968-45b2-a173-5e8e3e6074d2 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:00:12 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-94ae10e8-05da-40fd-94e6-87eec80b7f12 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] Created volume successfully.
Jun 15 16:00:12 devstack sudo[103986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4d817a0d-a968-45b2-a173-5e8e3e6074d2
Jun 15 16:00:12 devstack sudo[103986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:00:13 devstack sudo[103986]: pam_unix(sudo:session): session closed for user root
Jun 15 16:00:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-58292e4f-e192-444d-8ccb-2210811039dd tempest-SnapshotMetadataTestJSON-1107938519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4d817a0d-a968-45b2-a173-5e8e3e6074d2" returned: 0 in 0.802s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:00:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-58292e4f-e192-444d-8ccb-2210811039dd tempest-SnapshotMetadataTestJSON-1107938519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4d817a0d-a968-45b2-a173-5e8e3e6074d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4d817a0d-a968-45b2-a173-5e8e3e6074d2.266103be-ba5e-4858-ad52-cda59712aab5 1G {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:00:13 devstack sudo[103991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4d817a0d-a968-45b2-a173-5e8e3e6074d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4d817a0d-a968-45b2-a173-5e8e3e6074d2.266103be-ba5e-4858-ad52-cda59712aab5 1G
Jun 15 16:00:13 devstack sudo[103991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:00:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-c6ca2524-8896-4fef-98fb-54a6c229a7c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:00:14 devstack sudo[103991]: pam_unix(sudo:session): session closed for user root
Jun 15 16:00:14 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-58292e4f-e192-444d-8ccb-2210811039dd tempest-SnapshotMetadataTestJSON-1107938519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4d817a0d-a968-45b2-a173-5e8e3e6074d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4d817a0d-a968-45b2-a173-5e8e3e6074d2.266103be-ba5e-4858-ad52-cda59712aab5 1G" returned: 0 in 0.828s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:00:14 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-58292e4f-e192-444d-8ccb-2210811039dd tempest-SnapshotMetadataTestJSON-1107938519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d817a0d-a968-45b2-a173-5e8e3e6074d2 -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4d817a0d-a968-45b2-a173-5e8e3e6074d2.266103be-ba5e-4858-ad52-cda59712aab5 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:00:14 devstack sudo[103997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d817a0d-a968-45b2-a173-5e8e3e6074d2 -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4d817a0d-a968-45b2-a173-5e8e3e6074d2.266103be-ba5e-4858-ad52-cda59712aab5
Jun 15 16:00:14 devstack sudo[103997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:00:14 devstack sudo[103997]: pam_unix(sudo:session): session closed for user root
Jun 15 16:00:14 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-58292e4f-e192-444d-8ccb-2210811039dd tempest-SnapshotMetadataTestJSON-1107938519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d817a0d-a968-45b2-a173-5e8e3e6074d2 -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4d817a0d-a968-45b2-a173-5e8e3e6074d2.266103be-ba5e-4858-ad52-cda59712aab5" returned: 0 in 0.633s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:00:14 devstack cinder-volume[91863]: WARNING cinder.volume.drivers.remotefs [None req-58292e4f-e192-444d-8ccb-2210811039dd tempest-SnapshotMetadataTestJSON-1107938519 None] /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4d817a0d-a968-45b2-a173-5e8e3e6074d2.266103be-ba5e-4858-ad52-cda59712aab5 is being set with open permissions: ugo+rw
Jun 15 16:00:14 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-58292e4f-e192-444d-8ccb-2210811039dd tempest-SnapshotMetadataTestJSON-1107938519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4d817a0d-a968-45b2-a173-5e8e3e6074d2.266103be-ba5e-4858-ad52-cda59712aab5 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:00:14 devstack sudo[104003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4d817a0d-a968-45b2-a173-5e8e3e6074d2.266103be-ba5e-4858-ad52-cda59712aab5
Jun 15 16:00:14 devstack sudo[104003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:00:15 devstack sudo[104003]: pam_unix(sudo:session): session closed for user root
Jun 15 16:00:15 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-58292e4f-e192-444d-8ccb-2210811039dd tempest-SnapshotMetadataTestJSON-1107938519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4d817a0d-a968-45b2-a173-5e8e3e6074d2.266103be-ba5e-4858-ad52-cda59712aab5" returned: 0 in 0.627s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:00:15 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-58292e4f-e192-444d-8ccb-2210811039dd tempest-SnapshotMetadataTestJSON-1107938519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4d817a0d-a968-45b2-a173-5e8e3e6074d2.info {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:00:15 devstack sudo[104006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4d817a0d-a968-45b2-a173-5e8e3e6074d2.info
Jun 15 16:00:15 devstack sudo[104006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:00:15 devstack sudo[104006]: pam_unix(sudo:session): session closed for user root
Jun 15 16:00:15 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-58292e4f-e192-444d-8ccb-2210811039dd tempest-SnapshotMetadataTestJSON-1107938519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4d817a0d-a968-45b2-a173-5e8e3e6074d2.info" returned: 0 in 0.569s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:00:15 devstack cinder-volume[91863]: WARNING cinder.volume.drivers.remotefs [None req-58292e4f-e192-444d-8ccb-2210811039dd tempest-SnapshotMetadataTestJSON-1107938519 None] /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4d817a0d-a968-45b2-a173-5e8e3e6074d2.info is being set with open permissions: ugo+rw
Jun 15 16:00:16 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-58292e4f-e192-444d-8ccb-2210811039dd tempest-SnapshotMetadataTestJSON-1107938519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4d817a0d-a968-45b2-a173-5e8e3e6074d2.info {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:00:16 devstack sudo[104009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4d817a0d-a968-45b2-a173-5e8e3e6074d2.info
Jun 15 16:00:16 devstack sudo[104009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:00:16 devstack sudo[104009]: pam_unix(sudo:session): session closed for user root
Jun 15 16:00:16 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-58292e4f-e192-444d-8ccb-2210811039dd tempest-SnapshotMetadataTestJSON-1107938519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4d817a0d-a968-45b2-a173-5e8e3e6074d2.info" returned: 0 in 0.695s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:00:16 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-58292e4f-e192-444d-8ccb-2210811039dd tempest-SnapshotMetadataTestJSON-1107938519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.262s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:00:16 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-c6ca2524-8896-4fef-98fb-54a6c229a7c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.371s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:00:16 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-c6ca2524-8896-4fef-98fb-54a6c229a7c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] Creating offline snapshot ff179a4b-e86b-4893-95d9-3292bfd1b833 of volume 05a73b34-99b1-4d70-8cbe-c6e49ab18d52 {{(pid=91863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 15 16:00:16 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-58292e4f-e192-444d-8ccb-2210811039dd tempest-SnapshotMetadataTestJSON-1107938519 None] Create snapshot completed successfully
Jun 15 16:00:16 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[fffafbc0-2316-4c00-ab50-8f2a524437dd]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:00:16 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c6ca2524-8896-4fef-98fb-54a6c229a7c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-05a73b34-99b1-4d70-8cbe-c6e49ab18d52 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:00:16 devstack sudo[104012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-05a73b34-99b1-4d70-8cbe-c6e49ab18d52
Jun 15 16:00:16 devstack sudo[104012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:00:17 devstack sudo[104012]: pam_unix(sudo:session): session closed for user root
Jun 15 16:00:17 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c6ca2524-8896-4fef-98fb-54a6c229a7c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-05a73b34-99b1-4d70-8cbe-c6e49ab18d52" returned: 0 in 0.698s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:00:17 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c6ca2524-8896-4fef-98fb-54a6c229a7c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-05a73b34-99b1-4d70-8cbe-c6e49ab18d52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-05a73b34-99b1-4d70-8cbe-c6e49ab18d52.ff179a4b-e86b-4893-95d9-3292bfd1b833 1G {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:00:17 devstack sudo[104017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-05a73b34-99b1-4d70-8cbe-c6e49ab18d52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-05a73b34-99b1-4d70-8cbe-c6e49ab18d52.ff179a4b-e86b-4893-95d9-3292bfd1b833 1G
Jun 15 16:00:17 devstack sudo[104017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:00:18 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-fd53a3a8-dde1-4a20-87b9-e888c9811912 tempest-SnapshotMetadataTestJSON-1107938519 None] Acquiring lock "cinder-266103be-ba5e-4858-ad52-cda59712aab5-delete_snapshot" by "delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:00:18 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-fd53a3a8-dde1-4a20-87b9-e888c9811912 tempest-SnapshotMetadataTestJSON-1107938519 None] Lock "cinder-266103be-ba5e-4858-ad52-cda59712aab5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:00:18 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-fd53a3a8-dde1-4a20-87b9-e888c9811912 tempest-SnapshotMetadataTestJSON-1107938519 None] Acquiring lock "cinder-quobyte-4d817a0d-a968-45b2-a173-5e8e3e6074d2" by "delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:00:18 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-fd53a3a8-dde1-4a20-87b9-e888c9811912 tempest-SnapshotMetadataTestJSON-1107938519 None] Lock "cinder-quobyte-4d817a0d-a968-45b2-a173-5e8e3e6074d2" acquired by "delete_snapshot" :: waited 0.016s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:00:18 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-fd53a3a8-dde1-4a20-87b9-e888c9811912 tempest-SnapshotMetadataTestJSON-1107938519 None] Acquiring lock "cinder-quobyte-266103be-ba5e-4858-ad52-cda59712aab5" by "_delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:00:18 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-fd53a3a8-dde1-4a20-87b9-e888c9811912 tempest-SnapshotMetadataTestJSON-1107938519 None] Lock "cinder-quobyte-266103be-ba5e-4858-ad52-cda59712aab5" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:00:18 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-fd53a3a8-dde1-4a20-87b9-e888c9811912 tempest-SnapshotMetadataTestJSON-1107938519 None] Deleting offline snapshot 266103be-ba5e-4858-ad52-cda59712aab5 of volume 4d817a0d-a968-45b2-a173-5e8e3e6074d2 {{(pid=91863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 15 16:00:18 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-fd53a3a8-dde1-4a20-87b9-e888c9811912 tempest-SnapshotMetadataTestJSON-1107938519 None] snapshot_file for this snap is: volume-4d817a0d-a968-45b2-a173-5e8e3e6074d2.266103be-ba5e-4858-ad52-cda59712aab5 {{(pid=91863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 15 16:00:18 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd22f7e6-04d7-4565-a231-3ea4f8d13fe0]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:00:18 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-fd53a3a8-dde1-4a20-87b9-e888c9811912 tempest-SnapshotMetadataTestJSON-1107938519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4d817a0d-a968-45b2-a173-5e8e3e6074d2.266103be-ba5e-4858-ad52-cda59712aab5 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:00:18 devstack sudo[104024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4d817a0d-a968-45b2-a173-5e8e3e6074d2.266103be-ba5e-4858-ad52-cda59712aab5
Jun 15 16:00:18 devstack sudo[104024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:00:18 devstack sudo[104017]: pam_unix(sudo:session): session closed for user root
Jun 15 16:00:18 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c6ca2524-8896-4fef-98fb-54a6c229a7c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-05a73b34-99b1-4d70-8cbe-c6e49ab18d52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-05a73b34-99b1-4d70-8cbe-c6e49ab18d52.ff179a4b-e86b-4893-95d9-3292bfd1b833 1G" returned: 0 in 0.842s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:00:18 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c6ca2524-8896-4fef-98fb-54a6c229a7c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05a73b34-99b1-4d70-8cbe-c6e49ab18d52 -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-05a73b34-99b1-4d70-8cbe-c6e49ab18d52.ff179a4b-e86b-4893-95d9-3292bfd1b833 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:00:18 devstack sudo[104027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05a73b34-99b1-4d70-8cbe-c6e49ab18d52 -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-05a73b34-99b1-4d70-8cbe-c6e49ab18d52.ff179a4b-e86b-4893-95d9-3292bfd1b833
Jun 15 16:00:18 devstack sudo[104027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:00:18 devstack sudo[104024]: pam_unix(sudo:session): session closed for user root
Jun 15 16:00:18 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-fd53a3a8-dde1-4a20-87b9-e888c9811912 tempest-SnapshotMetadataTestJSON-1107938519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4d817a0d-a968-45b2-a173-5e8e3e6074d2.266103be-ba5e-4858-ad52-cda59712aab5" returned: 0 in 0.790s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:00:18 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-fd53a3a8-dde1-4a20-87b9-e888c9811912 tempest-SnapshotMetadataTestJSON-1107938519 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d817a0d-a968-45b2-a173-5e8e3e6074d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 16:00:18 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4beda250-42a3-409d-9796-85c6e29735d1]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:00:18 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-fd53a3a8-dde1-4a20-87b9-e888c9811912 tempest-SnapshotMetadataTestJSON-1107938519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4d817a0d-a968-45b2-a173-5e8e3e6074d2 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:00:18 devstack sudo[104027]: pam_unix(sudo:session): session closed for user root
Jun 15 16:00:18 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c6ca2524-8896-4fef-98fb-54a6c229a7c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05a73b34-99b1-4d70-8cbe-c6e49ab18d52 -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-05a73b34-99b1-4d70-8cbe-c6e49ab18d52.ff179a4b-e86b-4893-95d9-3292bfd1b833" returned: 0 in 0.688s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:00:18 devstack cinder-volume[91863]: WARNING cinder.volume.drivers.remotefs [None req-c6ca2524-8896-4fef-98fb-54a6c229a7c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-05a73b34-99b1-4d70-8cbe-c6e49ab18d52.ff179a4b-e86b-4893-95d9-3292bfd1b833 is being set with open permissions: ugo+rw
Jun 15 16:00:18 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c6ca2524-8896-4fef-98fb-54a6c229a7c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-05a73b34-99b1-4d70-8cbe-c6e49ab18d52.ff179a4b-e86b-4893-95d9-3292bfd1b833 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:00:19 devstack sudo[104036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-05a73b34-99b1-4d70-8cbe-c6e49ab18d52.ff179a4b-e86b-4893-95d9-3292bfd1b833
Jun 15 16:00:19 devstack sudo[104036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:00:19 devstack sudo[104035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4d817a0d-a968-45b2-a173-5e8e3e6074d2
Jun 15 16:00:19 devstack sudo[104035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:00:19 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5d7e74c-74cb-4377-a43a-941a22b5ff68 tempest-TestServerVolumeAttachScenarioOldVersion-353574235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 16:00:19 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-c5d7e74c-74cb-4377-a43a-941a22b5ff68 tempest-TestServerVolumeAttachScenarioOldVersion-353574235 None] Flow 'volume_create_manager' (7f20384d-fe26-40fc-b5b6-8e30a8ab81b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:00:19 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-c5d7e74c-74cb-4377-a43a-941a22b5ff68 tempest-TestServerVolumeAttachScenarioOldVersion-353574235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf0c10b6-3dfb-4df7-8f3f-d10f779d9d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:00:19 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-c5d7e74c-74cb-4377-a43a-941a22b5ff68 tempest-TestServerVolumeAttachScenarioOldVersion-353574235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf0c10b6-3dfb-4df7-8f3f-d10f779d9d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:00:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-2017282373',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35b3c089-cc44-450f-b9de-73aafc624c45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4cec6acb0b44ecd87b5dfc76014df9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:00:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:00:19Z,use_quota=True,user_id='cd0405b2e89047f1b671527dccd82e8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:00:19 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-c5d7e74c-74cb-4377-a43a-941a22b5ff68 tempest-TestServerVolumeAttachScenarioOldVersion-353574235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66779f65-1429-4e8f-88d7-cb8a0ed77116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:00:19 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-c5d7e74c-74cb-4377-a43a-941a22b5ff68 tempest-TestServerVolumeAttachScenarioOldVersion-353574235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66779f65-1429-4e8f-88d7-cb8a0ed77116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:00:19 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-c5d7e74c-74cb-4377-a43a-941a22b5ff68 tempest-TestServerVolumeAttachScenarioOldVersion-353574235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38462dce-94a4-47e4-954d-2d7772f03f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:00:19 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-c5d7e74c-74cb-4377-a43a-941a22b5ff68 tempest-TestServerVolumeAttachScenarioOldVersion-353574235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38462dce-94a4-47e4-954d-2d7772f03f2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35b3c089-cc44-450f-b9de-73aafc624c45', 'volume_name': 'volume-35b3c089-cc44-450f-b9de-73aafc624c45', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:00:19 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-c5d7e74c-74cb-4377-a43a-941a22b5ff68 tempest-TestServerVolumeAttachScenarioOldVersion-353574235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bf37840-86f0-48ac-baad-0542d37ed0c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:00:19 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-c5d7e74c-74cb-4377-a43a-941a22b5ff68 tempest-TestServerVolumeAttachScenarioOldVersion-353574235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bf37840-86f0-48ac-baad-0542d37ed0c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:00:19 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-c5d7e74c-74cb-4377-a43a-941a22b5ff68 tempest-TestServerVolumeAttachScenarioOldVersion-353574235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (855ca022-2d7b-422e-a048-6fcceca6606e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:00:19 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-c5d7e74c-74cb-4377-a43a-941a22b5ff68 tempest-TestServerVolumeAttachScenarioOldVersion-353574235 None] Volume 35b3c089-cc44-450f-b9de-73aafc624c45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35b3c089-cc44-450f-b9de-73aafc624c45', 'volume_size': 1}
Jun 15 16:00:19 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-c5d7e74c-74cb-4377-a43a-941a22b5ff68 tempest-TestServerVolumeAttachScenarioOldVersion-353574235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:00:19 devstack sudo[104036]: pam_unix(sudo:session): session closed for user root
Jun 15 16:00:19 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c6ca2524-8896-4fef-98fb-54a6c229a7c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-05a73b34-99b1-4d70-8cbe-c6e49ab18d52.ff179a4b-e86b-4893-95d9-3292bfd1b833" returned: 0 in 0.631s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:00:19 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c6ca2524-8896-4fef-98fb-54a6c229a7c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-05a73b34-99b1-4d70-8cbe-c6e49ab18d52.info {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:00:19 devstack sudo[104043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-05a73b34-99b1-4d70-8cbe-c6e49ab18d52.info
Jun 15 16:00:19 devstack sudo[104043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:00:19 devstack sudo[104035]: pam_unix(sudo:session): session closed for user root
Jun 15 16:00:19 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-fd53a3a8-dde1-4a20-87b9-e888c9811912 tempest-SnapshotMetadataTestJSON-1107938519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4d817a0d-a968-45b2-a173-5e8e3e6074d2" returned: 0 in 0.759s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:00:19 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-fd53a3a8-dde1-4a20-87b9-e888c9811912 tempest-SnapshotMetadataTestJSON-1107938519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4d817a0d-a968-45b2-a173-5e8e3e6074d2.266103be-ba5e-4858-ad52-cda59712aab5 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:00:19 devstack sudo[104045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4d817a0d-a968-45b2-a173-5e8e3e6074d2.266103be-ba5e-4858-ad52-cda59712aab5
Jun 15 16:00:19 devstack sudo[104045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:00:20 devstack sudo[104043]: pam_unix(sudo:session): session closed for user root
Jun 15 16:00:20 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c6ca2524-8896-4fef-98fb-54a6c229a7c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-05a73b34-99b1-4d70-8cbe-c6e49ab18d52.info" returned: 0 in 0.588s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:00:20 devstack cinder-volume[91863]: WARNING cinder.volume.drivers.remotefs [None req-c6ca2524-8896-4fef-98fb-54a6c229a7c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-05a73b34-99b1-4d70-8cbe-c6e49ab18d52.info is being set with open permissions: ugo+rw
Jun 15 16:00:20 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c6ca2524-8896-4fef-98fb-54a6c229a7c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-05a73b34-99b1-4d70-8cbe-c6e49ab18d52.info {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:00:20 devstack sudo[104051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-05a73b34-99b1-4d70-8cbe-c6e49ab18d52.info
Jun 15 16:00:20 devstack sudo[104051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:00:20 devstack sudo[104045]: pam_unix(sudo:session): session closed for user root
Jun 15 16:00:20 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-fd53a3a8-dde1-4a20-87b9-e888c9811912 tempest-SnapshotMetadataTestJSON-1107938519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4d817a0d-a968-45b2-a173-5e8e3e6074d2.266103be-ba5e-4858-ad52-cda59712aab5" returned: 0 in 0.666s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:00:20 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-fd53a3a8-dde1-4a20-87b9-e888c9811912 tempest-SnapshotMetadataTestJSON-1107938519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4d817a0d-a968-45b2-a173-5e8e3e6074d2.266103be-ba5e-4858-ad52-cda59712aab5 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:00:20 devstack sudo[104053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4d817a0d-a968-45b2-a173-5e8e3e6074d2.266103be-ba5e-4858-ad52-cda59712aab5
Jun 15 16:00:20 devstack sudo[104053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:00:20 devstack sudo[104051]: pam_unix(sudo:session): session closed for user root
Jun 15 16:00:20 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c6ca2524-8896-4fef-98fb-54a6c229a7c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-05a73b34-99b1-4d70-8cbe-c6e49ab18d52.info" returned: 0 in 0.589s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:00:20 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-c6ca2524-8896-4fef-98fb-54a6c229a7c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.133s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:00:20 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-c5d7e74c-74cb-4377-a43a-941a22b5ff68 tempest-TestServerVolumeAttachScenarioOldVersion-353574235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.635s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:00:20 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-c5d7e74c-74cb-4377-a43a-941a22b5ff68 tempest-TestServerVolumeAttachScenarioOldVersion-353574235 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:00:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-2017282373',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35b3c089-cc44-450f-b9de-73aafc624c45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4cec6acb0b44ecd87b5dfc76014df9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:00:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:00:19Z,use_quota=True,user_id='cd0405b2e89047f1b671527dccd82e8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 16:00:20 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-c5d7e74c-74cb-4377-a43a-941a22b5ff68 tempest-TestServerVolumeAttachScenarioOldVersion-353574235 None] Creating volume 35b3c089-cc44-450f-b9de-73aafc624c45 {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 16:00:20 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-c5d7e74c-74cb-4377-a43a-941a22b5ff68 tempest-TestServerVolumeAttachScenarioOldVersion-353574235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:00:20 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-c5d7e74c-74cb-4377-a43a-941a22b5ff68 tempest-TestServerVolumeAttachScenarioOldVersion-353574235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:00:20 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-c5d7e74c-74cb-4377-a43a-941a22b5ff68 tempest-TestServerVolumeAttachScenarioOldVersion-353574235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:00:20 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-c5d7e74c-74cb-4377-a43a-941a22b5ff68 tempest-TestServerVolumeAttachScenarioOldVersion-353574235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:00:20 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-c5d7e74c-74cb-4377-a43a-941a22b5ff68 tempest-TestServerVolumeAttachScenarioOldVersion-353574235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:00:20 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-c5d7e74c-74cb-4377-a43a-941a22b5ff68 tempest-TestServerVolumeAttachScenarioOldVersion-353574235 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 16:00:20 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-c5d7e74c-74cb-4377-a43a-941a22b5ff68 tempest-TestServerVolumeAttachScenarioOldVersion-353574235 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 16:00:20 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c5d7e74c-74cb-4377-a43a-941a22b5ff68 tempest-TestServerVolumeAttachScenarioOldVersion-353574235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-35b3c089-cc44-450f-b9de-73aafc624c45 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:00:20 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-c6ca2524-8896-4fef-98fb-54a6c229a7c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] Create snapshot completed successfully
Jun 15 16:00:20 devstack sudo[104058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-35b3c089-cc44-450f-b9de-73aafc624c45 1073741824
Jun 15 16:00:20 devstack sudo[104058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:00:20 devstack sudo[104053]: pam_unix(sudo:session): session closed for user root
Jun 15 16:00:20 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-fd53a3a8-dde1-4a20-87b9-e888c9811912 tempest-SnapshotMetadataTestJSON-1107938519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4d817a0d-a968-45b2-a173-5e8e3e6074d2.266103be-ba5e-4858-ad52-cda59712aab5" returned: 0 in 0.590s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:00:20 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-fd53a3a8-dde1-4a20-87b9-e888c9811912 tempest-SnapshotMetadataTestJSON-1107938519 None] Lock "cinder-quobyte-266103be-ba5e-4858-ad52-cda59712aab5" released by "_delete_snapshot" :: held 2.926s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:00:21 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-fd53a3a8-dde1-4a20-87b9-e888c9811912 tempest-SnapshotMetadataTestJSON-1107938519 None] Lock "cinder-quobyte-4d817a0d-a968-45b2-a173-5e8e3e6074d2" released by "delete_snapshot" :: held 2.952s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:00:21 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-fd53a3a8-dde1-4a20-87b9-e888c9811912 tempest-SnapshotMetadataTestJSON-1107938519 None] Created reservations ['33173be9-c101-4df7-ae4d-bd1f583ceb9e', '34c2fc22-bfa5-48a0-9670-9536a95c7c9c', 'c35fd954-33d7-427d-a8ce-556fc733bae6', 'cd252739-49a9-4e83-bb08-c4fb1db132d7'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 16:00:21 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-fd53a3a8-dde1-4a20-87b9-e888c9811912 tempest-SnapshotMetadataTestJSON-1107938519 None] Delete snapshot completed successfully.
Jun 15 16:00:21 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-fd53a3a8-dde1-4a20-87b9-e888c9811912 tempest-SnapshotMetadataTestJSON-1107938519 None] Lock "cinder-266103be-ba5e-4858-ad52-cda59712aab5-delete_snapshot" released by "delete_snapshot" :: held 3.087s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:00:21 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-6a6c16c3-064a-4a3b-afd2-8ac96d1fe1c5 tempest-SnapshotMetadataTestJSON-1107938519 None] Acquiring lock "cinder-4d817a0d-a968-45b2-a173-5e8e3e6074d2-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:00:21 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-6a6c16c3-064a-4a3b-afd2-8ac96d1fe1c5 tempest-SnapshotMetadataTestJSON-1107938519 None] Lock "cinder-4d817a0d-a968-45b2-a173-5e8e3e6074d2-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:00:21 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-6a6c16c3-064a-4a3b-afd2-8ac96d1fe1c5 tempest-SnapshotMetadataTestJSON-1107938519 None] Acquiring lock "cinder-quobyte-4d817a0d-a968-45b2-a173-5e8e3e6074d2" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:00:21 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-6a6c16c3-064a-4a3b-afd2-8ac96d1fe1c5 tempest-SnapshotMetadataTestJSON-1107938519 None] Lock "cinder-quobyte-4d817a0d-a968-45b2-a173-5e8e3e6074d2" acquired by "delete_volume" :: waited 0.021s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:00:21 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f8a909-f2a4-4e0d-a16c-0a8d1ebfeaf8]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:00:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6a6c16c3-064a-4a3b-afd2-8ac96d1fe1c5 tempest-SnapshotMetadataTestJSON-1107938519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4d817a0d-a968-45b2-a173-5e8e3e6074d2 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:00:21 devstack sudo[104063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4d817a0d-a968-45b2-a173-5e8e3e6074d2
Jun 15 16:00:21 devstack sudo[104063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:00:21 devstack sudo[104058]: pam_unix(sudo:session): session closed for user root
Jun 15 16:00:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c5d7e74c-74cb-4377-a43a-941a22b5ff68 tempest-TestServerVolumeAttachScenarioOldVersion-353574235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-35b3c089-cc44-450f-b9de-73aafc624c45 1073741824" returned: 0 in 0.844s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:00:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c5d7e74c-74cb-4377-a43a-941a22b5ff68 tempest-TestServerVolumeAttachScenarioOldVersion-353574235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-35b3c089-cc44-450f-b9de-73aafc624c45 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:00:21 devstack sudo[104066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-35b3c089-cc44-450f-b9de-73aafc624c45
Jun 15 16:00:21 devstack sudo[104066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:00:22 devstack sudo[104063]: pam_unix(sudo:session): session closed for user root
Jun 15 16:00:22 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6a6c16c3-064a-4a3b-afd2-8ac96d1fe1c5 tempest-SnapshotMetadataTestJSON-1107938519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4d817a0d-a968-45b2-a173-5e8e3e6074d2" returned: 0 in 0.773s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:00:22 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6a6c16c3-064a-4a3b-afd2-8ac96d1fe1c5 tempest-SnapshotMetadataTestJSON-1107938519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4d817a0d-a968-45b2-a173-5e8e3e6074d2 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:00:22 devstack sudo[104072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4d817a0d-a968-45b2-a173-5e8e3e6074d2
Jun 15 16:00:22 devstack sudo[104072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:00:22 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-f948327c-5fa0-448d-a023-784de8621832 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] Acquiring lock "cinder-ff179a4b-e86b-4893-95d9-3292bfd1b833-delete_snapshot" by "delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:00:22 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-f948327c-5fa0-448d-a023-784de8621832 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] Lock "cinder-ff179a4b-e86b-4893-95d9-3292bfd1b833-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:00:22 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-f948327c-5fa0-448d-a023-784de8621832 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] Acquiring lock "cinder-quobyte-05a73b34-99b1-4d70-8cbe-c6e49ab18d52" by "delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:00:22 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-f948327c-5fa0-448d-a023-784de8621832 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] Lock "cinder-quobyte-05a73b34-99b1-4d70-8cbe-c6e49ab18d52" acquired by "delete_snapshot" :: waited 0.016s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:00:22 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-f948327c-5fa0-448d-a023-784de8621832 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] Acquiring lock "cinder-quobyte-ff179a4b-e86b-4893-95d9-3292bfd1b833" by "_delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:00:22 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-f948327c-5fa0-448d-a023-784de8621832 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] Lock "cinder-quobyte-ff179a4b-e86b-4893-95d9-3292bfd1b833" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:00:22 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-f948327c-5fa0-448d-a023-784de8621832 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] Deleting offline snapshot ff179a4b-e86b-4893-95d9-3292bfd1b833 of volume 05a73b34-99b1-4d70-8cbe-c6e49ab18d52 {{(pid=91863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 15 16:00:22 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-f948327c-5fa0-448d-a023-784de8621832 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] snapshot_file for this snap is: volume-05a73b34-99b1-4d70-8cbe-c6e49ab18d52.ff179a4b-e86b-4893-95d9-3292bfd1b833 {{(pid=91863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 15 16:00:22 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[724e41f2-ec73-4ea8-b523-7915656ee046]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:00:22 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-f948327c-5fa0-448d-a023-784de8621832 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-05a73b34-99b1-4d70-8cbe-c6e49ab18d52.ff179a4b-e86b-4893-95d9-3292bfd1b833 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:00:22 devstack sudo[104066]: pam_unix(sudo:session): session closed for user root
Jun 15 16:00:22 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c5d7e74c-74cb-4377-a43a-941a22b5ff68 tempest-TestServerVolumeAttachScenarioOldVersion-353574235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-35b3c089-cc44-450f-b9de-73aafc624c45" returned: 0 in 0.661s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:00:22 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-c5d7e74c-74cb-4377-a43a-941a22b5ff68 tempest-TestServerVolumeAttachScenarioOldVersion-353574235 None] <== create_volume: return (1554ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 16:00:22 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-c5d7e74c-74cb-4377-a43a-941a22b5ff68 tempest-TestServerVolumeAttachScenarioOldVersion-353574235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.558s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:00:22 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-c5d7e74c-74cb-4377-a43a-941a22b5ff68 tempest-TestServerVolumeAttachScenarioOldVersion-353574235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (855ca022-2d7b-422e-a048-6fcceca6606e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35b3c089-cc44-450f-b9de-73aafc624c45', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:00:22 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-c5d7e74c-74cb-4377-a43a-941a22b5ff68 tempest-TestServerVolumeAttachScenarioOldVersion-353574235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d2f518f-8649-486a-bb43-ad703d7b9b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:00:22 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-c5d7e74c-74cb-4377-a43a-941a22b5ff68 tempest-TestServerVolumeAttachScenarioOldVersion-353574235 None] Volume volume-35b3c089-cc44-450f-b9de-73aafc624c45 (35b3c089-cc44-450f-b9de-73aafc624c45): created successfully
Jun 15 16:00:22 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-c5d7e74c-74cb-4377-a43a-941a22b5ff68 tempest-TestServerVolumeAttachScenarioOldVersion-353574235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d2f518f-8649-486a-bb43-ad703d7b9b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:00:22 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-c5d7e74c-74cb-4377-a43a-941a22b5ff68 tempest-TestServerVolumeAttachScenarioOldVersion-353574235 None] Flow 'volume_create_manager' (7f20384d-fe26-40fc-b5b6-8e30a8ab81b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:00:22 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-c5d7e74c-74cb-4377-a43a-941a22b5ff68 tempest-TestServerVolumeAttachScenarioOldVersion-353574235 None] Created volume successfully.
Jun 15 16:00:22 devstack sudo[104075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-05a73b34-99b1-4d70-8cbe-c6e49ab18d52.ff179a4b-e86b-4893-95d9-3292bfd1b833
Jun 15 16:00:22 devstack sudo[104075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:00:22 devstack sudo[104072]: pam_unix(sudo:session): session closed for user root
Jun 15 16:00:22 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6a6c16c3-064a-4a3b-afd2-8ac96d1fe1c5 tempest-SnapshotMetadataTestJSON-1107938519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4d817a0d-a968-45b2-a173-5e8e3e6074d2" returned: 0 in 0.601s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:00:22 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-6a6c16c3-064a-4a3b-afd2-8ac96d1fe1c5 tempest-SnapshotMetadataTestJSON-1107938519 None] Lock "cinder-quobyte-4d817a0d-a968-45b2-a173-5e8e3e6074d2" released by "delete_volume" :: held 1.475s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:00:22 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-6a6c16c3-064a-4a3b-afd2-8ac96d1fe1c5 tempest-SnapshotMetadataTestJSON-1107938519 None] Created reservations ['4e6bec94-2bcb-481f-828f-27262ab3d296', '58ff4c1b-4660-4719-b434-b085ff845859', 'eb668018-3b9e-405a-89cf-bbc9a75f26a0', '2b25bf19-c402-4147-933e-aedd454f2908'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 16:00:22 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6a6c16c3-064a-4a3b-afd2-8ac96d1fe1c5 tempest-SnapshotMetadataTestJSON-1107938519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:00:22 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6a6c16c3-064a-4a3b-afd2-8ac96d1fe1c5 tempest-SnapshotMetadataTestJSON-1107938519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:00:22 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6a6c16c3-064a-4a3b-afd2-8ac96d1fe1c5 tempest-SnapshotMetadataTestJSON-1107938519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:00:22 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6a6c16c3-064a-4a3b-afd2-8ac96d1fe1c5 tempest-SnapshotMetadataTestJSON-1107938519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:00:22 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6a6c16c3-064a-4a3b-afd2-8ac96d1fe1c5 tempest-SnapshotMetadataTestJSON-1107938519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:00:22 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6a6c16c3-064a-4a3b-afd2-8ac96d1fe1c5 tempest-SnapshotMetadataTestJSON-1107938519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:00:23 devstack sudo[104078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 16:00:23 devstack sudo[104078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:00:23 devstack sudo[104075]: pam_unix(sudo:session): session closed for user root
Jun 15 16:00:23 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-f948327c-5fa0-448d-a023-784de8621832 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-05a73b34-99b1-4d70-8cbe-c6e49ab18d52.ff179a4b-e86b-4893-95d9-3292bfd1b833" returned: 0 in 0.803s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:00:23 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-f948327c-5fa0-448d-a023-784de8621832 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05a73b34-99b1-4d70-8cbe-c6e49ab18d52(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 16:00:23 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c370b649-3768-4b20-aead-40b2e052cdc7]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:00:23 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-f948327c-5fa0-448d-a023-784de8621832 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-05a73b34-99b1-4d70-8cbe-c6e49ab18d52 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:00:23 devstack sudo[104087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-05a73b34-99b1-4d70-8cbe-c6e49ab18d52
Jun 15 16:00:23 devstack sudo[104087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:00:23 devstack sudo[104078]: pam_unix(sudo:session): session closed for user root
Jun 15 16:00:23 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6a6c16c3-064a-4a3b-afd2-8ac96d1fe1c5 tempest-SnapshotMetadataTestJSON-1107938519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.623s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:00:23 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-6a6c16c3-064a-4a3b-afd2-8ac96d1fe1c5 tempest-SnapshotMetadataTestJSON-1107938519 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 16:00:23 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-6a6c16c3-064a-4a3b-afd2-8ac96d1fe1c5 tempest-SnapshotMetadataTestJSON-1107938519 None] Deleted volume successfully.
Jun 15 16:00:23 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-6a6c16c3-064a-4a3b-afd2-8ac96d1fe1c5 tempest-SnapshotMetadataTestJSON-1107938519 None] Lock "cinder-4d817a0d-a968-45b2-a173-5e8e3e6074d2-delete_volume" released by "delete_volume" :: held 2.318s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:00:24 devstack sudo[104087]: pam_unix(sudo:session): session closed for user root
Jun 15 16:00:24 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-f948327c-5fa0-448d-a023-784de8621832 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-05a73b34-99b1-4d70-8cbe-c6e49ab18d52" returned: 0 in 0.839s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:00:24 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-f948327c-5fa0-448d-a023-784de8621832 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-05a73b34-99b1-4d70-8cbe-c6e49ab18d52.ff179a4b-e86b-4893-95d9-3292bfd1b833 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:00:24 devstack sudo[104096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-05a73b34-99b1-4d70-8cbe-c6e49ab18d52.ff179a4b-e86b-4893-95d9-3292bfd1b833
Jun 15 16:00:24 devstack sudo[104096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:00:24 devstack sudo[104096]: pam_unix(sudo:session): session closed for user root
Jun 15 16:00:24 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-f948327c-5fa0-448d-a023-784de8621832 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-05a73b34-99b1-4d70-8cbe-c6e49ab18d52.ff179a4b-e86b-4893-95d9-3292bfd1b833" returned: 0 in 0.745s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:00:24 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-f948327c-5fa0-448d-a023-784de8621832 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-05a73b34-99b1-4d70-8cbe-c6e49ab18d52.ff179a4b-e86b-4893-95d9-3292bfd1b833 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:00:24 devstack sudo[104103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-05a73b34-99b1-4d70-8cbe-c6e49ab18d52.ff179a4b-e86b-4893-95d9-3292bfd1b833
Jun 15 16:00:24 devstack sudo[104103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:00:25 devstack sudo[104103]: pam_unix(sudo:session): session closed for user root
Jun 15 16:00:25 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-f948327c-5fa0-448d-a023-784de8621832 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-05a73b34-99b1-4d70-8cbe-c6e49ab18d52.ff179a4b-e86b-4893-95d9-3292bfd1b833" returned: 0 in 0.596s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:00:25 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-f948327c-5fa0-448d-a023-784de8621832 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] Lock "cinder-quobyte-ff179a4b-e86b-4893-95d9-3292bfd1b833" released by "_delete_snapshot" :: held 3.091s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:00:25 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-f948327c-5fa0-448d-a023-784de8621832 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] Lock "cinder-quobyte-05a73b34-99b1-4d70-8cbe-c6e49ab18d52" released by "delete_snapshot" :: held 3.116s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:00:25 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-f948327c-5fa0-448d-a023-784de8621832 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] Created reservations ['9282a758-a995-46a6-8aa1-71ae347fc6cc', '7b1a5eef-f68d-4a98-bfaf-e6babb3d005e', 'f2d6b98d-4baf-429e-9866-7a716fa32fdb', '62cffee1-f674-4808-836b-346d55dbeeaa'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 16:00:25 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-f948327c-5fa0-448d-a023-784de8621832 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] Delete snapshot completed successfully.
Jun 15 16:00:25 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-f948327c-5fa0-448d-a023-784de8621832 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] Lock "cinder-ff179a4b-e86b-4893-95d9-3292bfd1b833-delete_snapshot" released by "delete_snapshot" :: held 3.272s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:00:26 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-1a31b925-a22c-49ba-8028-55b3344141b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] Acquiring lock "cinder-05a73b34-99b1-4d70-8cbe-c6e49ab18d52-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:00:26 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-1a31b925-a22c-49ba-8028-55b3344141b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] Lock "cinder-05a73b34-99b1-4d70-8cbe-c6e49ab18d52-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:00:26 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-1a31b925-a22c-49ba-8028-55b3344141b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] Acquiring lock "cinder-quobyte-05a73b34-99b1-4d70-8cbe-c6e49ab18d52" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:00:26 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-1a31b925-a22c-49ba-8028-55b3344141b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] Lock "cinder-quobyte-05a73b34-99b1-4d70-8cbe-c6e49ab18d52" acquired by "delete_volume" :: waited 0.019s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:00:26 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c625730d-e912-4e61-bfcf-44f6983b7bd5]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:00:26 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-1a31b925-a22c-49ba-8028-55b3344141b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-05a73b34-99b1-4d70-8cbe-c6e49ab18d52 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:00:26 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [req-6a76bacc-121f-48fe-8482-72311267adfb req-40bb0cb1-44ec-466e-9163-b1169c9068c1 tempest-TestServerVolumeAttachScenarioOldVersion-353574235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:00:26 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [req-6a76bacc-121f-48fe-8482-72311267adfb req-40bb0cb1-44ec-466e-9163-b1169c9068c1 tempest-TestServerVolumeAttachScenarioOldVersion-353574235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:00:26 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eeb3a22-8aee-4541-859f-662949334ab4]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:00:26 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-6a76bacc-121f-48fe-8482-72311267adfb req-40bb0cb1-44ec-466e-9163-b1169c9068c1 tempest-TestServerVolumeAttachScenarioOldVersion-353574235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-35b3c089-cc44-450f-b9de-73aafc624c45 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:00:26 devstack sudo[104114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-05a73b34-99b1-4d70-8cbe-c6e49ab18d52
Jun 15 16:00:26 devstack sudo[104114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:00:26 devstack sudo[104115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-35b3c089-cc44-450f-b9de-73aafc624c45
Jun 15 16:00:26 devstack sudo[104115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:00:27 devstack sudo[104114]: pam_unix(sudo:session): session closed for user root
Jun 15 16:00:27 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-1a31b925-a22c-49ba-8028-55b3344141b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-05a73b34-99b1-4d70-8cbe-c6e49ab18d52" returned: 0 in 0.756s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:00:27 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-1a31b925-a22c-49ba-8028-55b3344141b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-05a73b34-99b1-4d70-8cbe-c6e49ab18d52 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:00:27 devstack sudo[104124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-05a73b34-99b1-4d70-8cbe-c6e49ab18d52
Jun 15 16:00:27 devstack sudo[104124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:00:27 devstack sudo[104115]: pam_unix(sudo:session): session closed for user root
Jun 15 16:00:27 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-6a76bacc-121f-48fe-8482-72311267adfb req-40bb0cb1-44ec-466e-9163-b1169c9068c1 tempest-TestServerVolumeAttachScenarioOldVersion-353574235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-35b3c089-cc44-450f-b9de-73aafc624c45" returned: 0 in 0.770s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:00:27 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [req-6a76bacc-121f-48fe-8482-72311267adfb req-40bb0cb1-44ec-466e-9163-b1169c9068c1 tempest-TestServerVolumeAttachScenarioOldVersion-353574235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.790s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:00:27 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [req-6a76bacc-121f-48fe-8482-72311267adfb req-40bb0cb1-44ec-466e-9163-b1169c9068c1 tempest-TestServerVolumeAttachScenarioOldVersion-353574235 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc', 'name': 'volume-35b3c089-cc44-450f-b9de-73aafc624c45', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c73b32b9-2ccf-4fea-8a97-51244c89b3e8', 'enforce_multipath': True} {{(pid=91863) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 15 16:00:27 devstack cinder-volume[91863]: INFO cinder.volume.manager [req-6a76bacc-121f-48fe-8482-72311267adfb req-40bb0cb1-44ec-466e-9163-b1169c9068c1 tempest-TestServerVolumeAttachScenarioOldVersion-353574235 None] attachment_update completed successfully.
Jun 15 16:00:28 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2fc2a2a-d1e1-4f7a-9548-058a1052967c tempest-VolumesTransfersV357Test-1300253650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 16:00:28 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e2fc2a2a-d1e1-4f7a-9548-058a1052967c tempest-VolumesTransfersV357Test-1300253650 None] Flow 'volume_create_manager' (e8e648ce-65bf-4dbf-91ea-fe68a7e63c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:00:28 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e2fc2a2a-d1e1-4f7a-9548-058a1052967c tempest-VolumesTransfersV357Test-1300253650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cda7c333-0591-407e-95be-4311bb41f647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:00:28 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e2fc2a2a-d1e1-4f7a-9548-058a1052967c tempest-VolumesTransfersV357Test-1300253650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cda7c333-0591-407e-95be-4311bb41f647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:00:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-548702331',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f887a90-3bcb-41db-a473-9a5f0f3edfd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f875aa6598344255a18c52d73d394ea0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:00:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:00:28Z,use_quota=True,user_id='59409920705b4ec494916eb83d9ecd23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:00:28 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e2fc2a2a-d1e1-4f7a-9548-058a1052967c tempest-VolumesTransfersV357Test-1300253650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ce6e651-fe05-49e2-bbec-26aabf141916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:00:28 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e2fc2a2a-d1e1-4f7a-9548-058a1052967c tempest-VolumesTransfersV357Test-1300253650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ce6e651-fe05-49e2-bbec-26aabf141916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:00:28 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e2fc2a2a-d1e1-4f7a-9548-058a1052967c tempest-VolumesTransfersV357Test-1300253650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1439d944-7d91-4047-a99b-2b2375e8525b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:00:28 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e2fc2a2a-d1e1-4f7a-9548-058a1052967c tempest-VolumesTransfersV357Test-1300253650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1439d944-7d91-4047-a99b-2b2375e8525b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f887a90-3bcb-41db-a473-9a5f0f3edfd9', 'volume_name': 'volume-1f887a90-3bcb-41db-a473-9a5f0f3edfd9', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:00:28 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e2fc2a2a-d1e1-4f7a-9548-058a1052967c tempest-VolumesTransfersV357Test-1300253650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83bde30d-68d2-4752-a623-62c9ca55dea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:00:28 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e2fc2a2a-d1e1-4f7a-9548-058a1052967c tempest-VolumesTransfersV357Test-1300253650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83bde30d-68d2-4752-a623-62c9ca55dea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:00:28 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e2fc2a2a-d1e1-4f7a-9548-058a1052967c tempest-VolumesTransfersV357Test-1300253650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad6c49b2-b536-45c3-a025-d817b75a9454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:00:28 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-e2fc2a2a-d1e1-4f7a-9548-058a1052967c tempest-VolumesTransfersV357Test-1300253650 None] Volume 1f887a90-3bcb-41db-a473-9a5f0f3edfd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f887a90-3bcb-41db-a473-9a5f0f3edfd9', 'volume_size': 1}
Jun 15 16:00:28 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-e2fc2a2a-d1e1-4f7a-9548-058a1052967c tempest-VolumesTransfersV357Test-1300253650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:00:28 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-e2fc2a2a-d1e1-4f7a-9548-058a1052967c tempest-VolumesTransfersV357Test-1300253650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:00:28 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-e2fc2a2a-d1e1-4f7a-9548-058a1052967c tempest-VolumesTransfersV357Test-1300253650 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:00:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-548702331',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f887a90-3bcb-41db-a473-9a5f0f3edfd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f875aa6598344255a18c52d73d394ea0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:00:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:00:28Z,use_quota=True,user_id='59409920705b4ec494916eb83d9ecd23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 16:00:28 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-e2fc2a2a-d1e1-4f7a-9548-058a1052967c tempest-VolumesTransfersV357Test-1300253650 None] Creating volume 1f887a90-3bcb-41db-a473-9a5f0f3edfd9 {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 16:00:28 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-e2fc2a2a-d1e1-4f7a-9548-058a1052967c tempest-VolumesTransfersV357Test-1300253650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:00:28 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-e2fc2a2a-d1e1-4f7a-9548-058a1052967c tempest-VolumesTransfersV357Test-1300253650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:00:28 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-e2fc2a2a-d1e1-4f7a-9548-058a1052967c tempest-VolumesTransfersV357Test-1300253650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:00:28 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-e2fc2a2a-d1e1-4f7a-9548-058a1052967c tempest-VolumesTransfersV357Test-1300253650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:00:28 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-e2fc2a2a-d1e1-4f7a-9548-058a1052967c tempest-VolumesTransfersV357Test-1300253650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:00:28 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-e2fc2a2a-d1e1-4f7a-9548-058a1052967c tempest-VolumesTransfersV357Test-1300253650 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 16:00:28 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-e2fc2a2a-d1e1-4f7a-9548-058a1052967c tempest-VolumesTransfersV357Test-1300253650 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 16:00:28 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-e2fc2a2a-d1e1-4f7a-9548-058a1052967c tempest-VolumesTransfersV357Test-1300253650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1f887a90-3bcb-41db-a473-9a5f0f3edfd9 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:00:28 devstack sudo[104194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1f887a90-3bcb-41db-a473-9a5f0f3edfd9 1073741824
Jun 15 16:00:28 devstack sudo[104194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:00:28 devstack sudo[104124]: pam_unix(sudo:session): session closed for user root
Jun 15 16:00:28 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-1a31b925-a22c-49ba-8028-55b3344141b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-05a73b34-99b1-4d70-8cbe-c6e49ab18d52" returned: 0 in 0.788s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:00:28 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-1a31b925-a22c-49ba-8028-55b3344141b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] Lock "cinder-quobyte-05a73b34-99b1-4d70-8cbe-c6e49ab18d52" released by "delete_volume" :: held 1.618s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:00:28 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-1a31b925-a22c-49ba-8028-55b3344141b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] Created reservations ['5aac4fc5-088b-4a76-8a0b-aa5691a03848', '9992548e-25e3-45dd-b684-e809b6b1eccd', '49d2219d-4553-4dd5-86aa-84e5b7e51496', '0c9292fc-18d1-4d54-9ff1-c49196b1c0bb'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 16:00:28 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-1a31b925-a22c-49ba-8028-55b3344141b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:00:28 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-1a31b925-a22c-49ba-8028-55b3344141b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:00:28 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-1a31b925-a22c-49ba-8028-55b3344141b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:00:28 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-1a31b925-a22c-49ba-8028-55b3344141b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:00:28 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-1a31b925-a22c-49ba-8028-55b3344141b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:00:28 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-1a31b925-a22c-49ba-8028-55b3344141b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:00:28 devstack sudo[104196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 16:00:28 devstack sudo[104196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:00:29 devstack sudo[104194]: pam_unix(sudo:session): session closed for user root
Jun 15 16:00:29 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-e2fc2a2a-d1e1-4f7a-9548-058a1052967c tempest-VolumesTransfersV357Test-1300253650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1f887a90-3bcb-41db-a473-9a5f0f3edfd9 1073741824" returned: 0 in 0.953s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:00:29 devstack sudo[104196]: pam_unix(sudo:session): session closed for user root
Jun 15 16:00:29 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-1a31b925-a22c-49ba-8028-55b3344141b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.694s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:00:29 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-1a31b925-a22c-49ba-8028-55b3344141b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 16:00:29 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-1a31b925-a22c-49ba-8028-55b3344141b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] Deleted volume successfully.
Jun 15 16:00:29 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-e2fc2a2a-d1e1-4f7a-9548-058a1052967c tempest-VolumesTransfersV357Test-1300253650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1f887a90-3bcb-41db-a473-9a5f0f3edfd9 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:00:29 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-1a31b925-a22c-49ba-8028-55b3344141b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2131613482 None] Lock "cinder-05a73b34-99b1-4d70-8cbe-c6e49ab18d52-delete_volume" released by "delete_volume" :: held 2.566s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:00:29 devstack sudo[104517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1f887a90-3bcb-41db-a473-9a5f0f3edfd9
Jun 15 16:00:29 devstack sudo[104517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:00:29 devstack sudo[104517]: pam_unix(sudo:session): session closed for user root
Jun 15 16:00:29 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-e2fc2a2a-d1e1-4f7a-9548-058a1052967c tempest-VolumesTransfersV357Test-1300253650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1f887a90-3bcb-41db-a473-9a5f0f3edfd9" returned: 0 in 0.674s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:00:29 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-e2fc2a2a-d1e1-4f7a-9548-058a1052967c tempest-VolumesTransfersV357Test-1300253650 None] <== create_volume: return (1699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 16:00:29 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-e2fc2a2a-d1e1-4f7a-9548-058a1052967c tempest-VolumesTransfersV357Test-1300253650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.704s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:00:29 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e2fc2a2a-d1e1-4f7a-9548-058a1052967c tempest-VolumesTransfersV357Test-1300253650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad6c49b2-b536-45c3-a025-d817b75a9454) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f887a90-3bcb-41db-a473-9a5f0f3edfd9', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:00:29 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e2fc2a2a-d1e1-4f7a-9548-058a1052967c tempest-VolumesTransfersV357Test-1300253650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6275827-27a6-4607-bc2d-74dbde7d1fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:00:29 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-e2fc2a2a-d1e1-4f7a-9548-058a1052967c tempest-VolumesTransfersV357Test-1300253650 None] Volume volume-1f887a90-3bcb-41db-a473-9a5f0f3edfd9 (1f887a90-3bcb-41db-a473-9a5f0f3edfd9): created successfully
Jun 15 16:00:29 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e2fc2a2a-d1e1-4f7a-9548-058a1052967c tempest-VolumesTransfersV357Test-1300253650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6275827-27a6-4607-bc2d-74dbde7d1fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:00:29 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e2fc2a2a-d1e1-4f7a-9548-058a1052967c tempest-VolumesTransfersV357Test-1300253650 None] Flow 'volume_create_manager' (e8e648ce-65bf-4dbf-91ea-fe68a7e63c46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:00:29 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-e2fc2a2a-d1e1-4f7a-9548-058a1052967c tempest-VolumesTransfersV357Test-1300253650 None] Created volume successfully.
Jun 15 16:00:31 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-3e1bd8a3-d314-4bc3-9499-7d4c289a5094 tempest-VolumesTransfersV357Test-1039366039 None] Transfer volume completed successfully.
Jun 15 16:00:31 devstack cinder-volume[91863]: DEBUG oslo_service.periodic_task [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 16:00:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:00:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:00:31 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:00:31 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:00:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:00:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:00:31 devstack sudo[104521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 16:00:31 devstack sudo[104521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:00:31 devstack sudo[104521]: pam_unix(sudo:session): session closed for user root
Jun 15 16:00:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.752s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:00:31 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 16:00:31 devstack cinder-volume[91863]: DEBUG oslo_service.periodic_task [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Running periodic task VolumeManager._thread_info {{(pid=91863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 16:00:31 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] thread count: 28 {{(pid=91863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 15 16:00:31 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] thread info: [<_MainThread(MainThread, started 131088232640640)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131088122704576)>, <Thread(Thread-3 (stat_writer), started daemon 131088123058112)>, <Thread(Rabbit-heartbeat, started daemon 131088121268864)>, <Thread(Thread-5 (_runner), started daemon 131088121904192)>, <Thread(Thread-7 (_runner), started daemon 131088122037248)>, <Thread(fd_logger, started daemon 131088119630784)>, <Thread(privsep_reader, started daemon 131088119781440)>, <Thread(tpool_thread_0, started daemon 131088111617728)>, <Thread(tpool_thread_1, started daemon 131088103225024)>, <Thread(tpool_thread_2, started daemon 131088094832320)>, <Thread(tpool_thread_3, started daemon 131088086439616)>, <Thread(tpool_thread_4, started daemon 131088078046912)>, <Thread(tpool_thread_5, started daemon 131088069654208)>, <Thread(tpool_thread_6, started daemon 131088061261504)>, <Thread(tpool_thread_7, started daemon 131088052868800)>, <Thread(tpool_thread_8, started daemon 131088044476096)>, <Thread(tpool_thread_9, started daemon 131088036083392)>, <Thread(tpool_thread_10, started daemon 131088027690688)>, <Thread(tpool_thread_11, started daemon 131088019297984)>, <Thread(tpool_thread_12, started daemon 131088010905280)>, <Thread(tpool_thread_13, started daemon 131088002512576)>, <Thread(tpool_thread_14, started daemon 131087994119872)>, <Thread(tpool_thread_15, started daemon 131087985727168)>, <Thread(tpool_thread_16, started daemon 131087977334464)>, <Thread(tpool_thread_17, started daemon 131087968941760)>, <Thread(tpool_thread_18, started daemon 131087960549056)>, <Thread(tpool_thread_19, started daemon 131087952156352)>] {{(pid=91863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 15 16:00:32 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-e51ced47-2bab-42d3-a4b5-7d46f2fc5f13 tempest-VolumesTransfersV357Test-456529301 None] Acquiring lock "cinder-1f887a90-3bcb-41db-a473-9a5f0f3edfd9-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:00:32 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-e51ced47-2bab-42d3-a4b5-7d46f2fc5f13 tempest-VolumesTransfersV357Test-456529301 None] Lock "cinder-1f887a90-3bcb-41db-a473-9a5f0f3edfd9-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:00:32 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-e51ced47-2bab-42d3-a4b5-7d46f2fc5f13 tempest-VolumesTransfersV357Test-456529301 None] Acquiring lock "cinder-quobyte-1f887a90-3bcb-41db-a473-9a5f0f3edfd9" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:00:32 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-e51ced47-2bab-42d3-a4b5-7d46f2fc5f13 tempest-VolumesTransfersV357Test-456529301 None] Lock "cinder-quobyte-1f887a90-3bcb-41db-a473-9a5f0f3edfd9" acquired by "delete_volume" :: waited 0.031s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:00:32 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f96e2b95-e467-4327-8da3-b6d0ea6c4369]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:00:32 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-e51ced47-2bab-42d3-a4b5-7d46f2fc5f13 tempest-VolumesTransfersV357Test-456529301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1f887a90-3bcb-41db-a473-9a5f0f3edfd9 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:00:32 devstack sudo[104524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1f887a90-3bcb-41db-a473-9a5f0f3edfd9
Jun 15 16:00:32 devstack sudo[104524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:00:33 devstack sudo[104524]: pam_unix(sudo:session): session closed for user root
Jun 15 16:00:33 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-e51ced47-2bab-42d3-a4b5-7d46f2fc5f13 tempest-VolumesTransfersV357Test-456529301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1f887a90-3bcb-41db-a473-9a5f0f3edfd9" returned: 0 in 0.862s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:00:33 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-e51ced47-2bab-42d3-a4b5-7d46f2fc5f13 tempest-VolumesTransfersV357Test-456529301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1f887a90-3bcb-41db-a473-9a5f0f3edfd9 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:00:33 devstack sudo[104529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1f887a90-3bcb-41db-a473-9a5f0f3edfd9
Jun 15 16:00:33 devstack sudo[104529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:00:34 devstack sudo[104529]: pam_unix(sudo:session): session closed for user root
Jun 15 16:00:34 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-e51ced47-2bab-42d3-a4b5-7d46f2fc5f13 tempest-VolumesTransfersV357Test-456529301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1f887a90-3bcb-41db-a473-9a5f0f3edfd9" returned: 0 in 0.726s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:00:34 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-e51ced47-2bab-42d3-a4b5-7d46f2fc5f13 tempest-VolumesTransfersV357Test-456529301 None] Lock "cinder-quobyte-1f887a90-3bcb-41db-a473-9a5f0f3edfd9" released by "delete_volume" :: held 1.647s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:00:34 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-e51ced47-2bab-42d3-a4b5-7d46f2fc5f13 tempest-VolumesTransfersV357Test-456529301 None] Created reservations ['8d4b48a3-e1af-4062-9ede-74e608634e4a', 'd5886025-51c7-423a-aabf-1a6b1356ab5e', 'ce642c7c-9ffb-4222-b54e-29abd99f9de0', 'fd0d0c6f-6c08-40f3-b745-27f8fbca7b2f'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 16:00:34 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-e51ced47-2bab-42d3-a4b5-7d46f2fc5f13 tempest-VolumesTransfersV357Test-456529301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:00:34 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-e51ced47-2bab-42d3-a4b5-7d46f2fc5f13 tempest-VolumesTransfersV357Test-456529301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:00:34 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-e51ced47-2bab-42d3-a4b5-7d46f2fc5f13 tempest-VolumesTransfersV357Test-456529301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:00:34 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-e51ced47-2bab-42d3-a4b5-7d46f2fc5f13 tempest-VolumesTransfersV357Test-456529301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:00:34 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-e51ced47-2bab-42d3-a4b5-7d46f2fc5f13 tempest-VolumesTransfersV357Test-456529301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:00:34 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-e51ced47-2bab-42d3-a4b5-7d46f2fc5f13 tempest-VolumesTransfersV357Test-456529301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:00:34 devstack sudo[104532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 16:00:34 devstack sudo[104532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:00:34 devstack sudo[104532]: pam_unix(sudo:session): session closed for user root
Jun 15 16:00:34 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-e51ced47-2bab-42d3-a4b5-7d46f2fc5f13 tempest-VolumesTransfersV357Test-456529301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.657s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:00:34 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-e51ced47-2bab-42d3-a4b5-7d46f2fc5f13 tempest-VolumesTransfersV357Test-456529301 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 16:00:34 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-e51ced47-2bab-42d3-a4b5-7d46f2fc5f13 tempest-VolumesTransfersV357Test-456529301 None] Deleted volume successfully.
Jun 15 16:00:34 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-e51ced47-2bab-42d3-a4b5-7d46f2fc5f13 tempest-VolumesTransfersV357Test-456529301 None] Lock "cinder-1f887a90-3bcb-41db-a473-9a5f0f3edfd9-delete_volume" released by "delete_volume" :: held 2.561s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:00:35 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-01a7f42d-56b2-47be-84f1-e77a8e24b0a3 tempest-VolumesTransfersV357Test-1300253650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 16:00:35 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-01a7f42d-56b2-47be-84f1-e77a8e24b0a3 tempest-VolumesTransfersV357Test-1300253650 None] Flow 'volume_create_manager' (26e66a5d-e206-41b9-860b-237b670a30d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:00:35 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-01a7f42d-56b2-47be-84f1-e77a8e24b0a3 tempest-VolumesTransfersV357Test-1300253650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f89b9a55-f0a7-414a-a18f-631cf4448fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:00:35 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-01a7f42d-56b2-47be-84f1-e77a8e24b0a3 tempest-VolumesTransfersV357Test-1300253650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f89b9a55-f0a7-414a-a18f-631cf4448fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:00:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1792847218',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0aa78890-aa37-4c8f-a69d-8e9d7b60d0ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f875aa6598344255a18c52d73d394ea0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:00:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:00:35Z,use_quota=True,user_id='59409920705b4ec494916eb83d9ecd23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:00:35 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-01a7f42d-56b2-47be-84f1-e77a8e24b0a3 tempest-VolumesTransfersV357Test-1300253650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (536a0fdb-bb13-46bd-892b-c69570eedb46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:00:35 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-01a7f42d-56b2-47be-84f1-e77a8e24b0a3 tempest-VolumesTransfersV357Test-1300253650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (536a0fdb-bb13-46bd-892b-c69570eedb46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:00:35 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-01a7f42d-56b2-47be-84f1-e77a8e24b0a3 tempest-VolumesTransfersV357Test-1300253650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61e76f9f-053e-4b11-ab3f-862223f90d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:00:35 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-01a7f42d-56b2-47be-84f1-e77a8e24b0a3 tempest-VolumesTransfersV357Test-1300253650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61e76f9f-053e-4b11-ab3f-862223f90d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0aa78890-aa37-4c8f-a69d-8e9d7b60d0ca', 'volume_name': 'volume-0aa78890-aa37-4c8f-a69d-8e9d7b60d0ca', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:00:35 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-01a7f42d-56b2-47be-84f1-e77a8e24b0a3 tempest-VolumesTransfersV357Test-1300253650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54199d25-0e67-4ef6-92fa-53f82265c2be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:00:35 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-01a7f42d-56b2-47be-84f1-e77a8e24b0a3 tempest-VolumesTransfersV357Test-1300253650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54199d25-0e67-4ef6-92fa-53f82265c2be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:00:35 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-01a7f42d-56b2-47be-84f1-e77a8e24b0a3 tempest-VolumesTransfersV357Test-1300253650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d485dfe9-bc05-41ef-a9e5-789e264168f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:00:35 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-01a7f42d-56b2-47be-84f1-e77a8e24b0a3 tempest-VolumesTransfersV357Test-1300253650 None] Volume 0aa78890-aa37-4c8f-a69d-8e9d7b60d0ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0aa78890-aa37-4c8f-a69d-8e9d7b60d0ca', 'volume_size': 1}
Jun 15 16:00:35 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-01a7f42d-56b2-47be-84f1-e77a8e24b0a3 tempest-VolumesTransfersV357Test-1300253650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:00:35 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-01a7f42d-56b2-47be-84f1-e77a8e24b0a3 tempest-VolumesTransfersV357Test-1300253650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:00:35 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-01a7f42d-56b2-47be-84f1-e77a8e24b0a3 tempest-VolumesTransfersV357Test-1300253650 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:00:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1792847218',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0aa78890-aa37-4c8f-a69d-8e9d7b60d0ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f875aa6598344255a18c52d73d394ea0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:00:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:00:35Z,use_quota=True,user_id='59409920705b4ec494916eb83d9ecd23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 16:00:35 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-01a7f42d-56b2-47be-84f1-e77a8e24b0a3 tempest-VolumesTransfersV357Test-1300253650 None] Creating volume 0aa78890-aa37-4c8f-a69d-8e9d7b60d0ca {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 16:00:35 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-01a7f42d-56b2-47be-84f1-e77a8e24b0a3 tempest-VolumesTransfersV357Test-1300253650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:00:35 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-01a7f42d-56b2-47be-84f1-e77a8e24b0a3 tempest-VolumesTransfersV357Test-1300253650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:00:35 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-01a7f42d-56b2-47be-84f1-e77a8e24b0a3 tempest-VolumesTransfersV357Test-1300253650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:00:35 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-01a7f42d-56b2-47be-84f1-e77a8e24b0a3 tempest-VolumesTransfersV357Test-1300253650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:00:35 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-01a7f42d-56b2-47be-84f1-e77a8e24b0a3 tempest-VolumesTransfersV357Test-1300253650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:00:35 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-01a7f42d-56b2-47be-84f1-e77a8e24b0a3 tempest-VolumesTransfersV357Test-1300253650 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 16:00:35 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-01a7f42d-56b2-47be-84f1-e77a8e24b0a3 tempest-VolumesTransfersV357Test-1300253650 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 16:00:35 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-01a7f42d-56b2-47be-84f1-e77a8e24b0a3 tempest-VolumesTransfersV357Test-1300253650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-0aa78890-aa37-4c8f-a69d-8e9d7b60d0ca 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:00:35 devstack sudo[104578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-0aa78890-aa37-4c8f-a69d-8e9d7b60d0ca 1073741824
Jun 15 16:00:35 devstack sudo[104578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:00:35 devstack cinder-volume[91863]: INFO cinder.volume.manager [req-86a7bfc5-bd6d-46d0-96f3-da5f3369acdc req-b561d42a-a7df-4c38-823d-17cc32420a83 tempest-TestServerVolumeAttachScenarioOldVersion-353574235 None] Terminate volume connection completed successfully.
Jun 15 16:00:35 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [req-86a7bfc5-bd6d-46d0-96f3-da5f3369acdc req-b561d42a-a7df-4c38-823d-17cc32420a83 tempest-TestServerVolumeAttachScenarioOldVersion-353574235 None] Deleting attachment c73b32b9-2ccf-4fea-8a97-51244c89b3e8. {{(pid=91863) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 15 16:00:36 devstack sudo[104578]: pam_unix(sudo:session): session closed for user root
Jun 15 16:00:36 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-01a7f42d-56b2-47be-84f1-e77a8e24b0a3 tempest-VolumesTransfersV357Test-1300253650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-0aa78890-aa37-4c8f-a69d-8e9d7b60d0ca 1073741824" returned: 0 in 1.004s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:00:36 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-01a7f42d-56b2-47be-84f1-e77a8e24b0a3 tempest-VolumesTransfersV357Test-1300253650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-0aa78890-aa37-4c8f-a69d-8e9d7b60d0ca {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:00:36 devstack sudo[104604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-0aa78890-aa37-4c8f-a69d-8e9d7b60d0ca
Jun 15 16:00:36 devstack sudo[104604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:00:37 devstack sudo[104604]: pam_unix(sudo:session): session closed for user root
Jun 15 16:00:37 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-01a7f42d-56b2-47be-84f1-e77a8e24b0a3 tempest-VolumesTransfersV357Test-1300253650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-0aa78890-aa37-4c8f-a69d-8e9d7b60d0ca" returned: 0 in 0.730s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:00:37 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-01a7f42d-56b2-47be-84f1-e77a8e24b0a3 tempest-VolumesTransfersV357Test-1300253650 None] <== create_volume: return (1779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 16:00:37 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-01a7f42d-56b2-47be-84f1-e77a8e24b0a3 tempest-VolumesTransfersV357Test-1300253650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.783s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:00:37 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-01a7f42d-56b2-47be-84f1-e77a8e24b0a3 tempest-VolumesTransfersV357Test-1300253650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d485dfe9-bc05-41ef-a9e5-789e264168f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0aa78890-aa37-4c8f-a69d-8e9d7b60d0ca', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:00:37 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-01a7f42d-56b2-47be-84f1-e77a8e24b0a3 tempest-VolumesTransfersV357Test-1300253650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4d956ea-f61c-4e92-be8e-43249e5ce750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:00:37 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-01a7f42d-56b2-47be-84f1-e77a8e24b0a3 tempest-VolumesTransfersV357Test-1300253650 None] Volume volume-0aa78890-aa37-4c8f-a69d-8e9d7b60d0ca (0aa78890-aa37-4c8f-a69d-8e9d7b60d0ca): created successfully
Jun 15 16:00:37 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-01a7f42d-56b2-47be-84f1-e77a8e24b0a3 tempest-VolumesTransfersV357Test-1300253650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4d956ea-f61c-4e92-be8e-43249e5ce750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:00:37 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-01a7f42d-56b2-47be-84f1-e77a8e24b0a3 tempest-VolumesTransfersV357Test-1300253650 None] Flow 'volume_create_manager' (26e66a5d-e206-41b9-860b-237b670a30d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:00:37 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-01a7f42d-56b2-47be-84f1-e77a8e24b0a3 tempest-VolumesTransfersV357Test-1300253650 None] Created volume successfully.
Jun 15 16:00:37 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-02b578a0-aa08-48c5-bd15-972693ff4685 tempest-TestServerVolumeAttachScenarioOldVersion-353574235 None] Acquiring lock "cinder-35b3c089-cc44-450f-b9de-73aafc624c45-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:00:37 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-02b578a0-aa08-48c5-bd15-972693ff4685 tempest-TestServerVolumeAttachScenarioOldVersion-353574235 None] Lock "cinder-35b3c089-cc44-450f-b9de-73aafc624c45-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:00:37 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-02b578a0-aa08-48c5-bd15-972693ff4685 tempest-TestServerVolumeAttachScenarioOldVersion-353574235 None] Acquiring lock "cinder-quobyte-35b3c089-cc44-450f-b9de-73aafc624c45" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:00:37 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-02b578a0-aa08-48c5-bd15-972693ff4685 tempest-TestServerVolumeAttachScenarioOldVersion-353574235 None] Lock "cinder-quobyte-35b3c089-cc44-450f-b9de-73aafc624c45" acquired by "delete_volume" :: waited 0.018s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:00:37 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a87375-076d-4e68-ab00-c74e21445802]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:00:37 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-02b578a0-aa08-48c5-bd15-972693ff4685 tempest-TestServerVolumeAttachScenarioOldVersion-353574235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-35b3c089-cc44-450f-b9de-73aafc624c45 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:00:37 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-637644ee-128b-4706-a2e3-d08f70ac0fa0 tempest-VolumesTransfersV357Test-456529301 None] Acquiring lock "cinder-0aa78890-aa37-4c8f-a69d-8e9d7b60d0ca-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:00:37 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-637644ee-128b-4706-a2e3-d08f70ac0fa0 tempest-VolumesTransfersV357Test-456529301 None] Lock "cinder-0aa78890-aa37-4c8f-a69d-8e9d7b60d0ca-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:00:37 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-637644ee-128b-4706-a2e3-d08f70ac0fa0 tempest-VolumesTransfersV357Test-456529301 None] Acquiring lock "cinder-quobyte-0aa78890-aa37-4c8f-a69d-8e9d7b60d0ca" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:00:37 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-637644ee-128b-4706-a2e3-d08f70ac0fa0 tempest-VolumesTransfersV357Test-456529301 None] Lock "cinder-quobyte-0aa78890-aa37-4c8f-a69d-8e9d7b60d0ca" acquired by "delete_volume" :: waited 0.018s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:00:37 devstack sudo[104607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-35b3c089-cc44-450f-b9de-73aafc624c45
Jun 15 16:00:37 devstack sudo[104607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:00:37 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af2757d-4c94-4e97-91e1-d04281fe4fe3]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:00:37 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-637644ee-128b-4706-a2e3-d08f70ac0fa0 tempest-VolumesTransfersV357Test-456529301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-0aa78890-aa37-4c8f-a69d-8e9d7b60d0ca {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:00:37 devstack sudo[104609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-0aa78890-aa37-4c8f-a69d-8e9d7b60d0ca
Jun 15 16:00:37 devstack sudo[104609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:00:38 devstack sudo[104607]: pam_unix(sudo:session): session closed for user root
Jun 15 16:00:38 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-02b578a0-aa08-48c5-bd15-972693ff4685 tempest-TestServerVolumeAttachScenarioOldVersion-353574235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-35b3c089-cc44-450f-b9de-73aafc624c45" returned: 0 in 0.954s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:00:38 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-02b578a0-aa08-48c5-bd15-972693ff4685 tempest-TestServerVolumeAttachScenarioOldVersion-353574235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-35b3c089-cc44-450f-b9de-73aafc624c45 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:00:38 devstack sudo[104617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-35b3c089-cc44-450f-b9de-73aafc624c45
Jun 15 16:00:38 devstack sudo[104617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:00:38 devstack sudo[104609]: pam_unix(sudo:session): session closed for user root
Jun 15 16:00:38 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-637644ee-128b-4706-a2e3-d08f70ac0fa0 tempest-VolumesTransfersV357Test-456529301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-0aa78890-aa37-4c8f-a69d-8e9d7b60d0ca" returned: 0 in 0.856s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:00:38 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-637644ee-128b-4706-a2e3-d08f70ac0fa0 tempest-VolumesTransfersV357Test-456529301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-0aa78890-aa37-4c8f-a69d-8e9d7b60d0ca {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:00:38 devstack sudo[104619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-0aa78890-aa37-4c8f-a69d-8e9d7b60d0ca
Jun 15 16:00:38 devstack sudo[104619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:00:39 devstack sudo[104617]: pam_unix(sudo:session): session closed for user root
Jun 15 16:00:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-02b578a0-aa08-48c5-bd15-972693ff4685 tempest-TestServerVolumeAttachScenarioOldVersion-353574235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-35b3c089-cc44-450f-b9de-73aafc624c45" returned: 0 in 0.770s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:00:39 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-02b578a0-aa08-48c5-bd15-972693ff4685 tempest-TestServerVolumeAttachScenarioOldVersion-353574235 None] Lock "cinder-quobyte-35b3c089-cc44-450f-b9de-73aafc624c45" released by "delete_volume" :: held 1.789s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:00:39 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-02b578a0-aa08-48c5-bd15-972693ff4685 tempest-TestServerVolumeAttachScenarioOldVersion-353574235 None] Created reservations ['6f45772c-15bb-4659-86ef-9976d887e6c7', '4b1b976b-1ff3-4afa-a7f2-e636b79deb36', '7c4a8360-7bfb-4853-b0c4-ae1c6f1a16c8', 'ba1de242-84d0-4da5-b7d2-af2594af1bab'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 16:00:39 devstack sudo[104619]: pam_unix(sudo:session): session closed for user root
Jun 15 16:00:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-637644ee-128b-4706-a2e3-d08f70ac0fa0 tempest-VolumesTransfersV357Test-456529301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-0aa78890-aa37-4c8f-a69d-8e9d7b60d0ca" returned: 0 in 0.757s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:00:39 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-637644ee-128b-4706-a2e3-d08f70ac0fa0 tempest-VolumesTransfersV357Test-456529301 None] Lock "cinder-quobyte-0aa78890-aa37-4c8f-a69d-8e9d7b60d0ca" released by "delete_volume" :: held 1.683s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:00:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-02b578a0-aa08-48c5-bd15-972693ff4685 tempest-TestServerVolumeAttachScenarioOldVersion-353574235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:00:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-02b578a0-aa08-48c5-bd15-972693ff4685 tempest-TestServerVolumeAttachScenarioOldVersion-353574235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:00:39 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-02b578a0-aa08-48c5-bd15-972693ff4685 tempest-TestServerVolumeAttachScenarioOldVersion-353574235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:00:39 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-02b578a0-aa08-48c5-bd15-972693ff4685 tempest-TestServerVolumeAttachScenarioOldVersion-353574235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:00:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-02b578a0-aa08-48c5-bd15-972693ff4685 tempest-TestServerVolumeAttachScenarioOldVersion-353574235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:00:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-02b578a0-aa08-48c5-bd15-972693ff4685 tempest-TestServerVolumeAttachScenarioOldVersion-353574235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:00:39 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-637644ee-128b-4706-a2e3-d08f70ac0fa0 tempest-VolumesTransfersV357Test-456529301 None] Created reservations ['4d23d6bd-b83c-4116-b7d8-d90f598cb4c3', 'aded8a1c-d0cb-4b65-9155-5969a1193ac9', '6701902f-be65-4c0c-8c6d-8d518bd45b33', '7a68151d-c73e-4c7b-8c72-929fcdb647cf'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 16:00:39 devstack sudo[104623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 16:00:39 devstack sudo[104623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:00:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-637644ee-128b-4706-a2e3-d08f70ac0fa0 tempest-VolumesTransfersV357Test-456529301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:00:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-637644ee-128b-4706-a2e3-d08f70ac0fa0 tempest-VolumesTransfersV357Test-456529301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:00:39 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-637644ee-128b-4706-a2e3-d08f70ac0fa0 tempest-VolumesTransfersV357Test-456529301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:00:39 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-637644ee-128b-4706-a2e3-d08f70ac0fa0 tempest-VolumesTransfersV357Test-456529301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:00:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-637644ee-128b-4706-a2e3-d08f70ac0fa0 tempest-VolumesTransfersV357Test-456529301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:00:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-637644ee-128b-4706-a2e3-d08f70ac0fa0 tempest-VolumesTransfersV357Test-456529301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:00:39 devstack sudo[104625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 16:00:39 devstack sudo[104625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:00:40 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf40f49d-7017-4545-b6a7-22e3721622b9 tempest-VolumesMetadataTest-1848806551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 16:00:40 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-bf40f49d-7017-4545-b6a7-22e3721622b9 tempest-VolumesMetadataTest-1848806551 None] Flow 'volume_create_manager' (44062c0a-f46d-449b-95b7-ab38ed338f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:00:40 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-bf40f49d-7017-4545-b6a7-22e3721622b9 tempest-VolumesMetadataTest-1848806551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fec425d-c49b-44a4-86d2-2fa989292bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:00:40 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-bf40f49d-7017-4545-b6a7-22e3721622b9 tempest-VolumesMetadataTest-1848806551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fec425d-c49b-44a4-86d2-2fa989292bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:00:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-716381165',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acde5345-8f11-44c6-afc4-19c6e4a2ec9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6851fd15c57b4aabb81ee71e645d7bb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:00:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:00:40Z,use_quota=True,user_id='3e165f8a7e89459aada2c70fc8b8fc58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:00:40 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-bf40f49d-7017-4545-b6a7-22e3721622b9 tempest-VolumesMetadataTest-1848806551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d33faba4-5615-4e7a-9d4f-4be0df0cd4d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:00:40 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-bf40f49d-7017-4545-b6a7-22e3721622b9 tempest-VolumesMetadataTest-1848806551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d33faba4-5615-4e7a-9d4f-4be0df0cd4d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:00:40 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-bf40f49d-7017-4545-b6a7-22e3721622b9 tempest-VolumesMetadataTest-1848806551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db4941f3-f91a-435b-9ddb-a1fc145bc30f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:00:40 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-bf40f49d-7017-4545-b6a7-22e3721622b9 tempest-VolumesMetadataTest-1848806551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db4941f3-f91a-435b-9ddb-a1fc145bc30f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acde5345-8f11-44c6-afc4-19c6e4a2ec9d', 'volume_name': 'volume-acde5345-8f11-44c6-afc4-19c6e4a2ec9d', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:00:40 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-bf40f49d-7017-4545-b6a7-22e3721622b9 tempest-VolumesMetadataTest-1848806551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80c7df30-58d4-4cf5-bd3a-37042dd42dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:00:40 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-bf40f49d-7017-4545-b6a7-22e3721622b9 tempest-VolumesMetadataTest-1848806551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80c7df30-58d4-4cf5-bd3a-37042dd42dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:00:40 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-bf40f49d-7017-4545-b6a7-22e3721622b9 tempest-VolumesMetadataTest-1848806551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7691f66-aa1f-4888-8c78-691a1bc0d9c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:00:40 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-bf40f49d-7017-4545-b6a7-22e3721622b9 tempest-VolumesMetadataTest-1848806551 None] Volume acde5345-8f11-44c6-afc4-19c6e4a2ec9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acde5345-8f11-44c6-afc4-19c6e4a2ec9d', 'volume_size': 1}
Jun 15 16:00:40 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-bf40f49d-7017-4545-b6a7-22e3721622b9 tempest-VolumesMetadataTest-1848806551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:00:40 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-bf40f49d-7017-4545-b6a7-22e3721622b9 tempest-VolumesMetadataTest-1848806551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:00:40 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-bf40f49d-7017-4545-b6a7-22e3721622b9 tempest-VolumesMetadataTest-1848806551 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:00:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-716381165',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acde5345-8f11-44c6-afc4-19c6e4a2ec9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6851fd15c57b4aabb81ee71e645d7bb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:00:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:00:40Z,use_quota=True,user_id='3e165f8a7e89459aada2c70fc8b8fc58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 16:00:40 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-bf40f49d-7017-4545-b6a7-22e3721622b9 tempest-VolumesMetadataTest-1848806551 None] Creating volume acde5345-8f11-44c6-afc4-19c6e4a2ec9d {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 16:00:40 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-bf40f49d-7017-4545-b6a7-22e3721622b9 tempest-VolumesMetadataTest-1848806551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:00:40 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-bf40f49d-7017-4545-b6a7-22e3721622b9 tempest-VolumesMetadataTest-1848806551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:00:40 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-bf40f49d-7017-4545-b6a7-22e3721622b9 tempest-VolumesMetadataTest-1848806551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:00:40 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-bf40f49d-7017-4545-b6a7-22e3721622b9 tempest-VolumesMetadataTest-1848806551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:00:40 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-bf40f49d-7017-4545-b6a7-22e3721622b9 tempest-VolumesMetadataTest-1848806551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:00:40 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-bf40f49d-7017-4545-b6a7-22e3721622b9 tempest-VolumesMetadataTest-1848806551 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 16:00:40 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-bf40f49d-7017-4545-b6a7-22e3721622b9 tempest-VolumesMetadataTest-1848806551 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 16:00:40 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-bf40f49d-7017-4545-b6a7-22e3721622b9 tempest-VolumesMetadataTest-1848806551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-acde5345-8f11-44c6-afc4-19c6e4a2ec9d 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:00:40 devstack sudo[104627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-acde5345-8f11-44c6-afc4-19c6e4a2ec9d 1073741824
Jun 15 16:00:40 devstack sudo[104627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:00:40 devstack sudo[104623]: pam_unix(sudo:session): session closed for user root
Jun 15 16:00:40 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-02b578a0-aa08-48c5-bd15-972693ff4685 tempest-TestServerVolumeAttachScenarioOldVersion-353574235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 1.014s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:00:40 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-02b578a0-aa08-48c5-bd15-972693ff4685 tempest-TestServerVolumeAttachScenarioOldVersion-353574235 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 16:00:40 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-02b578a0-aa08-48c5-bd15-972693ff4685 tempest-TestServerVolumeAttachScenarioOldVersion-353574235 None] Deleted volume successfully.
Jun 15 16:00:40 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-02b578a0-aa08-48c5-bd15-972693ff4685 tempest-TestServerVolumeAttachScenarioOldVersion-353574235 None] Lock "cinder-35b3c089-cc44-450f-b9de-73aafc624c45-delete_volume" released by "delete_volume" :: held 3.132s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:00:40 devstack sudo[104625]: pam_unix(sudo:session): session closed for user root
Jun 15 16:00:40 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-637644ee-128b-4706-a2e3-d08f70ac0fa0 tempest-VolumesTransfersV357Test-456529301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.984s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:00:40 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-637644ee-128b-4706-a2e3-d08f70ac0fa0 tempest-VolumesTransfersV357Test-456529301 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 16:00:40 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-637644ee-128b-4706-a2e3-d08f70ac0fa0 tempest-VolumesTransfersV357Test-456529301 None] Deleted volume successfully.
Jun 15 16:00:40 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-637644ee-128b-4706-a2e3-d08f70ac0fa0 tempest-VolumesTransfersV357Test-456529301 None] Lock "cinder-0aa78890-aa37-4c8f-a69d-8e9d7b60d0ca-delete_volume" released by "delete_volume" :: held 3.004s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:00:41 devstack sudo[104627]: pam_unix(sudo:session): session closed for user root
Jun 15 16:00:41 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-bf40f49d-7017-4545-b6a7-22e3721622b9 tempest-VolumesMetadataTest-1848806551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-acde5345-8f11-44c6-afc4-19c6e4a2ec9d 1073741824" returned: 0 in 1.314s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:00:41 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-bf40f49d-7017-4545-b6a7-22e3721622b9 tempest-VolumesMetadataTest-1848806551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-acde5345-8f11-44c6-afc4-19c6e4a2ec9d {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:00:41 devstack sudo[104674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-acde5345-8f11-44c6-afc4-19c6e4a2ec9d
Jun 15 16:00:41 devstack sudo[104674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:00:42 devstack sudo[104674]: pam_unix(sudo:session): session closed for user root
Jun 15 16:00:42 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-bf40f49d-7017-4545-b6a7-22e3721622b9 tempest-VolumesMetadataTest-1848806551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-acde5345-8f11-44c6-afc4-19c6e4a2ec9d" returned: 0 in 0.749s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:00:42 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-bf40f49d-7017-4545-b6a7-22e3721622b9 tempest-VolumesMetadataTest-1848806551 None] <== create_volume: return (2147ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 16:00:42 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-bf40f49d-7017-4545-b6a7-22e3721622b9 tempest-VolumesMetadataTest-1848806551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.149s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:00:42 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-bf40f49d-7017-4545-b6a7-22e3721622b9 tempest-VolumesMetadataTest-1848806551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7691f66-aa1f-4888-8c78-691a1bc0d9c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acde5345-8f11-44c6-afc4-19c6e4a2ec9d', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:00:42 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-bf40f49d-7017-4545-b6a7-22e3721622b9 tempest-VolumesMetadataTest-1848806551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b43bd975-7c12-42a3-9cb3-da4abd992e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:00:42 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-bf40f49d-7017-4545-b6a7-22e3721622b9 tempest-VolumesMetadataTest-1848806551 None] Volume volume-acde5345-8f11-44c6-afc4-19c6e4a2ec9d (acde5345-8f11-44c6-afc4-19c6e4a2ec9d): created successfully
Jun 15 16:00:42 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-bf40f49d-7017-4545-b6a7-22e3721622b9 tempest-VolumesMetadataTest-1848806551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b43bd975-7c12-42a3-9cb3-da4abd992e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:00:42 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-bf40f49d-7017-4545-b6a7-22e3721622b9 tempest-VolumesMetadataTest-1848806551 None] Flow 'volume_create_manager' (44062c0a-f46d-449b-95b7-ab38ed338f59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:00:42 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-bf40f49d-7017-4545-b6a7-22e3721622b9 tempest-VolumesMetadataTest-1848806551 None] Created volume successfully.
Jun 15 16:00:44 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-aa774670-8d22-49f8-b65d-1a0608e391a7 tempest-VolumesMetadataTest-1848806551 None] Acquiring lock "cinder-acde5345-8f11-44c6-afc4-19c6e4a2ec9d-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:00:44 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-aa774670-8d22-49f8-b65d-1a0608e391a7 tempest-VolumesMetadataTest-1848806551 None] Lock "cinder-acde5345-8f11-44c6-afc4-19c6e4a2ec9d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:00:44 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-aa774670-8d22-49f8-b65d-1a0608e391a7 tempest-VolumesMetadataTest-1848806551 None] Acquiring lock "cinder-quobyte-acde5345-8f11-44c6-afc4-19c6e4a2ec9d" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:00:44 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-aa774670-8d22-49f8-b65d-1a0608e391a7 tempest-VolumesMetadataTest-1848806551 None] Lock "cinder-quobyte-acde5345-8f11-44c6-afc4-19c6e4a2ec9d" acquired by "delete_volume" :: waited 0.019s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:00:44 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc97397-4a95-4826-9b50-e5e77feb05fd]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:00:44 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-aa774670-8d22-49f8-b65d-1a0608e391a7 tempest-VolumesMetadataTest-1848806551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-acde5345-8f11-44c6-afc4-19c6e4a2ec9d {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:00:44 devstack sudo[104682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-acde5345-8f11-44c6-afc4-19c6e4a2ec9d
Jun 15 16:00:44 devstack sudo[104682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:00:45 devstack sudo[104682]: pam_unix(sudo:session): session closed for user root
Jun 15 16:00:45 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-aa774670-8d22-49f8-b65d-1a0608e391a7 tempest-VolumesMetadataTest-1848806551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-acde5345-8f11-44c6-afc4-19c6e4a2ec9d" returned: 0 in 0.761s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:00:45 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-aa774670-8d22-49f8-b65d-1a0608e391a7 tempest-VolumesMetadataTest-1848806551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-acde5345-8f11-44c6-afc4-19c6e4a2ec9d {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:00:45 devstack sudo[104688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-acde5345-8f11-44c6-afc4-19c6e4a2ec9d
Jun 15 16:00:45 devstack sudo[104688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:00:45 devstack sudo[104688]: pam_unix(sudo:session): session closed for user root
Jun 15 16:00:45 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-aa774670-8d22-49f8-b65d-1a0608e391a7 tempest-VolumesMetadataTest-1848806551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-acde5345-8f11-44c6-afc4-19c6e4a2ec9d" returned: 0 in 0.619s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:00:45 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-aa774670-8d22-49f8-b65d-1a0608e391a7 tempest-VolumesMetadataTest-1848806551 None] Lock "cinder-quobyte-acde5345-8f11-44c6-afc4-19c6e4a2ec9d" released by "delete_volume" :: held 1.425s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:00:45 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-aa774670-8d22-49f8-b65d-1a0608e391a7 tempest-VolumesMetadataTest-1848806551 None] Created reservations ['6942fa5c-a172-4e39-a218-ae626621ae46', 'f42e3769-2654-43c4-a4aa-2a75e9bfe929', '1eb5a57f-4619-49d6-9ccd-7bdc72660890', '20aac7be-4544-45ee-9bea-a1ff087c5c4e'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 16:00:45 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-aa774670-8d22-49f8-b65d-1a0608e391a7 tempest-VolumesMetadataTest-1848806551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:00:45 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-aa774670-8d22-49f8-b65d-1a0608e391a7 tempest-VolumesMetadataTest-1848806551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:00:45 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-aa774670-8d22-49f8-b65d-1a0608e391a7 tempest-VolumesMetadataTest-1848806551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:00:45 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-aa774670-8d22-49f8-b65d-1a0608e391a7 tempest-VolumesMetadataTest-1848806551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:00:45 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-aa774670-8d22-49f8-b65d-1a0608e391a7 tempest-VolumesMetadataTest-1848806551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:00:45 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-aa774670-8d22-49f8-b65d-1a0608e391a7 tempest-VolumesMetadataTest-1848806551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:00:45 devstack sudo[104691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 16:00:45 devstack sudo[104691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:00:46 devstack sudo[104691]: pam_unix(sudo:session): session closed for user root
Jun 15 16:00:46 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-aa774670-8d22-49f8-b65d-1a0608e391a7 tempest-VolumesMetadataTest-1848806551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.646s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:00:46 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-aa774670-8d22-49f8-b65d-1a0608e391a7 tempest-VolumesMetadataTest-1848806551 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 16:00:46 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-aa774670-8d22-49f8-b65d-1a0608e391a7 tempest-VolumesMetadataTest-1848806551 None] Deleted volume successfully.
Jun 15 16:00:46 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-aa774670-8d22-49f8-b65d-1a0608e391a7 tempest-VolumesMetadataTest-1848806551 None] Lock "cinder-acde5345-8f11-44c6-afc4-19c6e4a2ec9d-delete_volume" released by "delete_volume" :: held 2.302s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:00:50 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-c71cb37a-608a-4295-b8e0-f1620e8e6886 tempest-VolumesCloneTest-780036490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 16:00:50 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-c71cb37a-608a-4295-b8e0-f1620e8e6886 tempest-VolumesCloneTest-780036490 None] Flow 'volume_create_manager' (81f45d94-aa86-4ab2-ab55-89cc25c40f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:00:50 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-c71cb37a-608a-4295-b8e0-f1620e8e6886 tempest-VolumesCloneTest-780036490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feb56f9c-3e7b-43e2-898b-262fcb775d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:00:50 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-c71cb37a-608a-4295-b8e0-f1620e8e6886 tempest-VolumesCloneTest-780036490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feb56f9c-3e7b-43e2-898b-262fcb775d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:00:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1936331461',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=726da0ec-3cf4-402e-824e-e6a60f280a60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5755dffb90041a5b5c0b8a3d991163f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:00:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:00:50Z,use_quota=True,user_id='8d9aba92a8e14409b11bba0007740bee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:00:50 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-c71cb37a-608a-4295-b8e0-f1620e8e6886 tempest-VolumesCloneTest-780036490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a06a06c-005d-4d1c-8f7c-901b1777bc4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:00:50 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-c71cb37a-608a-4295-b8e0-f1620e8e6886 tempest-VolumesCloneTest-780036490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a06a06c-005d-4d1c-8f7c-901b1777bc4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:00:50 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-c71cb37a-608a-4295-b8e0-f1620e8e6886 tempest-VolumesCloneTest-780036490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e530aaaf-c4df-4855-a6e2-7f9436443662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:00:50 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-c71cb37a-608a-4295-b8e0-f1620e8e6886 tempest-VolumesCloneTest-780036490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e530aaaf-c4df-4855-a6e2-7f9436443662) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '726da0ec-3cf4-402e-824e-e6a60f280a60', 'volume_name': 'volume-726da0ec-3cf4-402e-824e-e6a60f280a60', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:00:50 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-c71cb37a-608a-4295-b8e0-f1620e8e6886 tempest-VolumesCloneTest-780036490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d259cd5-9f70-4f8d-ab48-793bd0bb5319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:00:50 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-c71cb37a-608a-4295-b8e0-f1620e8e6886 tempest-VolumesCloneTest-780036490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d259cd5-9f70-4f8d-ab48-793bd0bb5319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:00:50 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-c71cb37a-608a-4295-b8e0-f1620e8e6886 tempest-VolumesCloneTest-780036490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7eb7acc3-909f-4f1d-a99a-b68d62ad5eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:00:50 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-c71cb37a-608a-4295-b8e0-f1620e8e6886 tempest-VolumesCloneTest-780036490 None] Volume 726da0ec-3cf4-402e-824e-e6a60f280a60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-726da0ec-3cf4-402e-824e-e6a60f280a60', 'volume_size': 1}
Jun 15 16:00:50 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-c71cb37a-608a-4295-b8e0-f1620e8e6886 tempest-VolumesCloneTest-780036490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:00:50 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-c71cb37a-608a-4295-b8e0-f1620e8e6886 tempest-VolumesCloneTest-780036490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:00:50 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-c71cb37a-608a-4295-b8e0-f1620e8e6886 tempest-VolumesCloneTest-780036490 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:00:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1936331461',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=726da0ec-3cf4-402e-824e-e6a60f280a60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5755dffb90041a5b5c0b8a3d991163f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:00:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:00:50Z,use_quota=True,user_id='8d9aba92a8e14409b11bba0007740bee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 16:00:50 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-c71cb37a-608a-4295-b8e0-f1620e8e6886 tempest-VolumesCloneTest-780036490 None] Creating volume 726da0ec-3cf4-402e-824e-e6a60f280a60 {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 16:00:50 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-c71cb37a-608a-4295-b8e0-f1620e8e6886 tempest-VolumesCloneTest-780036490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:00:50 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-c71cb37a-608a-4295-b8e0-f1620e8e6886 tempest-VolumesCloneTest-780036490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:00:50 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-c71cb37a-608a-4295-b8e0-f1620e8e6886 tempest-VolumesCloneTest-780036490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:00:50 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-c71cb37a-608a-4295-b8e0-f1620e8e6886 tempest-VolumesCloneTest-780036490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:00:50 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-c71cb37a-608a-4295-b8e0-f1620e8e6886 tempest-VolumesCloneTest-780036490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:00:50 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-c71cb37a-608a-4295-b8e0-f1620e8e6886 tempest-VolumesCloneTest-780036490 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 16:00:50 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-c71cb37a-608a-4295-b8e0-f1620e8e6886 tempest-VolumesCloneTest-780036490 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 16:00:50 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c71cb37a-608a-4295-b8e0-f1620e8e6886 tempest-VolumesCloneTest-780036490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-726da0ec-3cf4-402e-824e-e6a60f280a60 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:00:50 devstack sudo[104695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-726da0ec-3cf4-402e-824e-e6a60f280a60 1073741824
Jun 15 16:00:50 devstack sudo[104695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:00:51 devstack sudo[104695]: pam_unix(sudo:session): session closed for user root
Jun 15 16:00:51 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c71cb37a-608a-4295-b8e0-f1620e8e6886 tempest-VolumesCloneTest-780036490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-726da0ec-3cf4-402e-824e-e6a60f280a60 1073741824" returned: 0 in 0.877s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:00:51 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c71cb37a-608a-4295-b8e0-f1620e8e6886 tempest-VolumesCloneTest-780036490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-726da0ec-3cf4-402e-824e-e6a60f280a60 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:00:51 devstack sudo[104704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-726da0ec-3cf4-402e-824e-e6a60f280a60
Jun 15 16:00:51 devstack sudo[104704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:00:52 devstack sudo[104704]: pam_unix(sudo:session): session closed for user root
Jun 15 16:00:52 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c71cb37a-608a-4295-b8e0-f1620e8e6886 tempest-VolumesCloneTest-780036490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-726da0ec-3cf4-402e-824e-e6a60f280a60" returned: 0 in 0.732s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:00:52 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-c71cb37a-608a-4295-b8e0-f1620e8e6886 tempest-VolumesCloneTest-780036490 None] <== create_volume: return (1661ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 16:00:52 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-c71cb37a-608a-4295-b8e0-f1620e8e6886 tempest-VolumesCloneTest-780036490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.663s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:00:52 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-c71cb37a-608a-4295-b8e0-f1620e8e6886 tempest-VolumesCloneTest-780036490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7eb7acc3-909f-4f1d-a99a-b68d62ad5eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-726da0ec-3cf4-402e-824e-e6a60f280a60', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:00:52 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-c71cb37a-608a-4295-b8e0-f1620e8e6886 tempest-VolumesCloneTest-780036490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64f0c77e-4dd2-4d6a-a2ad-d658120a8b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:00:52 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-c71cb37a-608a-4295-b8e0-f1620e8e6886 tempest-VolumesCloneTest-780036490 None] Volume volume-726da0ec-3cf4-402e-824e-e6a60f280a60 (726da0ec-3cf4-402e-824e-e6a60f280a60): created successfully
Jun 15 16:00:52 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-c71cb37a-608a-4295-b8e0-f1620e8e6886 tempest-VolumesCloneTest-780036490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64f0c77e-4dd2-4d6a-a2ad-d658120a8b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:00:52 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-c71cb37a-608a-4295-b8e0-f1620e8e6886 tempest-VolumesCloneTest-780036490 None] Flow 'volume_create_manager' (81f45d94-aa86-4ab2-ab55-89cc25c40f1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:00:52 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-c71cb37a-608a-4295-b8e0-f1620e8e6886 tempest-VolumesCloneTest-780036490 None] Created volume successfully.
Jun 15 16:00:53 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad084672-7af9-43ae-92e9-6904db80f2b5 tempest-VolumesCloneTest-780036490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 16:00:53 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-ad084672-7af9-43ae-92e9-6904db80f2b5 tempest-VolumesCloneTest-780036490 None] Flow 'volume_create_manager' (45c075db-ea38-49dd-8c83-870dcc1d0e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:00:53 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-ad084672-7af9-43ae-92e9-6904db80f2b5 tempest-VolumesCloneTest-780036490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4637207c-4a2d-4156-80ea-1663f8b08f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:00:53 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-ad084672-7af9-43ae-92e9-6904db80f2b5 tempest-VolumesCloneTest-780036490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4637207c-4a2d-4156-80ea-1663f8b08f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:00:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-572662018',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dff7b04-ccfe-4678-8883-f0ec27e52bea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5755dffb90041a5b5c0b8a3d991163f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:00:53Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=726da0ec-3cf4-402e-824e-e6a60f280a60,status='creating',terminated_at=None,updated_at=2026-06-15T14:00:53Z,use_quota=True,user_id='8d9aba92a8e14409b11bba0007740bee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:00:53 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-ad084672-7af9-43ae-92e9-6904db80f2b5 tempest-VolumesCloneTest-780036490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14f2d356-e77d-4bb4-ba78-03d69d1fc0c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:00:53 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-ad084672-7af9-43ae-92e9-6904db80f2b5 tempest-VolumesCloneTest-780036490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14f2d356-e77d-4bb4-ba78-03d69d1fc0c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:00:53 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-ad084672-7af9-43ae-92e9-6904db80f2b5 tempest-VolumesCloneTest-780036490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cc5814e-a360-4f18-8bc7-a0547e9e918e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:00:53 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-ad084672-7af9-43ae-92e9-6904db80f2b5 tempest-VolumesCloneTest-780036490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cc5814e-a360-4f18-8bc7-a0547e9e918e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '1dff7b04-ccfe-4678-8883-f0ec27e52bea', 'volume_name': 'volume-1dff7b04-ccfe-4678-8883-f0ec27e52bea', 'volume_size': 2, 'source_volid': '726da0ec-3cf4-402e-824e-e6a60f280a60', 'source_volstatus': 'available'}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:00:53 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-ad084672-7af9-43ae-92e9-6904db80f2b5 tempest-VolumesCloneTest-780036490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbf39511-9be0-4155-803d-dea1c20d9c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:00:53 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-ad084672-7af9-43ae-92e9-6904db80f2b5 tempest-VolumesCloneTest-780036490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbf39511-9be0-4155-803d-dea1c20d9c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:00:53 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-ad084672-7af9-43ae-92e9-6904db80f2b5 tempest-VolumesCloneTest-780036490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de114422-7557-4aaa-a693-34e7880340bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:00:53 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-ad084672-7af9-43ae-92e9-6904db80f2b5 tempest-VolumesCloneTest-780036490 None] Volume 1dff7b04-ccfe-4678-8883-f0ec27e52bea: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-1dff7b04-ccfe-4678-8883-f0ec27e52bea', 'volume_size': 2, 'source_volid': '726da0ec-3cf4-402e-824e-e6a60f280a60', 'source_volstatus': 'available'}
Jun 15 16:00:53 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-ad084672-7af9-43ae-92e9-6904db80f2b5 tempest-VolumesCloneTest-780036490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:00:53 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-ad084672-7af9-43ae-92e9-6904db80f2b5 tempest-VolumesCloneTest-780036490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:00:53 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-ad084672-7af9-43ae-92e9-6904db80f2b5 tempest-VolumesCloneTest-780036490 None] Cloning volume 726da0ec-3cf4-402e-824e-e6a60f280a60 to volume 1dff7b04-ccfe-4678-8883-f0ec27e52bea
Jun 15 16:00:53 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-ad084672-7af9-43ae-92e9-6904db80f2b5 tempest-VolumesCloneTest-780036490 None] Creating offline snapshot da887c80-f5a8-4df3-9546-d03c89167e6b of volume 726da0ec-3cf4-402e-824e-e6a60f280a60 {{(pid=91863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 15 16:00:53 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[206ca1c3-4f23-44a5-b9fd-f5dd2aedfa18]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:00:53 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ad084672-7af9-43ae-92e9-6904db80f2b5 tempest-VolumesCloneTest-780036490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-726da0ec-3cf4-402e-824e-e6a60f280a60 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:00:53 devstack sudo[104707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-726da0ec-3cf4-402e-824e-e6a60f280a60
Jun 15 16:00:53 devstack sudo[104707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:00:54 devstack sudo[104707]: pam_unix(sudo:session): session closed for user root
Jun 15 16:00:54 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ad084672-7af9-43ae-92e9-6904db80f2b5 tempest-VolumesCloneTest-780036490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-726da0ec-3cf4-402e-824e-e6a60f280a60" returned: 0 in 0.958s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:00:54 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ad084672-7af9-43ae-92e9-6904db80f2b5 tempest-VolumesCloneTest-780036490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-726da0ec-3cf4-402e-824e-e6a60f280a60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-726da0ec-3cf4-402e-824e-e6a60f280a60.da887c80-f5a8-4df3-9546-d03c89167e6b 1G {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:00:54 devstack sudo[104712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-726da0ec-3cf4-402e-824e-e6a60f280a60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-726da0ec-3cf4-402e-824e-e6a60f280a60.da887c80-f5a8-4df3-9546-d03c89167e6b 1G
Jun 15 16:00:54 devstack sudo[104712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:00:55 devstack sudo[104712]: pam_unix(sudo:session): session closed for user root
Jun 15 16:00:55 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ad084672-7af9-43ae-92e9-6904db80f2b5 tempest-VolumesCloneTest-780036490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-726da0ec-3cf4-402e-824e-e6a60f280a60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-726da0ec-3cf4-402e-824e-e6a60f280a60.da887c80-f5a8-4df3-9546-d03c89167e6b 1G" returned: 0 in 0.916s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:00:55 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ad084672-7af9-43ae-92e9-6904db80f2b5 tempest-VolumesCloneTest-780036490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-726da0ec-3cf4-402e-824e-e6a60f280a60 -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-726da0ec-3cf4-402e-824e-e6a60f280a60.da887c80-f5a8-4df3-9546-d03c89167e6b {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:00:55 devstack sudo[104719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-726da0ec-3cf4-402e-824e-e6a60f280a60 -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-726da0ec-3cf4-402e-824e-e6a60f280a60.da887c80-f5a8-4df3-9546-d03c89167e6b
Jun 15 16:00:55 devstack sudo[104719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:00:55 devstack sudo[104719]: pam_unix(sudo:session): session closed for user root
Jun 15 16:00:55 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ad084672-7af9-43ae-92e9-6904db80f2b5 tempest-VolumesCloneTest-780036490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-726da0ec-3cf4-402e-824e-e6a60f280a60 -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-726da0ec-3cf4-402e-824e-e6a60f280a60.da887c80-f5a8-4df3-9546-d03c89167e6b" returned: 0 in 0.763s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:00:55 devstack cinder-volume[91863]: WARNING cinder.volume.drivers.remotefs [None req-ad084672-7af9-43ae-92e9-6904db80f2b5 tempest-VolumesCloneTest-780036490 None] /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-726da0ec-3cf4-402e-824e-e6a60f280a60.da887c80-f5a8-4df3-9546-d03c89167e6b is being set with open permissions: ugo+rw
Jun 15 16:00:55 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ad084672-7af9-43ae-92e9-6904db80f2b5 tempest-VolumesCloneTest-780036490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-726da0ec-3cf4-402e-824e-e6a60f280a60.da887c80-f5a8-4df3-9546-d03c89167e6b {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:00:55 devstack sudo[104724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-726da0ec-3cf4-402e-824e-e6a60f280a60.da887c80-f5a8-4df3-9546-d03c89167e6b
Jun 15 16:00:55 devstack sudo[104724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:00:56 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e164b31-acf0-4b72-9aae-7d71a3680759 tempest-VolumesActionsTest-1879812582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 16:00:56 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8e164b31-acf0-4b72-9aae-7d71a3680759 tempest-VolumesActionsTest-1879812582 None] Flow 'volume_create_manager' (08a75469-4caa-412c-9436-f364fa81bfb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:00:56 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8e164b31-acf0-4b72-9aae-7d71a3680759 tempest-VolumesActionsTest-1879812582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef1b9e13-1808-4adb-9dd2-17df0227e8a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:00:56 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8e164b31-acf0-4b72-9aae-7d71a3680759 tempest-VolumesActionsTest-1879812582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef1b9e13-1808-4adb-9dd2-17df0227e8a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:00:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-40374982',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15763aef-e495-466a-b919-a0bb6171f0cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ede134825e954a74af97158283f22d1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:00:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:00:56Z,use_quota=True,user_id='c5bc21acf6e84aaeb2dea8d8c1e1905c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:00:56 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8e164b31-acf0-4b72-9aae-7d71a3680759 tempest-VolumesActionsTest-1879812582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86b07c9f-0bfa-45ba-9b56-0a7305bb040e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:00:56 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8e164b31-acf0-4b72-9aae-7d71a3680759 tempest-VolumesActionsTest-1879812582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86b07c9f-0bfa-45ba-9b56-0a7305bb040e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:00:56 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8e164b31-acf0-4b72-9aae-7d71a3680759 tempest-VolumesActionsTest-1879812582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db17a16a-9c0d-4ff3-8618-4a44df10e7ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:00:56 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8e164b31-acf0-4b72-9aae-7d71a3680759 tempest-VolumesActionsTest-1879812582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db17a16a-9c0d-4ff3-8618-4a44df10e7ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15763aef-e495-466a-b919-a0bb6171f0cf', 'volume_name': 'volume-15763aef-e495-466a-b919-a0bb6171f0cf', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:00:56 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8e164b31-acf0-4b72-9aae-7d71a3680759 tempest-VolumesActionsTest-1879812582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d303bc6-e7be-4993-88fd-7be3d820add8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:00:56 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8e164b31-acf0-4b72-9aae-7d71a3680759 tempest-VolumesActionsTest-1879812582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d303bc6-e7be-4993-88fd-7be3d820add8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:00:56 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8e164b31-acf0-4b72-9aae-7d71a3680759 tempest-VolumesActionsTest-1879812582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bde68b34-ec08-4012-97e8-9d14a4090328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:00:56 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-8e164b31-acf0-4b72-9aae-7d71a3680759 tempest-VolumesActionsTest-1879812582 None] Volume 15763aef-e495-466a-b919-a0bb6171f0cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15763aef-e495-466a-b919-a0bb6171f0cf', 'volume_size': 1}
Jun 15 16:00:56 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-8e164b31-acf0-4b72-9aae-7d71a3680759 tempest-VolumesActionsTest-1879812582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:00:56 devstack sudo[104724]: pam_unix(sudo:session): session closed for user root
Jun 15 16:00:56 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ad084672-7af9-43ae-92e9-6904db80f2b5 tempest-VolumesCloneTest-780036490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-726da0ec-3cf4-402e-824e-e6a60f280a60.da887c80-f5a8-4df3-9546-d03c89167e6b" returned: 0 in 0.698s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:00:56 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ad084672-7af9-43ae-92e9-6904db80f2b5 tempest-VolumesCloneTest-780036490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-726da0ec-3cf4-402e-824e-e6a60f280a60.info {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:00:56 devstack sudo[104727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-726da0ec-3cf4-402e-824e-e6a60f280a60.info
Jun 15 16:00:56 devstack sudo[104727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:00:57 devstack sudo[104727]: pam_unix(sudo:session): session closed for user root
Jun 15 16:00:57 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ad084672-7af9-43ae-92e9-6904db80f2b5 tempest-VolumesCloneTest-780036490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-726da0ec-3cf4-402e-824e-e6a60f280a60.info" returned: 0 in 0.632s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:00:57 devstack cinder-volume[91863]: WARNING cinder.volume.drivers.remotefs [None req-ad084672-7af9-43ae-92e9-6904db80f2b5 tempest-VolumesCloneTest-780036490 None] /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-726da0ec-3cf4-402e-824e-e6a60f280a60.info is being set with open permissions: ugo+rw
Jun 15 16:00:57 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ad084672-7af9-43ae-92e9-6904db80f2b5 tempest-VolumesCloneTest-780036490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-726da0ec-3cf4-402e-824e-e6a60f280a60.info {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:00:57 devstack sudo[104730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-726da0ec-3cf4-402e-824e-e6a60f280a60.info
Jun 15 16:00:57 devstack sudo[104730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:00:57 devstack sudo[104730]: pam_unix(sudo:session): session closed for user root
Jun 15 16:00:57 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ad084672-7af9-43ae-92e9-6904db80f2b5 tempest-VolumesCloneTest-780036490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-726da0ec-3cf4-402e-824e-e6a60f280a60.info" returned: 0 in 0.628s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:00:57 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-ad084672-7af9-43ae-92e9-6904db80f2b5 tempest-VolumesCloneTest-780036490 None] Acquiring lock "cinder-quobyte-1dff7b04-ccfe-4678-8883-f0ec27e52bea" by "_copy_volume_from_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:00:57 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-ad084672-7af9-43ae-92e9-6904db80f2b5 tempest-VolumesCloneTest-780036490 None] Lock "cinder-quobyte-1dff7b04-ccfe-4678-8883-f0ec27e52bea" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:00:57 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-ad084672-7af9-43ae-92e9-6904db80f2b5 tempest-VolumesCloneTest-780036490 None] snapshot: da887c80-f5a8-4df3-9546-d03c89167e6b, volume: 1dff7b04-ccfe-4678-8883-f0ec27e52bea,  {{(pid=91863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 15 16:00:57 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-ad084672-7af9-43ae-92e9-6904db80f2b5 tempest-VolumesCloneTest-780036490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:00:57 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-ad084672-7af9-43ae-92e9-6904db80f2b5 tempest-VolumesCloneTest-780036490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:00:57 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-ad084672-7af9-43ae-92e9-6904db80f2b5 tempest-VolumesCloneTest-780036490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:00:57 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-ad084672-7af9-43ae-92e9-6904db80f2b5 tempest-VolumesCloneTest-780036490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:00:57 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-ad084672-7af9-43ae-92e9-6904db80f2b5 tempest-VolumesCloneTest-780036490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:00:57 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c4a448-43ed-4043-ab87-0d0b0c5f6ff0]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:00:57 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ad084672-7af9-43ae-92e9-6904db80f2b5 tempest-VolumesCloneTest-780036490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-726da0ec-3cf4-402e-824e-e6a60f280a60.da887c80-f5a8-4df3-9546-d03c89167e6b {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:00:58 devstack sudo[104733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-726da0ec-3cf4-402e-824e-e6a60f280a60.da887c80-f5a8-4df3-9546-d03c89167e6b
Jun 15 16:00:58 devstack sudo[104733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:00:58 devstack sudo[104733]: pam_unix(sudo:session): session closed for user root
Jun 15 16:00:58 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ad084672-7af9-43ae-92e9-6904db80f2b5 tempest-VolumesCloneTest-780036490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-726da0ec-3cf4-402e-824e-e6a60f280a60.da887c80-f5a8-4df3-9546-d03c89167e6b" returned: 0 in 0.728s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:00:58 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-ad084672-7af9-43ae-92e9-6904db80f2b5 tempest-VolumesCloneTest-780036490 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-726da0ec-3cf4-402e-824e-e6a60f280a60(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 16:00:58 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-ad084672-7af9-43ae-92e9-6904db80f2b5 tempest-VolumesCloneTest-780036490 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-726da0ec-3cf4-402e-824e-e6a60f280a60 {{(pid=91863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 15 16:00:58 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-ad084672-7af9-43ae-92e9-6904db80f2b5 tempest-VolumesCloneTest-780036490 None] Creating direct copy from snapshot {{(pid=91863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 15 16:00:58 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[60df8fb2-6ebd-400b-984f-60536f5d7001]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:00:58 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ad084672-7af9-43ae-92e9-6904db80f2b5 tempest-VolumesCloneTest-780036490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-726da0ec-3cf4-402e-824e-e6a60f280a60 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:00:58 devstack sudo[104739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-726da0ec-3cf4-402e-824e-e6a60f280a60
Jun 15 16:00:58 devstack sudo[104739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:00:59 devstack sudo[104739]: pam_unix(sudo:session): session closed for user root
Jun 15 16:00:59 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ad084672-7af9-43ae-92e9-6904db80f2b5 tempest-VolumesCloneTest-780036490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-726da0ec-3cf4-402e-824e-e6a60f280a60" returned: 0 in 0.699s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:00:59 devstack cinder-volume[91863]: DEBUG cinder.utils [None req-ad084672-7af9-43ae-92e9-6904db80f2b5 tempest-VolumesCloneTest-780036490 None] Path /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1dff7b04-ccfe-4678-8883-f0ec27e52bea not found in is_blk_device check {{(pid=91863) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 15 16:00:59 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ad084672-7af9-43ae-92e9-6904db80f2b5 tempest-VolumesCloneTest-780036490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-726da0ec-3cf4-402e-824e-e6a60f280a60 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1dff7b04-ccfe-4678-8883-f0ec27e52bea {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:00:59 devstack sudo[104745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-726da0ec-3cf4-402e-824e-e6a60f280a60 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1dff7b04-ccfe-4678-8883-f0ec27e52bea
Jun 15 16:00:59 devstack sudo[104745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:01:04 devstack sudo[104745]: pam_unix(sudo:session): session closed for user root
Jun 15 16:01:04 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ad084672-7af9-43ae-92e9-6904db80f2b5 tempest-VolumesCloneTest-780036490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-726da0ec-3cf4-402e-824e-e6a60f280a60 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1dff7b04-ccfe-4678-8883-f0ec27e52bea" returned: 0 in 5.300s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:01:04 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee598be-c058-479e-bcd6-8a5b7c53c521]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:01:04 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ad084672-7af9-43ae-92e9-6904db80f2b5 tempest-VolumesCloneTest-780036490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-726da0ec-3cf4-402e-824e-e6a60f280a60 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:01:04 devstack sudo[104760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-726da0ec-3cf4-402e-824e-e6a60f280a60
Jun 15 16:01:04 devstack sudo[104760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:01:05 devstack sudo[104760]: pam_unix(sudo:session): session closed for user root
Jun 15 16:01:05 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ad084672-7af9-43ae-92e9-6904db80f2b5 tempest-VolumesCloneTest-780036490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-726da0ec-3cf4-402e-824e-e6a60f280a60" returned: 0 in 0.865s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:01:05 devstack cinder-volume[91863]: DEBUG cinder.image.image_utils [None req-ad084672-7af9-43ae-92e9-6904db80f2b5 tempest-VolumesCloneTest-780036490 None] Image conversion details: src /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-726da0ec-3cf4-402e-824e-e6a60f280a60, size 1024.00 MB, duration 5.30 sec, destination /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1dff7b04-ccfe-4678-8883-f0ec27e52bea {{(pid=91863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 15 16:01:05 devstack cinder-volume[91863]: INFO cinder.image.image_utils [None req-ad084672-7af9-43ae-92e9-6904db80f2b5 tempest-VolumesCloneTest-780036490 None] Converted 1024.00 MB image at 193.16 MB/s
Jun 15 16:01:05 devstack cinder-volume[91863]: WARNING cinder.volume.drivers.remotefs [None req-ad084672-7af9-43ae-92e9-6904db80f2b5 tempest-VolumesCloneTest-780036490 None] /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1dff7b04-ccfe-4678-8883-f0ec27e52bea is being set with open permissions: ugo+rw
Jun 15 16:01:05 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ad084672-7af9-43ae-92e9-6904db80f2b5 tempest-VolumesCloneTest-780036490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1dff7b04-ccfe-4678-8883-f0ec27e52bea {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:01:05 devstack sudo[104765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1dff7b04-ccfe-4678-8883-f0ec27e52bea
Jun 15 16:01:05 devstack sudo[104765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:01:06 devstack sudo[104765]: pam_unix(sudo:session): session closed for user root
Jun 15 16:01:06 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ad084672-7af9-43ae-92e9-6904db80f2b5 tempest-VolumesCloneTest-780036490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1dff7b04-ccfe-4678-8883-f0ec27e52bea" returned: 0 in 0.606s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:01:06 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-ad084672-7af9-43ae-92e9-6904db80f2b5 tempest-VolumesCloneTest-780036490 None] Lock "cinder-quobyte-1dff7b04-ccfe-4678-8883-f0ec27e52bea" released by "_copy_volume_from_snapshot" :: held 8.301s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:01:06 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-ad084672-7af9-43ae-92e9-6904db80f2b5 tempest-VolumesCloneTest-780036490 None] Acquiring lock "cinder-quobyte-da887c80-f5a8-4df3-9546-d03c89167e6b" by "_delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:01:06 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-ad084672-7af9-43ae-92e9-6904db80f2b5 tempest-VolumesCloneTest-780036490 None] Lock "cinder-quobyte-da887c80-f5a8-4df3-9546-d03c89167e6b" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:01:06 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-ad084672-7af9-43ae-92e9-6904db80f2b5 tempest-VolumesCloneTest-780036490 None] Deleting offline snapshot da887c80-f5a8-4df3-9546-d03c89167e6b of volume 726da0ec-3cf4-402e-824e-e6a60f280a60 {{(pid=91863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 15 16:01:06 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-ad084672-7af9-43ae-92e9-6904db80f2b5 tempest-VolumesCloneTest-780036490 None] snapshot_file for this snap is: volume-726da0ec-3cf4-402e-824e-e6a60f280a60.da887c80-f5a8-4df3-9546-d03c89167e6b {{(pid=91863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 15 16:01:06 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bfde304-a6c0-4bfe-96f1-bdd7f7d5df3c]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:01:06 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ad084672-7af9-43ae-92e9-6904db80f2b5 tempest-VolumesCloneTest-780036490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-726da0ec-3cf4-402e-824e-e6a60f280a60.da887c80-f5a8-4df3-9546-d03c89167e6b {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:01:06 devstack sudo[104769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-726da0ec-3cf4-402e-824e-e6a60f280a60.da887c80-f5a8-4df3-9546-d03c89167e6b
Jun 15 16:01:06 devstack sudo[104769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:01:07 devstack sudo[104769]: pam_unix(sudo:session): session closed for user root
Jun 15 16:01:07 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ad084672-7af9-43ae-92e9-6904db80f2b5 tempest-VolumesCloneTest-780036490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-726da0ec-3cf4-402e-824e-e6a60f280a60.da887c80-f5a8-4df3-9546-d03c89167e6b" returned: 0 in 0.727s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:01:07 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-ad084672-7af9-43ae-92e9-6904db80f2b5 tempest-VolumesCloneTest-780036490 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-726da0ec-3cf4-402e-824e-e6a60f280a60(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 16:01:07 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[596a5e0f-9cc7-4d2d-a205-dec4f79c9301]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:01:07 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ad084672-7af9-43ae-92e9-6904db80f2b5 tempest-VolumesCloneTest-780036490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-726da0ec-3cf4-402e-824e-e6a60f280a60 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:01:07 devstack sudo[104775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-726da0ec-3cf4-402e-824e-e6a60f280a60
Jun 15 16:01:07 devstack sudo[104775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:01:07 devstack sudo[104775]: pam_unix(sudo:session): session closed for user root
Jun 15 16:01:07 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ad084672-7af9-43ae-92e9-6904db80f2b5 tempest-VolumesCloneTest-780036490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-726da0ec-3cf4-402e-824e-e6a60f280a60" returned: 0 in 0.778s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:01:07 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ad084672-7af9-43ae-92e9-6904db80f2b5 tempest-VolumesCloneTest-780036490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-726da0ec-3cf4-402e-824e-e6a60f280a60.da887c80-f5a8-4df3-9546-d03c89167e6b {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:01:07 devstack sudo[104780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-726da0ec-3cf4-402e-824e-e6a60f280a60.da887c80-f5a8-4df3-9546-d03c89167e6b
Jun 15 16:01:07 devstack sudo[104780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:01:08 devstack sudo[104780]: pam_unix(sudo:session): session closed for user root
Jun 15 16:01:08 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ad084672-7af9-43ae-92e9-6904db80f2b5 tempest-VolumesCloneTest-780036490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-726da0ec-3cf4-402e-824e-e6a60f280a60.da887c80-f5a8-4df3-9546-d03c89167e6b" returned: 0 in 0.739s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:01:08 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ad084672-7af9-43ae-92e9-6904db80f2b5 tempest-VolumesCloneTest-780036490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-726da0ec-3cf4-402e-824e-e6a60f280a60.da887c80-f5a8-4df3-9546-d03c89167e6b {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:01:08 devstack sudo[104785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-726da0ec-3cf4-402e-824e-e6a60f280a60.da887c80-f5a8-4df3-9546-d03c89167e6b
Jun 15 16:01:08 devstack sudo[104785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:01:09 devstack cinder-volume[91863]: DEBUG dbcounter [-] [91863] Writing DB stats cinder:SELECT=70,cinder:UPDATE=90,cinder:INSERT=20,cinder:DELETE=6 {{(pid=91863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 16:01:09 devstack sudo[104785]: pam_unix(sudo:session): session closed for user root
Jun 15 16:01:09 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ad084672-7af9-43ae-92e9-6904db80f2b5 tempest-VolumesCloneTest-780036490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-726da0ec-3cf4-402e-824e-e6a60f280a60.da887c80-f5a8-4df3-9546-d03c89167e6b" returned: 0 in 0.596s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:01:09 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-ad084672-7af9-43ae-92e9-6904db80f2b5 tempest-VolumesCloneTest-780036490 None] Lock "cinder-quobyte-da887c80-f5a8-4df3-9546-d03c89167e6b" released by "_delete_snapshot" :: held 2.964s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:01:09 devstack cinder-volume[91863]: DEBUG dbcounter [-] [91863] Writing DB stats cinder:SELECT=79,cinder:UPDATE=84,cinder:INSERT=24,cinder:DELETE=9 {{(pid=91863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 16:01:09 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-ad084672-7af9-43ae-92e9-6904db80f2b5 tempest-VolumesCloneTest-780036490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.074s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:01:09 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-8e164b31-acf0-4b72-9aae-7d71a3680759 tempest-VolumesActionsTest-1879812582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.736s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:01:09 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-8e164b31-acf0-4b72-9aae-7d71a3680759 tempest-VolumesActionsTest-1879812582 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:00:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-40374982',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15763aef-e495-466a-b919-a0bb6171f0cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ede134825e954a74af97158283f22d1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:00:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:00:56Z,use_quota=True,user_id='c5bc21acf6e84aaeb2dea8d8c1e1905c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 16:01:09 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-8e164b31-acf0-4b72-9aae-7d71a3680759 tempest-VolumesActionsTest-1879812582 None] Creating volume 15763aef-e495-466a-b919-a0bb6171f0cf {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 16:01:09 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-8e164b31-acf0-4b72-9aae-7d71a3680759 tempest-VolumesActionsTest-1879812582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:01:09 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-8e164b31-acf0-4b72-9aae-7d71a3680759 tempest-VolumesActionsTest-1879812582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:01:09 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-8e164b31-acf0-4b72-9aae-7d71a3680759 tempest-VolumesActionsTest-1879812582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:01:09 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-8e164b31-acf0-4b72-9aae-7d71a3680759 tempest-VolumesActionsTest-1879812582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:01:09 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-8e164b31-acf0-4b72-9aae-7d71a3680759 tempest-VolumesActionsTest-1879812582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:01:09 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-8e164b31-acf0-4b72-9aae-7d71a3680759 tempest-VolumesActionsTest-1879812582 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 16:01:09 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-8e164b31-acf0-4b72-9aae-7d71a3680759 tempest-VolumesActionsTest-1879812582 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 16:01:09 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-8e164b31-acf0-4b72-9aae-7d71a3680759 tempest-VolumesActionsTest-1879812582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-15763aef-e495-466a-b919-a0bb6171f0cf 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:01:09 devstack sudo[104788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-15763aef-e495-466a-b919-a0bb6171f0cf 1073741824
Jun 15 16:01:09 devstack sudo[104788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:01:09 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-ad084672-7af9-43ae-92e9-6904db80f2b5 tempest-VolumesCloneTest-780036490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de114422-7557-4aaa-a693-34e7880340bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1dff7b04-ccfe-4678-8883-f0ec27e52bea', 'volume_size': 2, 'source_volid': '726da0ec-3cf4-402e-824e-e6a60f280a60', 'source_volstatus': 'available'}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:01:09 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-ad084672-7af9-43ae-92e9-6904db80f2b5 tempest-VolumesCloneTest-780036490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65a601b8-7a9f-42e3-bb51-c1670d24918f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:01:09 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-ad084672-7af9-43ae-92e9-6904db80f2b5 tempest-VolumesCloneTest-780036490 None] Volume volume-1dff7b04-ccfe-4678-8883-f0ec27e52bea (1dff7b04-ccfe-4678-8883-f0ec27e52bea): created successfully
Jun 15 16:01:09 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-ad084672-7af9-43ae-92e9-6904db80f2b5 tempest-VolumesCloneTest-780036490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65a601b8-7a9f-42e3-bb51-c1670d24918f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:01:09 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-ad084672-7af9-43ae-92e9-6904db80f2b5 tempest-VolumesCloneTest-780036490 None] Flow 'volume_create_manager' (45c075db-ea38-49dd-8c83-870dcc1d0e30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:01:09 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-ad084672-7af9-43ae-92e9-6904db80f2b5 tempest-VolumesCloneTest-780036490 None] Created volume successfully.
Jun 15 16:01:09 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-3429b023-891c-4ec8-aa1e-c654e777803d tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 16:01:09 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-3429b023-891c-4ec8-aa1e-c654e777803d tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] Flow 'volume_create_manager' (e7ec5847-d450-454d-ba9e-fc88ad8f871f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:01:09 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-3429b023-891c-4ec8-aa1e-c654e777803d tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (225f60ef-887d-4a30-9d5d-9b48fad29abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:01:09 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-3429b023-891c-4ec8-aa1e-c654e777803d tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (225f60ef-887d-4a30-9d5d-9b48fad29abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:01:10Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15eafe9c-9af9-409f-9f50-379d148e4c2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fba90b3978f418e97de1cb530aa0f50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:01:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:01:10Z,use_quota=True,user_id='12680951859f452584d38b79938d804f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84738f13-abbf-442b-947c-10e69b8e57eb),volume_type_id=84738f13-abbf-442b-947c-10e69b8e57eb)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:01:09 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-3429b023-891c-4ec8-aa1e-c654e777803d tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f673300-b08f-4ecb-bcc3-244e227c4a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:01:09 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-3429b023-891c-4ec8-aa1e-c654e777803d tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f673300-b08f-4ecb-bcc3-244e227c4a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:01:09 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-3429b023-891c-4ec8-aa1e-c654e777803d tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a2eed7d-4fb5-4a28-baf5-47c7b981d392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:01:09 devstack cinder-volume[91863]: DEBUG cinder.image.glance [None req-3429b023-891c-4ec8-aa1e-c654e777803d tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] Creating Keystone auth plugin from conf {{(pid=91863) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 15 16:01:10 devstack sudo[104788]: pam_unix(sudo:session): session closed for user root
Jun 15 16:01:10 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-8e164b31-acf0-4b72-9aae-7d71a3680759 tempest-VolumesActionsTest-1879812582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-15763aef-e495-466a-b919-a0bb6171f0cf 1073741824" returned: 0 in 0.855s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:01:10 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-3429b023-891c-4ec8-aa1e-c654e777803d tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a2eed7d-4fb5-4a28-baf5-47c7b981d392) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '15eafe9c-9af9-409f-9f50-379d148e4c2f', 'volume_name': 'volume-15eafe9c-9af9-409f-9f50-379d148e4c2f', 'volume_size': 1, 'image_id': '7872825c-48c6-471b-a870-8f898aa828a8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7872825c-48c6-471b-a870-8f898aa828a8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '37483859b4e9dfdf2b775e153bf11908', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9fba90b3978f418e97de1cb530aa0f50', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '00006476873b476458026aff8841619f3526e4a076e36897fdd51a941dc95ce30d46b2ec2d486b61abb76087364b9161b38c8cfa685339930e9bbabd08ff04c3', 'id': '7872825c-48c6-471b-a870-8f898aa828a8', 'created_at': datetime.datetime(2026, 6, 15, 14, 1, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 14, 1, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7872825c-48c6-471b-a870-8f898aa828a8/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x773954bdd2b0>}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:01:10 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-3429b023-891c-4ec8-aa1e-c654e777803d tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (648e09f1-d4e9-4fb8-90c0-e5c1bedc3f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:01:10 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-3429b023-891c-4ec8-aa1e-c654e777803d tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (648e09f1-d4e9-4fb8-90c0-e5c1bedc3f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:01:10 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-3429b023-891c-4ec8-aa1e-c654e777803d tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5c35a94-1d49-4806-8e31-df335d1d3de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:01:10 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-3429b023-891c-4ec8-aa1e-c654e777803d tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] Volume 15eafe9c-9af9-409f-9f50-379d148e4c2f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-15eafe9c-9af9-409f-9f50-379d148e4c2f', 'volume_size': 1, 'image_id': '7872825c-48c6-471b-a870-8f898aa828a8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7872825c-48c6-471b-a870-8f898aa828a8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '37483859b4e9dfdf2b775e153bf11908', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9fba90b3978f418e97de1cb530aa0f50', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '00006476873b476458026aff8841619f3526e4a076e36897fdd51a941dc95ce30d46b2ec2d486b61abb76087364b9161b38c8cfa685339930e9bbabd08ff04c3', 'id': '7872825c-48c6-471b-a870-8f898aa828a8', 'created_at': datetime.datetime(2026, 6, 15, 14, 1, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 14, 1, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7872825c-48c6-471b-a870-8f898aa828a8/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x773954bdd2b0>}
Jun 15 16:01:10 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-3429b023-891c-4ec8-aa1e-c654e777803d tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] Trying to clone 15eafe9c-9af9-409f-9f50-379d148e4c2f from image 7872825c-48c6-471b-a870-8f898aa828a8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7872825c-48c6-471b-a870-8f898aa828a8', 'metadata': {}}]). {{(pid=91863) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jun 15 16:01:10 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-8e164b31-acf0-4b72-9aae-7d71a3680759 tempest-VolumesActionsTest-1879812582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-15763aef-e495-466a-b919-a0bb6171f0cf {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:01:10 devstack sudo[104794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-15763aef-e495-466a-b919-a0bb6171f0cf
Jun 15 16:01:10 devstack sudo[104794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:01:10 devstack cinder-volume[91863]: DEBUG cinder.image.image_utils [None req-3429b023-891c-4ec8-aa1e-c654e777803d tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7872825c-48c6-471b-a870-8f898aa828a8_rpznmrpydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=91863) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 15 16:01:10 devstack cinder-volume[91863]: INFO cinder.image.image_utils [None req-3429b023-891c-4ec8-aa1e-c654e777803d tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] Image download 0.00 MB at 0.00 MB/s
Jun 15 16:01:10 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd7c308-7f3f-4be7-ab83-495043289af9]: (4, 'raw') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:01:10 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3429b023-891c-4ec8-aa1e-c654e777803d tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7872825c-48c6-471b-a870-8f898aa828a8_rpznmrpydevstack@QuobyteHD {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:01:10 devstack sudo[104796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7872825c-48c6-471b-a870-8f898aa828a8_rpznmrpydevstack@QuobyteHD
Jun 15 16:01:10 devstack sudo[104796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:01:10 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-6028130e-d4b4-4c42-97fa-3900886905c4 tempest-VolumesCloneTest-780036490 None] Acquiring lock "cinder-1dff7b04-ccfe-4678-8883-f0ec27e52bea-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:01:10 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-6028130e-d4b4-4c42-97fa-3900886905c4 tempest-VolumesCloneTest-780036490 None] Lock "cinder-1dff7b04-ccfe-4678-8883-f0ec27e52bea-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:01:10 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-6028130e-d4b4-4c42-97fa-3900886905c4 tempest-VolumesCloneTest-780036490 None] Acquiring lock "cinder-quobyte-1dff7b04-ccfe-4678-8883-f0ec27e52bea" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:01:10 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-6028130e-d4b4-4c42-97fa-3900886905c4 tempest-VolumesCloneTest-780036490 None] Lock "cinder-quobyte-1dff7b04-ccfe-4678-8883-f0ec27e52bea" acquired by "delete_volume" :: waited 0.014s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:01:10 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e6732eb-f9d2-4ea6-9b5f-f72d2f97fc39]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:01:10 devstack sudo[104794]: pam_unix(sudo:session): session closed for user root
Jun 15 16:01:10 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6028130e-d4b4-4c42-97fa-3900886905c4 tempest-VolumesCloneTest-780036490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1dff7b04-ccfe-4678-8883-f0ec27e52bea {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:01:10 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-8e164b31-acf0-4b72-9aae-7d71a3680759 tempest-VolumesActionsTest-1879812582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-15763aef-e495-466a-b919-a0bb6171f0cf" returned: 0 in 0.677s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:01:10 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-8e164b31-acf0-4b72-9aae-7d71a3680759 tempest-VolumesActionsTest-1879812582 None] <== create_volume: return (1599ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 16:01:10 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-8e164b31-acf0-4b72-9aae-7d71a3680759 tempest-VolumesActionsTest-1879812582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.602s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:01:10 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8e164b31-acf0-4b72-9aae-7d71a3680759 tempest-VolumesActionsTest-1879812582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bde68b34-ec08-4012-97e8-9d14a4090328) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15763aef-e495-466a-b919-a0bb6171f0cf', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:01:10 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8e164b31-acf0-4b72-9aae-7d71a3680759 tempest-VolumesActionsTest-1879812582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb3b82a4-d41a-489f-aa36-211c2f6ebaf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:01:10 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-8e164b31-acf0-4b72-9aae-7d71a3680759 tempest-VolumesActionsTest-1879812582 None] Volume volume-15763aef-e495-466a-b919-a0bb6171f0cf (15763aef-e495-466a-b919-a0bb6171f0cf): created successfully
Jun 15 16:01:10 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8e164b31-acf0-4b72-9aae-7d71a3680759 tempest-VolumesActionsTest-1879812582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb3b82a4-d41a-489f-aa36-211c2f6ebaf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:01:10 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8e164b31-acf0-4b72-9aae-7d71a3680759 tempest-VolumesActionsTest-1879812582 None] Flow 'volume_create_manager' (08a75469-4caa-412c-9436-f364fa81bfb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:01:10 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-8e164b31-acf0-4b72-9aae-7d71a3680759 tempest-VolumesActionsTest-1879812582 None] Created volume successfully.
Jun 15 16:01:10 devstack sudo[104799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1dff7b04-ccfe-4678-8883-f0ec27e52bea
Jun 15 16:01:10 devstack sudo[104799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:01:11 devstack sudo[104796]: pam_unix(sudo:session): session closed for user root
Jun 15 16:01:11 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3429b023-891c-4ec8-aa1e-c654e777803d tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7872825c-48c6-471b-a870-8f898aa828a8_rpznmrpydevstack@QuobyteHD" returned: 0 in 0.717s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:01:11 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3429b023-891c-4ec8-aa1e-c654e777803d tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7872825c-48c6-471b-a870-8f898aa828a8_rpznmrpydevstack@QuobyteHD {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:01:11 devstack sudo[104803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7872825c-48c6-471b-a870-8f898aa828a8_rpznmrpydevstack@QuobyteHD
Jun 15 16:01:11 devstack sudo[104803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:01:11 devstack sudo[104799]: pam_unix(sudo:session): session closed for user root
Jun 15 16:01:11 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6028130e-d4b4-4c42-97fa-3900886905c4 tempest-VolumesCloneTest-780036490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1dff7b04-ccfe-4678-8883-f0ec27e52bea" returned: 0 in 0.695s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:01:11 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6028130e-d4b4-4c42-97fa-3900886905c4 tempest-VolumesCloneTest-780036490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1dff7b04-ccfe-4678-8883-f0ec27e52bea {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:01:11 devstack sudo[104808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1dff7b04-ccfe-4678-8883-f0ec27e52bea
Jun 15 16:01:11 devstack sudo[104808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:01:11 devstack sudo[104803]: pam_unix(sudo:session): session closed for user root
Jun 15 16:01:11 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3429b023-891c-4ec8-aa1e-c654e777803d tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7872825c-48c6-471b-a870-8f898aa828a8_rpznmrpydevstack@QuobyteHD" returned: 1 in 0.652s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:01:11 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3429b023-891c-4ec8-aa1e-c654e777803d tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7872825c-48c6-471b-a870-8f898aa828a8_rpznmrpydevstack@QuobyteHD' failed. Not Retrying. {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 15 16:01:11 devstack cinder-volume[91863]: DEBUG cinder.image.image_utils [None req-3429b023-891c-4ec8-aa1e-c654e777803d tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] Temporary image 7872825c-48c6-471b-a870-8f898aa828a8 is fetched for user 12680951859f452584d38b79938d804f. {{(pid=91863) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 15 16:01:11 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[203b941d-56fb-4680-9680-c7ae60cfc41a]: (4, 'raw') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:01:11 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3429b023-891c-4ec8-aa1e-c654e777803d tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7872825c-48c6-471b-a870-8f898aa828a8_rpznmrpydevstack@QuobyteHD {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:01:11 devstack sudo[104813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7872825c-48c6-471b-a870-8f898aa828a8_rpznmrpydevstack@QuobyteHD
Jun 15 16:01:11 devstack sudo[104813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:01:12 devstack sudo[104808]: pam_unix(sudo:session): session closed for user root
Jun 15 16:01:12 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6028130e-d4b4-4c42-97fa-3900886905c4 tempest-VolumesCloneTest-780036490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1dff7b04-ccfe-4678-8883-f0ec27e52bea" returned: 0 in 0.637s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:01:12 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-6028130e-d4b4-4c42-97fa-3900886905c4 tempest-VolumesCloneTest-780036490 None] Lock "cinder-quobyte-1dff7b04-ccfe-4678-8883-f0ec27e52bea" released by "delete_volume" :: held 1.396s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:01:12 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-6028130e-d4b4-4c42-97fa-3900886905c4 tempest-VolumesCloneTest-780036490 None] Created reservations ['b615fda4-ed42-4d60-8a4b-f9ea7d9a66b3', '1d34260a-c5e4-4656-817d-7f82f77851e6', '4185e9c7-7fbe-4758-9764-46eb82f777ff', 'fe15c6a3-eba2-4748-9797-026d3171a96b'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 16:01:12 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6028130e-d4b4-4c42-97fa-3900886905c4 tempest-VolumesCloneTest-780036490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:01:12 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6028130e-d4b4-4c42-97fa-3900886905c4 tempest-VolumesCloneTest-780036490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:01:12 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6028130e-d4b4-4c42-97fa-3900886905c4 tempest-VolumesCloneTest-780036490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:01:12 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6028130e-d4b4-4c42-97fa-3900886905c4 tempest-VolumesCloneTest-780036490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:01:12 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6028130e-d4b4-4c42-97fa-3900886905c4 tempest-VolumesCloneTest-780036490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:01:12 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6028130e-d4b4-4c42-97fa-3900886905c4 tempest-VolumesCloneTest-780036490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:01:12 devstack sudo[104816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 16:01:12 devstack sudo[104816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:01:12 devstack sudo[104813]: pam_unix(sudo:session): session closed for user root
Jun 15 16:01:12 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3429b023-891c-4ec8-aa1e-c654e777803d tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7872825c-48c6-471b-a870-8f898aa828a8_rpznmrpydevstack@QuobyteHD" returned: 0 in 0.782s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:01:12 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3429b023-891c-4ec8-aa1e-c654e777803d tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7872825c-48c6-471b-a870-8f898aa828a8_rpznmrpydevstack@QuobyteHD {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:01:12 devstack sudo[104821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7872825c-48c6-471b-a870-8f898aa828a8_rpznmrpydevstack@QuobyteHD
Jun 15 16:01:12 devstack sudo[104821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:01:13 devstack sudo[104816]: pam_unix(sudo:session): session closed for user root
Jun 15 16:01:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6028130e-d4b4-4c42-97fa-3900886905c4 tempest-VolumesCloneTest-780036490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.670s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:01:13 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-6028130e-d4b4-4c42-97fa-3900886905c4 tempest-VolumesCloneTest-780036490 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 16:01:13 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-6028130e-d4b4-4c42-97fa-3900886905c4 tempest-VolumesCloneTest-780036490 None] Deleted volume successfully.
Jun 15 16:01:13 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-6e471bc1-765b-4927-932b-9069480a19d8 tempest-VolumesCloneTest-780036490 None] Acquiring lock "cinder-726da0ec-3cf4-402e-824e-e6a60f280a60-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:01:13 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-6e471bc1-765b-4927-932b-9069480a19d8 tempest-VolumesCloneTest-780036490 None] Lock "cinder-726da0ec-3cf4-402e-824e-e6a60f280a60-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:01:13 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-6028130e-d4b4-4c42-97fa-3900886905c4 tempest-VolumesCloneTest-780036490 None] Lock "cinder-1dff7b04-ccfe-4678-8883-f0ec27e52bea-delete_volume" released by "delete_volume" :: held 2.360s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:01:13 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-6e471bc1-765b-4927-932b-9069480a19d8 tempest-VolumesCloneTest-780036490 None] Acquiring lock "cinder-quobyte-726da0ec-3cf4-402e-824e-e6a60f280a60" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:01:13 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-6e471bc1-765b-4927-932b-9069480a19d8 tempest-VolumesCloneTest-780036490 None] Lock "cinder-quobyte-726da0ec-3cf4-402e-824e-e6a60f280a60" acquired by "delete_volume" :: waited 0.019s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:01:13 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1bcf37-bb61-4095-b275-6d641e27af11]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:01:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6e471bc1-765b-4927-932b-9069480a19d8 tempest-VolumesCloneTest-780036490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-726da0ec-3cf4-402e-824e-e6a60f280a60 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:01:13 devstack sudo[104825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-726da0ec-3cf4-402e-824e-e6a60f280a60
Jun 15 16:01:13 devstack sudo[104825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:01:13 devstack sudo[104821]: pam_unix(sudo:session): session closed for user root
Jun 15 16:01:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3429b023-891c-4ec8-aa1e-c654e777803d tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7872825c-48c6-471b-a870-8f898aa828a8_rpznmrpydevstack@QuobyteHD" returned: 1 in 0.792s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:01:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3429b023-891c-4ec8-aa1e-c654e777803d tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7872825c-48c6-471b-a870-8f898aa828a8_rpznmrpydevstack@QuobyteHD' failed. Not Retrying. {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 15 16:01:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-3429b023-891c-4ec8-aa1e-c654e777803d tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:01:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-3429b023-891c-4ec8-aa1e-c654e777803d tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:01:13 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-3429b023-891c-4ec8-aa1e-c654e777803d tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:01:10Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15eafe9c-9af9-409f-9f50-379d148e4c2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fba90b3978f418e97de1cb530aa0f50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:01:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:01:10Z,use_quota=True,user_id='12680951859f452584d38b79938d804f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84738f13-abbf-442b-947c-10e69b8e57eb),volume_type_id=84738f13-abbf-442b-947c-10e69b8e57eb)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 16:01:13 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-3429b023-891c-4ec8-aa1e-c654e777803d tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] Creating volume 15eafe9c-9af9-409f-9f50-379d148e4c2f {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 16:01:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-3429b023-891c-4ec8-aa1e-c654e777803d tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:01:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-3429b023-891c-4ec8-aa1e-c654e777803d tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:01:13 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-3429b023-891c-4ec8-aa1e-c654e777803d tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:01:13 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-3429b023-891c-4ec8-aa1e-c654e777803d tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:01:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-3429b023-891c-4ec8-aa1e-c654e777803d tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:01:13 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-3429b023-891c-4ec8-aa1e-c654e777803d tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 16:01:13 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-3429b023-891c-4ec8-aa1e-c654e777803d tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 16:01:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3429b023-891c-4ec8-aa1e-c654e777803d tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-15eafe9c-9af9-409f-9f50-379d148e4c2f 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:01:13 devstack sudo[104830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-15eafe9c-9af9-409f-9f50-379d148e4c2f 1073741824
Jun 15 16:01:13 devstack sudo[104830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:01:13 devstack sudo[104825]: pam_unix(sudo:session): session closed for user root
Jun 15 16:01:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6e471bc1-765b-4927-932b-9069480a19d8 tempest-VolumesCloneTest-780036490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-726da0ec-3cf4-402e-824e-e6a60f280a60" returned: 0 in 0.741s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:01:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6e471bc1-765b-4927-932b-9069480a19d8 tempest-VolumesCloneTest-780036490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-726da0ec-3cf4-402e-824e-e6a60f280a60 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:01:13 devstack sudo[104838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-726da0ec-3cf4-402e-824e-e6a60f280a60
Jun 15 16:01:13 devstack sudo[104838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:01:14 devstack sudo[104830]: pam_unix(sudo:session): session closed for user root
Jun 15 16:01:14 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3429b023-891c-4ec8-aa1e-c654e777803d tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-15eafe9c-9af9-409f-9f50-379d148e4c2f 1073741824" returned: 0 in 0.813s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:01:14 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3429b023-891c-4ec8-aa1e-c654e777803d tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-15eafe9c-9af9-409f-9f50-379d148e4c2f {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:01:14 devstack sudo[104841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-15eafe9c-9af9-409f-9f50-379d148e4c2f
Jun 15 16:01:14 devstack sudo[104841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:01:14 devstack sudo[104838]: pam_unix(sudo:session): session closed for user root
Jun 15 16:01:14 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6e471bc1-765b-4927-932b-9069480a19d8 tempest-VolumesCloneTest-780036490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-726da0ec-3cf4-402e-824e-e6a60f280a60" returned: 0 in 0.642s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:01:14 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-6e471bc1-765b-4927-932b-9069480a19d8 tempest-VolumesCloneTest-780036490 None] Lock "cinder-quobyte-726da0ec-3cf4-402e-824e-e6a60f280a60" released by "delete_volume" :: held 1.454s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:01:14 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-6e471bc1-765b-4927-932b-9069480a19d8 tempest-VolumesCloneTest-780036490 None] Created reservations ['69d65772-e239-4073-a590-86b66be869f5', '73214d88-3963-4729-9746-903ef416940b', '7e745ca9-444e-449f-8048-439a3bbf11a6', 'e992f10d-6284-4129-83e4-407fc9f44dcb'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 16:01:14 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6e471bc1-765b-4927-932b-9069480a19d8 tempest-VolumesCloneTest-780036490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:01:14 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6e471bc1-765b-4927-932b-9069480a19d8 tempest-VolumesCloneTest-780036490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:01:14 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6e471bc1-765b-4927-932b-9069480a19d8 tempest-VolumesCloneTest-780036490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:01:14 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6e471bc1-765b-4927-932b-9069480a19d8 tempest-VolumesCloneTest-780036490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:01:14 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6e471bc1-765b-4927-932b-9069480a19d8 tempest-VolumesCloneTest-780036490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:01:14 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6e471bc1-765b-4927-932b-9069480a19d8 tempest-VolumesCloneTest-780036490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:01:14 devstack sudo[104845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 16:01:14 devstack sudo[104845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:01:14 devstack sudo[104841]: pam_unix(sudo:session): session closed for user root
Jun 15 16:01:14 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3429b023-891c-4ec8-aa1e-c654e777803d tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-15eafe9c-9af9-409f-9f50-379d148e4c2f" returned: 0 in 0.629s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:01:14 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-3429b023-891c-4ec8-aa1e-c654e777803d tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] <== create_volume: return (1498ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 16:01:14 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-3429b023-891c-4ec8-aa1e-c654e777803d tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.503s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:01:14 devstack cinder-volume[91863]: DEBUG cinder.volume.volume_utils [None req-3429b023-891c-4ec8-aa1e-c654e777803d tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] Attempting download of 7872825c-48c6-471b-a870-8f898aa828a8 ((None, [{'url': 'file:///opt/stack/data/glance/images/7872825c-48c6-471b-a870-8f898aa828a8', 'metadata': {}}])) to volume 15eafe9c-9af9-409f-9f50-379d148e4c2f. {{(pid=91863) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 15 16:01:14 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[634d0efa-bafa-4e24-bad2-5928c85d6622]: (4, 'raw') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:01:14 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3429b023-891c-4ec8-aa1e-c654e777803d tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7872825c-48c6-471b-a870-8f898aa828a8_4o6jsc4v {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:01:15 devstack sudo[104848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7872825c-48c6-471b-a870-8f898aa828a8_4o6jsc4v
Jun 15 16:01:15 devstack sudo[104848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:01:15 devstack sudo[104845]: pam_unix(sudo:session): session closed for user root
Jun 15 16:01:15 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6e471bc1-765b-4927-932b-9069480a19d8 tempest-VolumesCloneTest-780036490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.659s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:01:15 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-6e471bc1-765b-4927-932b-9069480a19d8 tempest-VolumesCloneTest-780036490 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 16:01:15 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-6e471bc1-765b-4927-932b-9069480a19d8 tempest-VolumesCloneTest-780036490 None] Deleted volume successfully.
Jun 15 16:01:15 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-6e471bc1-765b-4927-932b-9069480a19d8 tempest-VolumesCloneTest-780036490 None] Lock "cinder-726da0ec-3cf4-402e-824e-e6a60f280a60-delete_volume" released by "delete_volume" :: held 2.330s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:01:15 devstack sudo[104848]: pam_unix(sudo:session): session closed for user root
Jun 15 16:01:15 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3429b023-891c-4ec8-aa1e-c654e777803d tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7872825c-48c6-471b-a870-8f898aa828a8_4o6jsc4v" returned: 0 in 0.719s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:01:15 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3429b023-891c-4ec8-aa1e-c654e777803d tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7872825c-48c6-471b-a870-8f898aa828a8_4o6jsc4v {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:01:15 devstack sudo[104853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7872825c-48c6-471b-a870-8f898aa828a8_4o6jsc4v
Jun 15 16:01:15 devstack sudo[104853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:01:16 devstack sudo[104853]: pam_unix(sudo:session): session closed for user root
Jun 15 16:01:16 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3429b023-891c-4ec8-aa1e-c654e777803d tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7872825c-48c6-471b-a870-8f898aa828a8_4o6jsc4v" returned: 1 in 0.678s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:01:16 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3429b023-891c-4ec8-aa1e-c654e777803d tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7872825c-48c6-471b-a870-8f898aa828a8_4o6jsc4v' failed. Not Retrying. {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 15 16:01:16 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[37212dd7-8999-4e61-abd2-62bef1a4d33b]: (4, 'raw') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:01:16 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3429b023-891c-4ec8-aa1e-c654e777803d tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7872825c-48c6-471b-a870-8f898aa828a8_rpznmrpydevstack@QuobyteHD {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:01:16 devstack sudo[104857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7872825c-48c6-471b-a870-8f898aa828a8_rpznmrpydevstack@QuobyteHD
Jun 15 16:01:16 devstack sudo[104857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:01:17 devstack sudo[104857]: pam_unix(sudo:session): session closed for user root
Jun 15 16:01:17 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3429b023-891c-4ec8-aa1e-c654e777803d tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7872825c-48c6-471b-a870-8f898aa828a8_rpznmrpydevstack@QuobyteHD" returned: 0 in 0.740s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:01:17 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3429b023-891c-4ec8-aa1e-c654e777803d tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7872825c-48c6-471b-a870-8f898aa828a8_rpznmrpydevstack@QuobyteHD {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:01:17 devstack sudo[104861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7872825c-48c6-471b-a870-8f898aa828a8_rpznmrpydevstack@QuobyteHD
Jun 15 16:01:17 devstack sudo[104861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:01:17 devstack sudo[104861]: pam_unix(sudo:session): session closed for user root
Jun 15 16:01:17 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3429b023-891c-4ec8-aa1e-c654e777803d tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7872825c-48c6-471b-a870-8f898aa828a8_rpznmrpydevstack@QuobyteHD" returned: 1 in 0.849s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:01:17 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3429b023-891c-4ec8-aa1e-c654e777803d tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7872825c-48c6-471b-a870-8f898aa828a8_rpznmrpydevstack@QuobyteHD' failed. Not Retrying. {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 15 16:01:17 devstack cinder-volume[91863]: DEBUG cinder.image.image_utils [None req-3429b023-891c-4ec8-aa1e-c654e777803d tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] 7872825c-48c6-471b-a870-8f898aa828a8 was raw, converting to raw {{(pid=91863) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 15 16:01:17 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3429b023-891c-4ec8-aa1e-c654e777803d tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_7872825c-48c6-471b-a870-8f898aa828a8_rpznmrpydevstack@QuobyteHD /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-15eafe9c-9af9-409f-9f50-379d148e4c2f {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:01:18 devstack sudo[104866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_7872825c-48c6-471b-a870-8f898aa828a8_rpznmrpydevstack@QuobyteHD /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-15eafe9c-9af9-409f-9f50-379d148e4c2f
Jun 15 16:01:18 devstack sudo[104866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:01:18 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-755e6d85-4773-4641-a70a-cf9f138752d9 tempest-VolumesCloneNegativeTest-1937271331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 16:01:18 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-755e6d85-4773-4641-a70a-cf9f138752d9 tempest-VolumesCloneNegativeTest-1937271331 None] Flow 'volume_create_manager' (3f117cab-a996-4419-9e2a-186517073872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:01:18 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-755e6d85-4773-4641-a70a-cf9f138752d9 tempest-VolumesCloneNegativeTest-1937271331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a404ac6-6967-42fe-8c2b-a54fb9b40708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:01:18 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-755e6d85-4773-4641-a70a-cf9f138752d9 tempest-VolumesCloneNegativeTest-1937271331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a404ac6-6967-42fe-8c2b-a54fb9b40708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:01:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1719961804',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2aa6b16b-6edd-4016-b42f-55cfc4249e61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cea40341a73840ccbb66b4a83084ac60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:01:19Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:01:19Z,use_quota=True,user_id='8c3faa51fa154dbc90961ddbea75c2a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:01:18 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-755e6d85-4773-4641-a70a-cf9f138752d9 tempest-VolumesCloneNegativeTest-1937271331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d423cc7-5eba-4638-a6ab-3b2d413021e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:01:18 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-755e6d85-4773-4641-a70a-cf9f138752d9 tempest-VolumesCloneNegativeTest-1937271331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d423cc7-5eba-4638-a6ab-3b2d413021e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:01:18 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-755e6d85-4773-4641-a70a-cf9f138752d9 tempest-VolumesCloneNegativeTest-1937271331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c181d1a5-6111-4c78-9e0e-4a75cda116e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:01:18 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-755e6d85-4773-4641-a70a-cf9f138752d9 tempest-VolumesCloneNegativeTest-1937271331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c181d1a5-6111-4c78-9e0e-4a75cda116e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2aa6b16b-6edd-4016-b42f-55cfc4249e61', 'volume_name': 'volume-2aa6b16b-6edd-4016-b42f-55cfc4249e61', 'volume_size': 2}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:01:18 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-755e6d85-4773-4641-a70a-cf9f138752d9 tempest-VolumesCloneNegativeTest-1937271331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b09c2450-74e8-4229-b24a-c40ced526bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:01:18 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-755e6d85-4773-4641-a70a-cf9f138752d9 tempest-VolumesCloneNegativeTest-1937271331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b09c2450-74e8-4229-b24a-c40ced526bb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:01:18 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-755e6d85-4773-4641-a70a-cf9f138752d9 tempest-VolumesCloneNegativeTest-1937271331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54d22ad2-bad6-4757-af3a-ee92d39b7b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:01:18 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-755e6d85-4773-4641-a70a-cf9f138752d9 tempest-VolumesCloneNegativeTest-1937271331 None] Volume 2aa6b16b-6edd-4016-b42f-55cfc4249e61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2aa6b16b-6edd-4016-b42f-55cfc4249e61', 'volume_size': 2}
Jun 15 16:01:18 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-755e6d85-4773-4641-a70a-cf9f138752d9 tempest-VolumesCloneNegativeTest-1937271331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:01:18 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-755e6d85-4773-4641-a70a-cf9f138752d9 tempest-VolumesCloneNegativeTest-1937271331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:01:18 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-755e6d85-4773-4641-a70a-cf9f138752d9 tempest-VolumesCloneNegativeTest-1937271331 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:01:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1719961804',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2aa6b16b-6edd-4016-b42f-55cfc4249e61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cea40341a73840ccbb66b4a83084ac60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:01:19Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:01:19Z,use_quota=True,user_id='8c3faa51fa154dbc90961ddbea75c2a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 16:01:18 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-755e6d85-4773-4641-a70a-cf9f138752d9 tempest-VolumesCloneNegativeTest-1937271331 None] Creating volume 2aa6b16b-6edd-4016-b42f-55cfc4249e61 {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 16:01:18 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-755e6d85-4773-4641-a70a-cf9f138752d9 tempest-VolumesCloneNegativeTest-1937271331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:01:18 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-755e6d85-4773-4641-a70a-cf9f138752d9 tempest-VolumesCloneNegativeTest-1937271331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:01:18 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-755e6d85-4773-4641-a70a-cf9f138752d9 tempest-VolumesCloneNegativeTest-1937271331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:01:18 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-755e6d85-4773-4641-a70a-cf9f138752d9 tempest-VolumesCloneNegativeTest-1937271331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:01:18 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-755e6d85-4773-4641-a70a-cf9f138752d9 tempest-VolumesCloneNegativeTest-1937271331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:01:18 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-755e6d85-4773-4641-a70a-cf9f138752d9 tempest-VolumesCloneNegativeTest-1937271331 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 16:01:18 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-755e6d85-4773-4641-a70a-cf9f138752d9 tempest-VolumesCloneNegativeTest-1937271331 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 16:01:18 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-755e6d85-4773-4641-a70a-cf9f138752d9 tempest-VolumesCloneNegativeTest-1937271331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2aa6b16b-6edd-4016-b42f-55cfc4249e61 2147483648 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:01:18 devstack sudo[104871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2aa6b16b-6edd-4016-b42f-55cfc4249e61 2147483648
Jun 15 16:01:18 devstack sudo[104871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:01:18 devstack sudo[104866]: pam_unix(sudo:session): session closed for user root
Jun 15 16:01:18 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3429b023-891c-4ec8-aa1e-c654e777803d tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_7872825c-48c6-471b-a870-8f898aa828a8_rpznmrpydevstack@QuobyteHD /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-15eafe9c-9af9-409f-9f50-379d148e4c2f" returned: 0 in 0.921s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:01:18 devstack cinder-volume[91863]: DEBUG cinder.image.image_utils [None req-3429b023-891c-4ec8-aa1e-c654e777803d tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7872825c-48c6-471b-a870-8f898aa828a8_rpznmrpydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-15eafe9c-9af9-409f-9f50-379d148e4c2f {{(pid=91863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 15 16:01:18 devstack cinder-volume[91863]: INFO cinder.image.image_utils [None req-3429b023-891c-4ec8-aa1e-c654e777803d tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] Converted 0.00 MB image at 0.00 MB/s
Jun 15 16:01:18 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3429b023-891c-4ec8-aa1e-c654e777803d tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-15eafe9c-9af9-409f-9f50-379d148e4c2f 1G {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:01:18 devstack sudo[104873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-15eafe9c-9af9-409f-9f50-379d148e4c2f 1G
Jun 15 16:01:18 devstack sudo[104873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:01:19 devstack sudo[104873]: pam_unix(sudo:session): session closed for user root
Jun 15 16:01:19 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3429b023-891c-4ec8-aa1e-c654e777803d tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-15eafe9c-9af9-409f-9f50-379d148e4c2f 1G" returned: 0 in 0.778s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:01:19 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d67ec2-a24f-456e-a0d2-3c93391f971f]: (4, 'raw') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:01:19 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3429b023-891c-4ec8-aa1e-c654e777803d tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-15eafe9c-9af9-409f-9f50-379d148e4c2f {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:01:19 devstack sudo[104897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-15eafe9c-9af9-409f-9f50-379d148e4c2f
Jun 15 16:01:19 devstack sudo[104897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:01:19 devstack sudo[104871]: pam_unix(sudo:session): session closed for user root
Jun 15 16:01:19 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-755e6d85-4773-4641-a70a-cf9f138752d9 tempest-VolumesCloneNegativeTest-1937271331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2aa6b16b-6edd-4016-b42f-55cfc4249e61 2147483648" returned: 0 in 1.083s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:01:19 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-755e6d85-4773-4641-a70a-cf9f138752d9 tempest-VolumesCloneNegativeTest-1937271331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2aa6b16b-6edd-4016-b42f-55cfc4249e61 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:01:19 devstack sudo[104901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2aa6b16b-6edd-4016-b42f-55cfc4249e61
Jun 15 16:01:19 devstack sudo[104901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:01:20 devstack sudo[104897]: pam_unix(sudo:session): session closed for user root
Jun 15 16:01:20 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3429b023-891c-4ec8-aa1e-c654e777803d tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-15eafe9c-9af9-409f-9f50-379d148e4c2f" returned: 0 in 0.699s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:01:20 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3429b023-891c-4ec8-aa1e-c654e777803d tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-15eafe9c-9af9-409f-9f50-379d148e4c2f {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:01:20 devstack sudo[104901]: pam_unix(sudo:session): session closed for user root
Jun 15 16:01:20 devstack sudo[104906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-15eafe9c-9af9-409f-9f50-379d148e4c2f
Jun 15 16:01:20 devstack sudo[104906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:01:20 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-755e6d85-4773-4641-a70a-cf9f138752d9 tempest-VolumesCloneNegativeTest-1937271331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2aa6b16b-6edd-4016-b42f-55cfc4249e61" returned: 0 in 0.610s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:01:20 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-755e6d85-4773-4641-a70a-cf9f138752d9 tempest-VolumesCloneNegativeTest-1937271331 None] <== create_volume: return (1739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 16:01:20 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-755e6d85-4773-4641-a70a-cf9f138752d9 tempest-VolumesCloneNegativeTest-1937271331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.741s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:01:20 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-755e6d85-4773-4641-a70a-cf9f138752d9 tempest-VolumesCloneNegativeTest-1937271331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54d22ad2-bad6-4757-af3a-ee92d39b7b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2aa6b16b-6edd-4016-b42f-55cfc4249e61', 'volume_size': 2}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:01:20 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-755e6d85-4773-4641-a70a-cf9f138752d9 tempest-VolumesCloneNegativeTest-1937271331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00cdc0e0-c7e5-44bb-894c-ee97eab2ebe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:01:20 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-755e6d85-4773-4641-a70a-cf9f138752d9 tempest-VolumesCloneNegativeTest-1937271331 None] Volume volume-2aa6b16b-6edd-4016-b42f-55cfc4249e61 (2aa6b16b-6edd-4016-b42f-55cfc4249e61): created successfully
Jun 15 16:01:20 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-755e6d85-4773-4641-a70a-cf9f138752d9 tempest-VolumesCloneNegativeTest-1937271331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00cdc0e0-c7e5-44bb-894c-ee97eab2ebe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:01:20 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-755e6d85-4773-4641-a70a-cf9f138752d9 tempest-VolumesCloneNegativeTest-1937271331 None] Flow 'volume_create_manager' (3f117cab-a996-4419-9e2a-186517073872) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:01:20 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-755e6d85-4773-4641-a70a-cf9f138752d9 tempest-VolumesCloneNegativeTest-1937271331 None] Created volume successfully.
Jun 15 16:01:21 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-27692903-061d-4975-8c35-f2e33b074e32 tempest-VolumesCloneNegativeTest-1937271331 None] Acquiring lock "cinder-2aa6b16b-6edd-4016-b42f-55cfc4249e61-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:01:21 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-27692903-061d-4975-8c35-f2e33b074e32 tempest-VolumesCloneNegativeTest-1937271331 None] Lock "cinder-2aa6b16b-6edd-4016-b42f-55cfc4249e61-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:01:21 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-27692903-061d-4975-8c35-f2e33b074e32 tempest-VolumesCloneNegativeTest-1937271331 None] Acquiring lock "cinder-quobyte-2aa6b16b-6edd-4016-b42f-55cfc4249e61" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:01:21 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-27692903-061d-4975-8c35-f2e33b074e32 tempest-VolumesCloneNegativeTest-1937271331 None] Lock "cinder-quobyte-2aa6b16b-6edd-4016-b42f-55cfc4249e61" acquired by "delete_volume" :: waited 0.016s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:01:21 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c4053fe-a436-43dd-801c-f96df3afbd23]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:01:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-27692903-061d-4975-8c35-f2e33b074e32 tempest-VolumesCloneNegativeTest-1937271331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2aa6b16b-6edd-4016-b42f-55cfc4249e61 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:01:21 devstack sudo[104906]: pam_unix(sudo:session): session closed for user root
Jun 15 16:01:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3429b023-891c-4ec8-aa1e-c654e777803d tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-15eafe9c-9af9-409f-9f50-379d148e4c2f" returned: 1 in 0.746s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:01:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3429b023-891c-4ec8-aa1e-c654e777803d tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-15eafe9c-9af9-409f-9f50-379d148e4c2f' failed. Not Retrying. {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 15 16:01:21 devstack cinder-volume[91863]: DEBUG cinder.volume.volume_utils [None req-3429b023-891c-4ec8-aa1e-c654e777803d tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] Downloaded image 7872825c-48c6-471b-a870-8f898aa828a8 ((None, [{'url': 'file:///opt/stack/data/glance/images/7872825c-48c6-471b-a870-8f898aa828a8', 'metadata': {}}])) to volume 15eafe9c-9af9-409f-9f50-379d148e4c2f successfully. {{(pid=91863) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 15 16:01:21 devstack cinder-volume[91863]: DEBUG cinder.image.image_utils [None req-3429b023-891c-4ec8-aa1e-c654e777803d tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] Temporary image 7872825c-48c6-471b-a870-8f898aa828a8 for user 12680951859f452584d38b79938d804f is deleted. {{(pid=91863) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 15 16:01:21 devstack cinder-volume[91863]: DEBUG cinder.volume.volume_utils [None req-3429b023-891c-4ec8-aa1e-c654e777803d tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] Marking volume 15eafe9c-9af9-409f-9f50-379d148e4c2f as bootable. {{(pid=91863) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 15 16:01:21 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-3429b023-891c-4ec8-aa1e-c654e777803d tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] Copying metadata from image 7872825c-48c6-471b-a870-8f898aa828a8 to 15eafe9c-9af9-409f-9f50-379d148e4c2f. {{(pid=91863) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 15 16:01:21 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-3429b023-891c-4ec8-aa1e-c654e777803d tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] Creating volume glance metadata for volume 15eafe9c-9af9-409f-9f50-379d148e4c2f backed by image 7872825c-48c6-471b-a870-8f898aa828a8 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '7872825c-48c6-471b-a870-8f898aa828a8', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '37483859b4e9dfdf2b775e153bf11908', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=91863) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 15 16:01:21 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-3429b023-891c-4ec8-aa1e-c654e777803d tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5c35a94-1d49-4806-8e31-df335d1d3de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15eafe9c-9af9-409f-9f50-379d148e4c2f', 'volume_size': 1, 'image_id': '7872825c-48c6-471b-a870-8f898aa828a8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7872825c-48c6-471b-a870-8f898aa828a8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '37483859b4e9dfdf2b775e153bf11908', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9fba90b3978f418e97de1cb530aa0f50', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '00006476873b476458026aff8841619f3526e4a076e36897fdd51a941dc95ce30d46b2ec2d486b61abb76087364b9161b38c8cfa685339930e9bbabd08ff04c3', 'id': '7872825c-48c6-471b-a870-8f898aa828a8', 'created_at': datetime.datetime(2026, 6, 15, 14, 1, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 14, 1, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7872825c-48c6-471b-a870-8f898aa828a8/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x773954bdd2b0>}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:01:21 devstack sudo[104912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2aa6b16b-6edd-4016-b42f-55cfc4249e61
Jun 15 16:01:21 devstack sudo[104912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:01:21 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-3429b023-891c-4ec8-aa1e-c654e777803d tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79b26a8d-f452-4f80-a1d4-1512c7455197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:01:21 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-3429b023-891c-4ec8-aa1e-c654e777803d tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] Volume volume-15eafe9c-9af9-409f-9f50-379d148e4c2f (15eafe9c-9af9-409f-9f50-379d148e4c2f): created successfully
Jun 15 16:01:21 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-3429b023-891c-4ec8-aa1e-c654e777803d tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79b26a8d-f452-4f80-a1d4-1512c7455197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:01:21 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-3429b023-891c-4ec8-aa1e-c654e777803d tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] Flow 'volume_create_manager' (e7ec5847-d450-454d-ba9e-fc88ad8f871f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:01:21 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-3429b023-891c-4ec8-aa1e-c654e777803d tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] Created volume successfully.
Jun 15 16:01:21 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-64e88459-842b-4a2c-a477-73ce4d460bab tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] Acquiring lock "cinder-15eafe9c-9af9-409f-9f50-379d148e4c2f-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:01:21 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-64e88459-842b-4a2c-a477-73ce4d460bab tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] Lock "cinder-15eafe9c-9af9-409f-9f50-379d148e4c2f-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:01:21 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-64e88459-842b-4a2c-a477-73ce4d460bab tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] Acquiring lock "cinder-quobyte-15eafe9c-9af9-409f-9f50-379d148e4c2f" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:01:21 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-64e88459-842b-4a2c-a477-73ce4d460bab tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] Lock "cinder-quobyte-15eafe9c-9af9-409f-9f50-379d148e4c2f" acquired by "delete_volume" :: waited 0.018s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:01:21 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[765b1c67-e356-4b08-86d2-244ee0b702e6]: (4, 'raw') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:01:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-64e88459-842b-4a2c-a477-73ce4d460bab tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-15eafe9c-9af9-409f-9f50-379d148e4c2f {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:01:21 devstack sudo[104912]: pam_unix(sudo:session): session closed for user root
Jun 15 16:01:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-27692903-061d-4975-8c35-f2e33b074e32 tempest-VolumesCloneNegativeTest-1937271331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2aa6b16b-6edd-4016-b42f-55cfc4249e61" returned: 0 in 0.745s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:01:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-27692903-061d-4975-8c35-f2e33b074e32 tempest-VolumesCloneNegativeTest-1937271331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2aa6b16b-6edd-4016-b42f-55cfc4249e61 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:01:21 devstack sudo[104920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2aa6b16b-6edd-4016-b42f-55cfc4249e61
Jun 15 16:01:21 devstack sudo[104920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:01:21 devstack sudo[104919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-15eafe9c-9af9-409f-9f50-379d148e4c2f
Jun 15 16:01:21 devstack sudo[104919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:01:22 devstack sudo[104920]: pam_unix(sudo:session): session closed for user root
Jun 15 16:01:22 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-27692903-061d-4975-8c35-f2e33b074e32 tempest-VolumesCloneNegativeTest-1937271331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2aa6b16b-6edd-4016-b42f-55cfc4249e61" returned: 0 in 0.606s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:01:22 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-27692903-061d-4975-8c35-f2e33b074e32 tempest-VolumesCloneNegativeTest-1937271331 None] Lock "cinder-quobyte-2aa6b16b-6edd-4016-b42f-55cfc4249e61" released by "delete_volume" :: held 1.404s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:01:22 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-27692903-061d-4975-8c35-f2e33b074e32 tempest-VolumesCloneNegativeTest-1937271331 None] Created reservations ['d482b66e-0590-43ef-90f9-cdd3f38500de', 'd4093eed-f80b-453a-ab40-463c06ea0af3', 'c302ed84-bac0-4056-b46a-5e980d3c3757', '566cae8c-8c55-4f12-8657-068bc5ee2918'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 16:01:22 devstack sudo[104919]: pam_unix(sudo:session): session closed for user root
Jun 15 16:01:22 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-64e88459-842b-4a2c-a477-73ce4d460bab tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-15eafe9c-9af9-409f-9f50-379d148e4c2f" returned: 0 in 0.724s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:01:22 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-64e88459-842b-4a2c-a477-73ce4d460bab tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-15eafe9c-9af9-409f-9f50-379d148e4c2f {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:01:22 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-27692903-061d-4975-8c35-f2e33b074e32 tempest-VolumesCloneNegativeTest-1937271331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:01:22 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-27692903-061d-4975-8c35-f2e33b074e32 tempest-VolumesCloneNegativeTest-1937271331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:01:22 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-27692903-061d-4975-8c35-f2e33b074e32 tempest-VolumesCloneNegativeTest-1937271331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:01:22 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-27692903-061d-4975-8c35-f2e33b074e32 tempest-VolumesCloneNegativeTest-1937271331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:01:22 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-27692903-061d-4975-8c35-f2e33b074e32 tempest-VolumesCloneNegativeTest-1937271331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:01:22 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-27692903-061d-4975-8c35-f2e33b074e32 tempest-VolumesCloneNegativeTest-1937271331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:01:22 devstack sudo[104927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 16:01:22 devstack sudo[104927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:01:22 devstack sudo[104926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-15eafe9c-9af9-409f-9f50-379d148e4c2f
Jun 15 16:01:22 devstack sudo[104926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:01:23 devstack sudo[104927]: pam_unix(sudo:session): session closed for user root
Jun 15 16:01:23 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-27692903-061d-4975-8c35-f2e33b074e32 tempest-VolumesCloneNegativeTest-1937271331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.626s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:01:23 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-27692903-061d-4975-8c35-f2e33b074e32 tempest-VolumesCloneNegativeTest-1937271331 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 16:01:23 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-27692903-061d-4975-8c35-f2e33b074e32 tempest-VolumesCloneNegativeTest-1937271331 None] Deleted volume successfully.
Jun 15 16:01:23 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-27692903-061d-4975-8c35-f2e33b074e32 tempest-VolumesCloneNegativeTest-1937271331 None] Lock "cinder-2aa6b16b-6edd-4016-b42f-55cfc4249e61-delete_volume" released by "delete_volume" :: held 2.285s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:01:23 devstack sudo[104926]: pam_unix(sudo:session): session closed for user root
Jun 15 16:01:23 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-64e88459-842b-4a2c-a477-73ce4d460bab tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-15eafe9c-9af9-409f-9f50-379d148e4c2f" returned: 1 in 0.759s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:01:23 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-64e88459-842b-4a2c-a477-73ce4d460bab tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-15eafe9c-9af9-409f-9f50-379d148e4c2f' failed. Not Retrying. {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 15 16:01:23 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-64e88459-842b-4a2c-a477-73ce4d460bab tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-15eafe9c-9af9-409f-9f50-379d148e4c2f {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:01:23 devstack sudo[104943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-15eafe9c-9af9-409f-9f50-379d148e4c2f
Jun 15 16:01:23 devstack sudo[104943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:01:24 devstack sudo[104943]: pam_unix(sudo:session): session closed for user root
Jun 15 16:01:24 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-64e88459-842b-4a2c-a477-73ce4d460bab tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-15eafe9c-9af9-409f-9f50-379d148e4c2f" returned: 0 in 0.670s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:01:24 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-64e88459-842b-4a2c-a477-73ce4d460bab tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] Lock "cinder-quobyte-15eafe9c-9af9-409f-9f50-379d148e4c2f" released by "delete_volume" :: held 2.221s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:01:24 devstack cinder-volume[91863]: WARNING cinder.quota [None req-64e88459-842b-4a2c-a477-73ce4d460bab tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Jun 15 16:01:24 devstack cinder-volume[91863]: WARNING cinder.quota [None req-64e88459-842b-4a2c-a477-73ce4d460bab tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Jun 15 16:01:24 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-64e88459-842b-4a2c-a477-73ce4d460bab tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] Created reservations ['8f32c8b2-d908-42e9-9948-78cca50d5aca', '967fb854-8206-4c3a-a0b3-d8ad04748830', 'f7069313-96f5-4ad0-a303-aa1eb6fe9e79', 'f16d8990-4e23-41b1-bf20-fdbebd2762fb'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 16:01:24 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-64e88459-842b-4a2c-a477-73ce4d460bab tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:01:24 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-64e88459-842b-4a2c-a477-73ce4d460bab tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:01:24 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-64e88459-842b-4a2c-a477-73ce4d460bab tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:01:24 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-64e88459-842b-4a2c-a477-73ce4d460bab tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:01:24 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-64e88459-842b-4a2c-a477-73ce4d460bab tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:01:24 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-64e88459-842b-4a2c-a477-73ce4d460bab tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:01:24 devstack sudo[104946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 16:01:24 devstack sudo[104946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:01:25 devstack sudo[104946]: pam_unix(sudo:session): session closed for user root
Jun 15 16:01:25 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-64e88459-842b-4a2c-a477-73ce4d460bab tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 1.042s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:01:25 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-64e88459-842b-4a2c-a477-73ce4d460bab tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 16:01:25 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-64e88459-842b-4a2c-a477-73ce4d460bab tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] Deleted volume successfully.
Jun 15 16:01:25 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-64e88459-842b-4a2c-a477-73ce4d460bab tempest-VolumeAndVolumeTypeFromImageTest-1802166352 None] Lock "cinder-15eafe9c-9af9-409f-9f50-379d148e4c2f-delete_volume" released by "delete_volume" :: held 3.530s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:01:27 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb57741c-4e40-4cff-b0b7-a937531ccb54 tempest-VolumesGetTest-1408686534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 16:01:27 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-cb57741c-4e40-4cff-b0b7-a937531ccb54 tempest-VolumesGetTest-1408686534 None] Flow 'volume_create_manager' (766005f0-cdfd-408d-bbff-282d14e07f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:01:27 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-cb57741c-4e40-4cff-b0b7-a937531ccb54 tempest-VolumesGetTest-1408686534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9f2dac1-9d96-4a3d-9608-733ff5f1146b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:01:27 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-cb57741c-4e40-4cff-b0b7-a937531ccb54 tempest-VolumesGetTest-1408686534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9f2dac1-9d96-4a3d-9608-733ff5f1146b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:01:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1287377365',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24558490-eb43-4adc-b875-52a19506064a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b89be12fba7e480f872e67eec6dca5e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:01:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:01:27Z,use_quota=True,user_id='6fadaeabe0e54ddfaeda00f848c0c309',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:01:27 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-cb57741c-4e40-4cff-b0b7-a937531ccb54 tempest-VolumesGetTest-1408686534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bc2716e-c9c4-4435-802d-539ec81c19ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:01:27 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-cb57741c-4e40-4cff-b0b7-a937531ccb54 tempest-VolumesGetTest-1408686534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bc2716e-c9c4-4435-802d-539ec81c19ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:01:27 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-cb57741c-4e40-4cff-b0b7-a937531ccb54 tempest-VolumesGetTest-1408686534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a7db677-5137-42bf-8664-d85217122297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:01:27 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-cb57741c-4e40-4cff-b0b7-a937531ccb54 tempest-VolumesGetTest-1408686534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a7db677-5137-42bf-8664-d85217122297) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24558490-eb43-4adc-b875-52a19506064a', 'volume_name': 'volume-24558490-eb43-4adc-b875-52a19506064a', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:01:27 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-cb57741c-4e40-4cff-b0b7-a937531ccb54 tempest-VolumesGetTest-1408686534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60aafa10-fc47-4771-937a-b8e1528e1a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:01:27 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-cb57741c-4e40-4cff-b0b7-a937531ccb54 tempest-VolumesGetTest-1408686534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60aafa10-fc47-4771-937a-b8e1528e1a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:01:27 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-cb57741c-4e40-4cff-b0b7-a937531ccb54 tempest-VolumesGetTest-1408686534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8884bfa5-5465-43bb-b726-69ff7648af85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:01:27 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-cb57741c-4e40-4cff-b0b7-a937531ccb54 tempest-VolumesGetTest-1408686534 None] Volume 24558490-eb43-4adc-b875-52a19506064a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24558490-eb43-4adc-b875-52a19506064a', 'volume_size': 1}
Jun 15 16:01:27 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-cb57741c-4e40-4cff-b0b7-a937531ccb54 tempest-VolumesGetTest-1408686534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:01:27 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-cb57741c-4e40-4cff-b0b7-a937531ccb54 tempest-VolumesGetTest-1408686534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:01:27 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-cb57741c-4e40-4cff-b0b7-a937531ccb54 tempest-VolumesGetTest-1408686534 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:01:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1287377365',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24558490-eb43-4adc-b875-52a19506064a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b89be12fba7e480f872e67eec6dca5e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:01:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:01:27Z,use_quota=True,user_id='6fadaeabe0e54ddfaeda00f848c0c309',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 16:01:27 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-cb57741c-4e40-4cff-b0b7-a937531ccb54 tempest-VolumesGetTest-1408686534 None] Creating volume 24558490-eb43-4adc-b875-52a19506064a {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 16:01:27 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-cb57741c-4e40-4cff-b0b7-a937531ccb54 tempest-VolumesGetTest-1408686534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:01:27 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-cb57741c-4e40-4cff-b0b7-a937531ccb54 tempest-VolumesGetTest-1408686534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:01:27 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-cb57741c-4e40-4cff-b0b7-a937531ccb54 tempest-VolumesGetTest-1408686534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:01:27 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-cb57741c-4e40-4cff-b0b7-a937531ccb54 tempest-VolumesGetTest-1408686534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:01:27 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-cb57741c-4e40-4cff-b0b7-a937531ccb54 tempest-VolumesGetTest-1408686534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:01:27 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-cb57741c-4e40-4cff-b0b7-a937531ccb54 tempest-VolumesGetTest-1408686534 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 16:01:27 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-cb57741c-4e40-4cff-b0b7-a937531ccb54 tempest-VolumesGetTest-1408686534 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 16:01:27 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-cb57741c-4e40-4cff-b0b7-a937531ccb54 tempest-VolumesGetTest-1408686534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-24558490-eb43-4adc-b875-52a19506064a 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:01:27 devstack sudo[105013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-24558490-eb43-4adc-b875-52a19506064a 1073741824
Jun 15 16:01:27 devstack sudo[105013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:01:28 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-5adc844a-c09d-46d8-b35f-3928b54e0451 tempest-VolumesActionsTest-1879812582 None] Acquiring lock "cinder-15763aef-e495-466a-b919-a0bb6171f0cf" by "attach_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:01:28 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-5adc844a-c09d-46d8-b35f-3928b54e0451 tempest-VolumesActionsTest-1879812582 None] Lock "cinder-15763aef-e495-466a-b919-a0bb6171f0cf" acquired by "attach_volume" :: waited 0.029s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:01:28 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-5adc844a-c09d-46d8-b35f-3928b54e0451 tempest-VolumesActionsTest-1879812582 None] Attaching volume 15763aef-e495-466a-b919-a0bb6171f0cf to instance 9491fe50-8dfa-486e-8478-e1c3bd24a698 at mountpoint /dev/vdb on host None.
Jun 15 16:01:28 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-5adc844a-c09d-46d8-b35f-3928b54e0451 tempest-VolumesActionsTest-1879812582 None] Attach volume completed successfully.
Jun 15 16:01:28 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-5adc844a-c09d-46d8-b35f-3928b54e0451 tempest-VolumesActionsTest-1879812582 None] Lock "cinder-15763aef-e495-466a-b919-a0bb6171f0cf" released by "attach_volume" :: held 0.185s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:01:29 devstack sudo[105013]: pam_unix(sudo:session): session closed for user root
Jun 15 16:01:29 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-cb57741c-4e40-4cff-b0b7-a937531ccb54 tempest-VolumesGetTest-1408686534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-24558490-eb43-4adc-b875-52a19506064a 1073741824" returned: 0 in 1.419s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:01:29 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-73b98f84-9402-416f-9ec0-b95a6cf1f659 tempest-VolumesActionsTest-1879812582 None] Acquiring lock "cinder-15763aef-e495-466a-b919-a0bb6171f0cf-detach_volume" by "detach_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:01:29 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-cb57741c-4e40-4cff-b0b7-a937531ccb54 tempest-VolumesGetTest-1408686534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-24558490-eb43-4adc-b875-52a19506064a {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:01:29 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-73b98f84-9402-416f-9ec0-b95a6cf1f659 tempest-VolumesActionsTest-1879812582 None] Lock "cinder-15763aef-e495-466a-b919-a0bb6171f0cf-detach_volume" acquired by "detach_volume" :: waited 0.043s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:01:29 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-73b98f84-9402-416f-9ec0-b95a6cf1f659 tempest-VolumesActionsTest-1879812582 None] Detaching volume 15763aef-e495-466a-b919-a0bb6171f0cf from instance 9491fe50-8dfa-486e-8478-e1c3bd24a698.
Jun 15 16:01:29 devstack sudo[105019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-24558490-eb43-4adc-b875-52a19506064a
Jun 15 16:01:29 devstack sudo[105019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:01:29 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-73b98f84-9402-416f-9ec0-b95a6cf1f659 tempest-VolumesActionsTest-1879812582 None] Detach volume completed successfully.
Jun 15 16:01:29 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-73b98f84-9402-416f-9ec0-b95a6cf1f659 tempest-VolumesActionsTest-1879812582 None] Lock "cinder-15763aef-e495-466a-b919-a0bb6171f0cf-detach_volume" released by "detach_volume" :: held 0.129s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:01:29 devstack sudo[105019]: pam_unix(sudo:session): session closed for user root
Jun 15 16:01:29 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-cb57741c-4e40-4cff-b0b7-a937531ccb54 tempest-VolumesGetTest-1408686534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-24558490-eb43-4adc-b875-52a19506064a" returned: 0 in 0.781s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:01:29 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-cb57741c-4e40-4cff-b0b7-a937531ccb54 tempest-VolumesGetTest-1408686534 None] <== create_volume: return (2273ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 16:01:29 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-cb57741c-4e40-4cff-b0b7-a937531ccb54 tempest-VolumesGetTest-1408686534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.284s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:01:29 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-cb57741c-4e40-4cff-b0b7-a937531ccb54 tempest-VolumesGetTest-1408686534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8884bfa5-5465-43bb-b726-69ff7648af85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24558490-eb43-4adc-b875-52a19506064a', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:01:29 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-cb57741c-4e40-4cff-b0b7-a937531ccb54 tempest-VolumesGetTest-1408686534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79ea3dec-f8b4-482d-98be-1c8d87ce0410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:01:29 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-cb57741c-4e40-4cff-b0b7-a937531ccb54 tempest-VolumesGetTest-1408686534 None] Volume volume-24558490-eb43-4adc-b875-52a19506064a (24558490-eb43-4adc-b875-52a19506064a): created successfully
Jun 15 16:01:29 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-cb57741c-4e40-4cff-b0b7-a937531ccb54 tempest-VolumesGetTest-1408686534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79ea3dec-f8b4-482d-98be-1c8d87ce0410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:01:29 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-cb57741c-4e40-4cff-b0b7-a937531ccb54 tempest-VolumesGetTest-1408686534 None] Flow 'volume_create_manager' (766005f0-cdfd-408d-bbff-282d14e07f1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:01:29 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-cb57741c-4e40-4cff-b0b7-a937531ccb54 tempest-VolumesGetTest-1408686534 None] Created volume successfully.
Jun 15 16:01:31 devstack cinder-volume[91863]: DEBUG oslo_service.periodic_task [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 16:01:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:01:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:01:31 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:01:31 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:01:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:01:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:01:31 devstack sudo[105056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 16:01:31 devstack sudo[105056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:01:31 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f889bb2-ae74-4b9a-9dd6-558572fde564 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 16:01:31 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6f889bb2-ae74-4b9a-9dd6-558572fde564 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Flow 'volume_create_manager' (cd8496ad-41b9-4b3a-8987-048aa776f05e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:01:31 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6f889bb2-ae74-4b9a-9dd6-558572fde564 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9319f201-c2b8-4527-a094-e0d3e51bd03d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:01:31 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6f889bb2-ae74-4b9a-9dd6-558572fde564 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9319f201-c2b8-4527-a094-e0d3e51bd03d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:01:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1326594450',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90d8e416-e33c-44f8-9c2d-1d92666af647,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ceaefcebdc94eb397df6c7b8f2294c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:01:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:01:31Z,use_quota=True,user_id='055436238f3a4e2b9a1ed648cd24d12f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:01:31 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6f889bb2-ae74-4b9a-9dd6-558572fde564 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06fde726-298f-414f-9392-872946cc8d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:01:31 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6f889bb2-ae74-4b9a-9dd6-558572fde564 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06fde726-298f-414f-9392-872946cc8d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:01:31 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6f889bb2-ae74-4b9a-9dd6-558572fde564 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c94b5cc5-7b6d-45e3-bd10-043093ec5a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:01:31 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6f889bb2-ae74-4b9a-9dd6-558572fde564 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c94b5cc5-7b6d-45e3-bd10-043093ec5a20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90d8e416-e33c-44f8-9c2d-1d92666af647', 'volume_name': 'volume-90d8e416-e33c-44f8-9c2d-1d92666af647', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:01:31 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6f889bb2-ae74-4b9a-9dd6-558572fde564 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (336bd5e4-eda5-4ae6-bda4-4422053b23bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:01:31 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6f889bb2-ae74-4b9a-9dd6-558572fde564 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (336bd5e4-eda5-4ae6-bda4-4422053b23bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:01:31 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6f889bb2-ae74-4b9a-9dd6-558572fde564 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c8df209-38e0-4c27-a5f0-e80a7141ab45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:01:31 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-6f889bb2-ae74-4b9a-9dd6-558572fde564 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Volume 90d8e416-e33c-44f8-9c2d-1d92666af647: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90d8e416-e33c-44f8-9c2d-1d92666af647', 'volume_size': 1}
Jun 15 16:01:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6f889bb2-ae74-4b9a-9dd6-558572fde564 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:01:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6f889bb2-ae74-4b9a-9dd6-558572fde564 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:01:31 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6f889bb2-ae74-4b9a-9dd6-558572fde564 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:01:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1326594450',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90d8e416-e33c-44f8-9c2d-1d92666af647,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ceaefcebdc94eb397df6c7b8f2294c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:01:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:01:31Z,use_quota=True,user_id='055436238f3a4e2b9a1ed648cd24d12f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 16:01:31 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-6f889bb2-ae74-4b9a-9dd6-558572fde564 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Creating volume 90d8e416-e33c-44f8-9c2d-1d92666af647 {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 16:01:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6f889bb2-ae74-4b9a-9dd6-558572fde564 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:01:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6f889bb2-ae74-4b9a-9dd6-558572fde564 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:01:31 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6f889bb2-ae74-4b9a-9dd6-558572fde564 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:01:31 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6f889bb2-ae74-4b9a-9dd6-558572fde564 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:01:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6f889bb2-ae74-4b9a-9dd6-558572fde564 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:01:31 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6f889bb2-ae74-4b9a-9dd6-558572fde564 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 16:01:31 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-6f889bb2-ae74-4b9a-9dd6-558572fde564 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 16:01:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6f889bb2-ae74-4b9a-9dd6-558572fde564 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-90d8e416-e33c-44f8-9c2d-1d92666af647 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:01:31 devstack sudo[105062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-90d8e416-e33c-44f8-9c2d-1d92666af647 1073741824
Jun 15 16:01:31 devstack sudo[105062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:01:31 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d4c8425-248e-44b9-87bf-e026c711f5e3 tempest-VolumesGetTest-1408686534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 16:01:31 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-2d4c8425-248e-44b9-87bf-e026c711f5e3 tempest-VolumesGetTest-1408686534 None] Flow 'volume_create_manager' (4c2836c8-6630-4a95-a523-aeeadba35781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:01:31 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-2d4c8425-248e-44b9-87bf-e026c711f5e3 tempest-VolumesGetTest-1408686534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddb5d34a-5b01-4b2c-975c-1dd0cc045c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:01:31 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-2d4c8425-248e-44b9-87bf-e026c711f5e3 tempest-VolumesGetTest-1408686534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddb5d34a-5b01-4b2c-975c-1dd0cc045c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:01:31Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1070909690',display_name='tempest-VolumesGetTest-Volume-1928924770',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a0e2e0a-80fa-4f2b-8dea-a0f1bd53cfe3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b89be12fba7e480f872e67eec6dca5e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:01:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:01:32Z,use_quota=True,user_id='6fadaeabe0e54ddfaeda00f848c0c309',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:01:31 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-2d4c8425-248e-44b9-87bf-e026c711f5e3 tempest-VolumesGetTest-1408686534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40e3ae78-8639-40b4-bcf1-e175703b5370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:01:31 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-2d4c8425-248e-44b9-87bf-e026c711f5e3 tempest-VolumesGetTest-1408686534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40e3ae78-8639-40b4-bcf1-e175703b5370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:01:31 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-2d4c8425-248e-44b9-87bf-e026c711f5e3 tempest-VolumesGetTest-1408686534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b076943-35bb-4bbc-94dc-4219e387f6aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:01:31 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-2d4c8425-248e-44b9-87bf-e026c711f5e3 tempest-VolumesGetTest-1408686534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b076943-35bb-4bbc-94dc-4219e387f6aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a0e2e0a-80fa-4f2b-8dea-a0f1bd53cfe3', 'volume_name': 'volume-9a0e2e0a-80fa-4f2b-8dea-a0f1bd53cfe3', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:01:32 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-2d4c8425-248e-44b9-87bf-e026c711f5e3 tempest-VolumesGetTest-1408686534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee177c86-13c1-4154-a660-44df4362e111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:01:32 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-2d4c8425-248e-44b9-87bf-e026c711f5e3 tempest-VolumesGetTest-1408686534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee177c86-13c1-4154-a660-44df4362e111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:01:32 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-2d4c8425-248e-44b9-87bf-e026c711f5e3 tempest-VolumesGetTest-1408686534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62a74fce-4751-4216-bdaf-3ff59b9d4a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:01:32 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-2d4c8425-248e-44b9-87bf-e026c711f5e3 tempest-VolumesGetTest-1408686534 None] Volume 9a0e2e0a-80fa-4f2b-8dea-a0f1bd53cfe3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a0e2e0a-80fa-4f2b-8dea-a0f1bd53cfe3', 'volume_size': 1}
Jun 15 16:01:32 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-2d4c8425-248e-44b9-87bf-e026c711f5e3 tempest-VolumesGetTest-1408686534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:01:32 devstack sudo[105056]: pam_unix(sudo:session): session closed for user root
Jun 15 16:01:32 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.886s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:01:32 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 16:01:32 devstack cinder-volume[91863]: DEBUG oslo_service.periodic_task [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Running periodic task VolumeManager._thread_info {{(pid=91863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 16:01:32 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] thread count: 28 {{(pid=91863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 15 16:01:32 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] thread info: [<_MainThread(MainThread, started 131088232640640)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131088122704576)>, <Thread(Thread-3 (stat_writer), started daemon 131088123058112)>, <Thread(Rabbit-heartbeat, started daemon 131088121268864)>, <Thread(Thread-5 (_runner), started daemon 131088121904192)>, <Thread(Thread-7 (_runner), started daemon 131088122037248)>, <Thread(fd_logger, started daemon 131088119630784)>, <Thread(privsep_reader, started daemon 131088119781440)>, <Thread(tpool_thread_0, started daemon 131088111617728)>, <Thread(tpool_thread_1, started daemon 131088103225024)>, <Thread(tpool_thread_2, started daemon 131088094832320)>, <Thread(tpool_thread_3, started daemon 131088086439616)>, <Thread(tpool_thread_4, started daemon 131088078046912)>, <Thread(tpool_thread_5, started daemon 131088069654208)>, <Thread(tpool_thread_6, started daemon 131088061261504)>, <Thread(tpool_thread_7, started daemon 131088052868800)>, <Thread(tpool_thread_8, started daemon 131088044476096)>, <Thread(tpool_thread_9, started daemon 131088036083392)>, <Thread(tpool_thread_10, started daemon 131088027690688)>, <Thread(tpool_thread_11, started daemon 131088019297984)>, <Thread(tpool_thread_12, started daemon 131088010905280)>, <Thread(tpool_thread_13, started daemon 131088002512576)>, <Thread(tpool_thread_14, started daemon 131087994119872)>, <Thread(tpool_thread_15, started daemon 131087985727168)>, <Thread(tpool_thread_16, started daemon 131087977334464)>, <Thread(tpool_thread_17, started daemon 131087968941760)>, <Thread(tpool_thread_18, started daemon 131087960549056)>, <Thread(tpool_thread_19, started daemon 131087952156352)>] {{(pid=91863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 15 16:01:32 devstack sudo[105062]: pam_unix(sudo:session): session closed for user root
Jun 15 16:01:32 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6f889bb2-ae74-4b9a-9dd6-558572fde564 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-90d8e416-e33c-44f8-9c2d-1d92666af647 1073741824" returned: 0 in 1.135s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:01:32 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6f889bb2-ae74-4b9a-9dd6-558572fde564 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-90d8e416-e33c-44f8-9c2d-1d92666af647 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:01:32 devstack sudo[105069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-90d8e416-e33c-44f8-9c2d-1d92666af647
Jun 15 16:01:32 devstack sudo[105069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:01:33 devstack sudo[105069]: pam_unix(sudo:session): session closed for user root
Jun 15 16:01:33 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6f889bb2-ae74-4b9a-9dd6-558572fde564 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-90d8e416-e33c-44f8-9c2d-1d92666af647" returned: 0 in 0.723s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:01:33 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6f889bb2-ae74-4b9a-9dd6-558572fde564 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] <== create_volume: return (1898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 16:01:33 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6f889bb2-ae74-4b9a-9dd6-558572fde564 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.903s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:01:33 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-2d4c8425-248e-44b9-87bf-e026c711f5e3 tempest-VolumesGetTest-1408686534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.206s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:01:33 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-2d4c8425-248e-44b9-87bf-e026c711f5e3 tempest-VolumesGetTest-1408686534 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:01:31Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1070909690',display_name='tempest-VolumesGetTest-Volume-1928924770',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a0e2e0a-80fa-4f2b-8dea-a0f1bd53cfe3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b89be12fba7e480f872e67eec6dca5e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:01:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:01:32Z,use_quota=True,user_id='6fadaeabe0e54ddfaeda00f848c0c309',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 16:01:33 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-2d4c8425-248e-44b9-87bf-e026c711f5e3 tempest-VolumesGetTest-1408686534 None] Creating volume 9a0e2e0a-80fa-4f2b-8dea-a0f1bd53cfe3 {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 16:01:33 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-2d4c8425-248e-44b9-87bf-e026c711f5e3 tempest-VolumesGetTest-1408686534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:01:33 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-2d4c8425-248e-44b9-87bf-e026c711f5e3 tempest-VolumesGetTest-1408686534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:01:33 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-2d4c8425-248e-44b9-87bf-e026c711f5e3 tempest-VolumesGetTest-1408686534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:01:33 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-2d4c8425-248e-44b9-87bf-e026c711f5e3 tempest-VolumesGetTest-1408686534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:01:33 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-2d4c8425-248e-44b9-87bf-e026c711f5e3 tempest-VolumesGetTest-1408686534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:01:33 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-2d4c8425-248e-44b9-87bf-e026c711f5e3 tempest-VolumesGetTest-1408686534 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 16:01:33 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-2d4c8425-248e-44b9-87bf-e026c711f5e3 tempest-VolumesGetTest-1408686534 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 16:01:33 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-2d4c8425-248e-44b9-87bf-e026c711f5e3 tempest-VolumesGetTest-1408686534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-9a0e2e0a-80fa-4f2b-8dea-a0f1bd53cfe3 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:01:33 devstack sudo[105074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-9a0e2e0a-80fa-4f2b-8dea-a0f1bd53cfe3 1073741824
Jun 15 16:01:33 devstack sudo[105074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:01:33 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6f889bb2-ae74-4b9a-9dd6-558572fde564 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c8df209-38e0-4c27-a5f0-e80a7141ab45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90d8e416-e33c-44f8-9c2d-1d92666af647', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:01:33 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6f889bb2-ae74-4b9a-9dd6-558572fde564 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1ae8fef-f144-49af-a4d9-7919bfee8fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:01:33 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-6f889bb2-ae74-4b9a-9dd6-558572fde564 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Volume volume-90d8e416-e33c-44f8-9c2d-1d92666af647 (90d8e416-e33c-44f8-9c2d-1d92666af647): created successfully
Jun 15 16:01:33 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6f889bb2-ae74-4b9a-9dd6-558572fde564 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1ae8fef-f144-49af-a4d9-7919bfee8fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:01:33 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6f889bb2-ae74-4b9a-9dd6-558572fde564 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Flow 'volume_create_manager' (cd8496ad-41b9-4b3a-8987-048aa776f05e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:01:33 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-6f889bb2-ae74-4b9a-9dd6-558572fde564 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Created volume successfully.
Jun 15 16:01:34 devstack sudo[105074]: pam_unix(sudo:session): session closed for user root
Jun 15 16:01:34 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-2d4c8425-248e-44b9-87bf-e026c711f5e3 tempest-VolumesGetTest-1408686534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-9a0e2e0a-80fa-4f2b-8dea-a0f1bd53cfe3 1073741824" returned: 0 in 0.789s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:01:34 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-2d4c8425-248e-44b9-87bf-e026c711f5e3 tempest-VolumesGetTest-1408686534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-9a0e2e0a-80fa-4f2b-8dea-a0f1bd53cfe3 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:01:34 devstack sudo[105079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-9a0e2e0a-80fa-4f2b-8dea-a0f1bd53cfe3
Jun 15 16:01:34 devstack sudo[105079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:01:34 devstack sudo[105079]: pam_unix(sudo:session): session closed for user root
Jun 15 16:01:34 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-2d4c8425-248e-44b9-87bf-e026c711f5e3 tempest-VolumesGetTest-1408686534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-9a0e2e0a-80fa-4f2b-8dea-a0f1bd53cfe3" returned: 0 in 0.612s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:01:34 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-2d4c8425-248e-44b9-87bf-e026c711f5e3 tempest-VolumesGetTest-1408686534 None] <== create_volume: return (1444ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 16:01:34 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-2d4c8425-248e-44b9-87bf-e026c711f5e3 tempest-VolumesGetTest-1408686534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.448s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:01:34 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-2d4c8425-248e-44b9-87bf-e026c711f5e3 tempest-VolumesGetTest-1408686534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62a74fce-4751-4216-bdaf-3ff59b9d4a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a0e2e0a-80fa-4f2b-8dea-a0f1bd53cfe3', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:01:34 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-2d4c8425-248e-44b9-87bf-e026c711f5e3 tempest-VolumesGetTest-1408686534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d4ffa01-3735-41ae-9dac-68d39358586b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:01:34 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-2d4c8425-248e-44b9-87bf-e026c711f5e3 tempest-VolumesGetTest-1408686534 None] Volume volume-9a0e2e0a-80fa-4f2b-8dea-a0f1bd53cfe3 (9a0e2e0a-80fa-4f2b-8dea-a0f1bd53cfe3): created successfully
Jun 15 16:01:34 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-2d4c8425-248e-44b9-87bf-e026c711f5e3 tempest-VolumesGetTest-1408686534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d4ffa01-3735-41ae-9dac-68d39358586b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:01:34 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-2d4c8425-248e-44b9-87bf-e026c711f5e3 tempest-VolumesGetTest-1408686534 None] Flow 'volume_create_manager' (4c2836c8-6630-4a95-a523-aeeadba35781) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:01:34 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-2d4c8425-248e-44b9-87bf-e026c711f5e3 tempest-VolumesGetTest-1408686534 None] Created volume successfully.
Jun 15 16:01:34 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-39b66f60-a7c9-48b7-bd15-25444ef8e8e2 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 16:01:34 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-39b66f60-a7c9-48b7-bd15-25444ef8e8e2 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Flow 'volume_create_manager' (28075432-b258-40f8-8a08-53e5710b4f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:01:34 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-39b66f60-a7c9-48b7-bd15-25444ef8e8e2 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8aff409d-ded5-4541-af2b-567abb9ccc7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:01:34 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-39b66f60-a7c9-48b7-bd15-25444ef8e8e2 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8aff409d-ded5-4541-af2b-567abb9ccc7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:01:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-544269552',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92da3b2a-4c57-4f07-8425-400adcbef4ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ceaefcebdc94eb397df6c7b8f2294c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:01:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:01:35Z,use_quota=True,user_id='055436238f3a4e2b9a1ed648cd24d12f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:01:34 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-39b66f60-a7c9-48b7-bd15-25444ef8e8e2 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb816f3f-892a-486a-a7b6-a5a745628cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:01:34 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-39b66f60-a7c9-48b7-bd15-25444ef8e8e2 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb816f3f-892a-486a-a7b6-a5a745628cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:01:34 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-39b66f60-a7c9-48b7-bd15-25444ef8e8e2 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad7436cf-4d2e-4726-954d-484b537fd82b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:01:34 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-39b66f60-a7c9-48b7-bd15-25444ef8e8e2 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad7436cf-4d2e-4726-954d-484b537fd82b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92da3b2a-4c57-4f07-8425-400adcbef4ce', 'volume_name': 'volume-92da3b2a-4c57-4f07-8425-400adcbef4ce', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:01:34 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-39b66f60-a7c9-48b7-bd15-25444ef8e8e2 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8042af3c-849b-4764-8883-7367c9cca44f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:01:34 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-39b66f60-a7c9-48b7-bd15-25444ef8e8e2 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8042af3c-849b-4764-8883-7367c9cca44f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:01:34 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-39b66f60-a7c9-48b7-bd15-25444ef8e8e2 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e34703d-6251-49af-9a5a-7c76c7a1e384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:01:34 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-39b66f60-a7c9-48b7-bd15-25444ef8e8e2 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Volume 92da3b2a-4c57-4f07-8425-400adcbef4ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92da3b2a-4c57-4f07-8425-400adcbef4ce', 'volume_size': 1}
Jun 15 16:01:34 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-39b66f60-a7c9-48b7-bd15-25444ef8e8e2 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:01:34 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-39b66f60-a7c9-48b7-bd15-25444ef8e8e2 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:01:34 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-39b66f60-a7c9-48b7-bd15-25444ef8e8e2 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:01:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-544269552',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92da3b2a-4c57-4f07-8425-400adcbef4ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ceaefcebdc94eb397df6c7b8f2294c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:01:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:01:35Z,use_quota=True,user_id='055436238f3a4e2b9a1ed648cd24d12f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 16:01:34 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-39b66f60-a7c9-48b7-bd15-25444ef8e8e2 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Creating volume 92da3b2a-4c57-4f07-8425-400adcbef4ce {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 16:01:34 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-39b66f60-a7c9-48b7-bd15-25444ef8e8e2 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:01:34 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-39b66f60-a7c9-48b7-bd15-25444ef8e8e2 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:01:34 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-39b66f60-a7c9-48b7-bd15-25444ef8e8e2 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:01:34 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-39b66f60-a7c9-48b7-bd15-25444ef8e8e2 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:01:34 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-39b66f60-a7c9-48b7-bd15-25444ef8e8e2 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:01:34 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-39b66f60-a7c9-48b7-bd15-25444ef8e8e2 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 16:01:34 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-39b66f60-a7c9-48b7-bd15-25444ef8e8e2 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 16:01:34 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-39b66f60-a7c9-48b7-bd15-25444ef8e8e2 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-92da3b2a-4c57-4f07-8425-400adcbef4ce 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:01:34 devstack sudo[105083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-92da3b2a-4c57-4f07-8425-400adcbef4ce 1073741824
Jun 15 16:01:34 devstack sudo[105083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:01:35 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-82e90d72-28a2-44c6-8a9e-8b688aac7092 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 16:01:35 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-82e90d72-28a2-44c6-8a9e-8b688aac7092 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Flow 'volume_create_manager' (d243d131-8f7d-468e-ac18-a18209202867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:01:35 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-82e90d72-28a2-44c6-8a9e-8b688aac7092 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7722fa27-b93c-45fa-abbd-be92794d8509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:01:35 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-82e90d72-28a2-44c6-8a9e-8b688aac7092 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7722fa27-b93c-45fa-abbd-be92794d8509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:01:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-450412176',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46cb7365-c079-4ee8-9dec-2a9563f44589,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ceaefcebdc94eb397df6c7b8f2294c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:01:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:01:35Z,use_quota=True,user_id='055436238f3a4e2b9a1ed648cd24d12f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:01:35 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-82e90d72-28a2-44c6-8a9e-8b688aac7092 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ff058c2-621f-4d2d-b599-c650ca1c5177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:01:35 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-82e90d72-28a2-44c6-8a9e-8b688aac7092 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ff058c2-621f-4d2d-b599-c650ca1c5177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:01:35 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-82e90d72-28a2-44c6-8a9e-8b688aac7092 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3263f241-6e8a-4c16-abfe-48cd4398bfda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:01:35 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-82e90d72-28a2-44c6-8a9e-8b688aac7092 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3263f241-6e8a-4c16-abfe-48cd4398bfda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46cb7365-c079-4ee8-9dec-2a9563f44589', 'volume_name': 'volume-46cb7365-c079-4ee8-9dec-2a9563f44589', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:01:35 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-82e90d72-28a2-44c6-8a9e-8b688aac7092 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de64ffe5-14e7-49e3-abad-f18ab4feb140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:01:35 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-82e90d72-28a2-44c6-8a9e-8b688aac7092 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de64ffe5-14e7-49e3-abad-f18ab4feb140) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:01:35 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-82e90d72-28a2-44c6-8a9e-8b688aac7092 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82ac1108-0e2c-4b4d-b2ce-f8bfb4308fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:01:35 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-82e90d72-28a2-44c6-8a9e-8b688aac7092 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Volume 46cb7365-c079-4ee8-9dec-2a9563f44589: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46cb7365-c079-4ee8-9dec-2a9563f44589', 'volume_size': 1}
Jun 15 16:01:35 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-82e90d72-28a2-44c6-8a9e-8b688aac7092 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:01:35 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-a14d8192-e7ed-4322-bf97-f8988dd957b7 tempest-VolumesGetTest-1408686534 None] Acquiring lock "cinder-9a0e2e0a-80fa-4f2b-8dea-a0f1bd53cfe3-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:01:35 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-a14d8192-e7ed-4322-bf97-f8988dd957b7 tempest-VolumesGetTest-1408686534 None] Lock "cinder-9a0e2e0a-80fa-4f2b-8dea-a0f1bd53cfe3-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:01:35 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-a14d8192-e7ed-4322-bf97-f8988dd957b7 tempest-VolumesGetTest-1408686534 None] Acquiring lock "cinder-quobyte-9a0e2e0a-80fa-4f2b-8dea-a0f1bd53cfe3" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:01:35 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-a14d8192-e7ed-4322-bf97-f8988dd957b7 tempest-VolumesGetTest-1408686534 None] Lock "cinder-quobyte-9a0e2e0a-80fa-4f2b-8dea-a0f1bd53cfe3" acquired by "delete_volume" :: waited 0.017s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:01:35 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8527c2b-1597-4b9e-8db1-8aa98e94c99e]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:01:35 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-a14d8192-e7ed-4322-bf97-f8988dd957b7 tempest-VolumesGetTest-1408686534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-9a0e2e0a-80fa-4f2b-8dea-a0f1bd53cfe3 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:01:35 devstack sudo[105085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-9a0e2e0a-80fa-4f2b-8dea-a0f1bd53cfe3
Jun 15 16:01:35 devstack sudo[105085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:01:35 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e28c734-993b-4d75-b6f7-ece3c1514cdb tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 16:01:35 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-0e28c734-993b-4d75-b6f7-ece3c1514cdb tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Flow 'volume_create_manager' (60d1407d-b401-42c1-8c13-bb64cd9bf417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:01:35 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-0e28c734-993b-4d75-b6f7-ece3c1514cdb tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d10c5ff7-9883-4277-810b-0f73b4d3be27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:01:35 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-0e28c734-993b-4d75-b6f7-ece3c1514cdb tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d10c5ff7-9883-4277-810b-0f73b4d3be27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:01:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-347760951',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9db40b65-f88c-468e-8ba2-72e6901da642,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ceaefcebdc94eb397df6c7b8f2294c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:01:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:01:36Z,use_quota=True,user_id='055436238f3a4e2b9a1ed648cd24d12f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:01:35 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-0e28c734-993b-4d75-b6f7-ece3c1514cdb tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (673c2c38-4cb7-4c13-aabb-81fd95091a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:01:35 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-0e28c734-993b-4d75-b6f7-ece3c1514cdb tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (673c2c38-4cb7-4c13-aabb-81fd95091a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:01:35 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-0e28c734-993b-4d75-b6f7-ece3c1514cdb tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d0aaf88-841d-4896-81e9-3f775b7957aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:01:35 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-0e28c734-993b-4d75-b6f7-ece3c1514cdb tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d0aaf88-841d-4896-81e9-3f775b7957aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9db40b65-f88c-468e-8ba2-72e6901da642', 'volume_name': 'volume-9db40b65-f88c-468e-8ba2-72e6901da642', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:01:35 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-0e28c734-993b-4d75-b6f7-ece3c1514cdb tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4686765c-0371-44b5-a41c-3cc45101f3ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:01:35 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-0e28c734-993b-4d75-b6f7-ece3c1514cdb tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4686765c-0371-44b5-a41c-3cc45101f3ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:01:35 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-0e28c734-993b-4d75-b6f7-ece3c1514cdb tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4acd61a-ee0e-4a59-8a6d-52c2545ac6ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:01:35 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-0e28c734-993b-4d75-b6f7-ece3c1514cdb tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Volume 9db40b65-f88c-468e-8ba2-72e6901da642: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9db40b65-f88c-468e-8ba2-72e6901da642', 'volume_size': 1}
Jun 15 16:01:35 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-0e28c734-993b-4d75-b6f7-ece3c1514cdb tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:01:36 devstack sudo[105083]: pam_unix(sudo:session): session closed for user root
Jun 15 16:01:36 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-39b66f60-a7c9-48b7-bd15-25444ef8e8e2 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-92da3b2a-4c57-4f07-8425-400adcbef4ce 1073741824" returned: 0 in 1.254s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:01:36 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-39b66f60-a7c9-48b7-bd15-25444ef8e8e2 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-92da3b2a-4c57-4f07-8425-400adcbef4ce {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:01:36 devstack sudo[105126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-92da3b2a-4c57-4f07-8425-400adcbef4ce
Jun 15 16:01:36 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fea9c76-d33b-4bf4-b0dc-2174043ed23c tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 16:01:36 devstack sudo[105126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:01:36 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-1fea9c76-d33b-4bf4-b0dc-2174043ed23c tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Flow 'volume_create_manager' (ee95fcfb-caeb-4efb-9268-58013fa04566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:01:36 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-1fea9c76-d33b-4bf4-b0dc-2174043ed23c tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffaae2ef-54df-4319-8279-ef1434c43349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:01:36 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-1fea9c76-d33b-4bf4-b0dc-2174043ed23c tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffaae2ef-54df-4319-8279-ef1434c43349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:01:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-17748402',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9f1b2e9-a68d-4f8b-b733-d453511f3ce1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ceaefcebdc94eb397df6c7b8f2294c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:01:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:01:36Z,use_quota=True,user_id='055436238f3a4e2b9a1ed648cd24d12f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:01:36 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-1fea9c76-d33b-4bf4-b0dc-2174043ed23c tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b01a9b9-06b6-4d1a-8552-79f898e57b7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:01:36 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-1fea9c76-d33b-4bf4-b0dc-2174043ed23c tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b01a9b9-06b6-4d1a-8552-79f898e57b7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:01:36 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-1fea9c76-d33b-4bf4-b0dc-2174043ed23c tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01a509be-0b89-4251-8117-34595a6b2eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:01:36 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-1fea9c76-d33b-4bf4-b0dc-2174043ed23c tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01a509be-0b89-4251-8117-34595a6b2eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9f1b2e9-a68d-4f8b-b733-d453511f3ce1', 'volume_name': 'volume-d9f1b2e9-a68d-4f8b-b733-d453511f3ce1', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:01:36 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-1fea9c76-d33b-4bf4-b0dc-2174043ed23c tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e9ed377-5d87-4f8b-8faa-e25e33f0437a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:01:36 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-1fea9c76-d33b-4bf4-b0dc-2174043ed23c tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e9ed377-5d87-4f8b-8faa-e25e33f0437a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:01:36 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-1fea9c76-d33b-4bf4-b0dc-2174043ed23c tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aecbad18-2764-4347-99bd-eaa0bcf89703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:01:36 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-1fea9c76-d33b-4bf4-b0dc-2174043ed23c tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Volume d9f1b2e9-a68d-4f8b-b733-d453511f3ce1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9f1b2e9-a68d-4f8b-b733-d453511f3ce1', 'volume_size': 1}
Jun 15 16:01:36 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-1fea9c76-d33b-4bf4-b0dc-2174043ed23c tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:01:36 devstack sudo[105085]: pam_unix(sudo:session): session closed for user root
Jun 15 16:01:36 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-a14d8192-e7ed-4322-bf97-f8988dd957b7 tempest-VolumesGetTest-1408686534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-9a0e2e0a-80fa-4f2b-8dea-a0f1bd53cfe3" returned: 0 in 1.197s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:01:36 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-a14d8192-e7ed-4322-bf97-f8988dd957b7 tempest-VolumesGetTest-1408686534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-9a0e2e0a-80fa-4f2b-8dea-a0f1bd53cfe3 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:01:36 devstack sudo[105131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-9a0e2e0a-80fa-4f2b-8dea-a0f1bd53cfe3
Jun 15 16:01:36 devstack sudo[105131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:01:36 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-64ce3b7b-3038-4034-a80f-fc1660518386 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 16:01:36 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-64ce3b7b-3038-4034-a80f-fc1660518386 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Flow 'volume_create_manager' (40ace148-ad85-43d7-af39-6f6aaf9218a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:01:36 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-64ce3b7b-3038-4034-a80f-fc1660518386 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ade24af-8896-45bf-82c5-ae892c27558a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:01:36 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-64ce3b7b-3038-4034-a80f-fc1660518386 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ade24af-8896-45bf-82c5-ae892c27558a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:01:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2089136954',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a86ab290-d33a-477f-825e-d73c1b440034,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ceaefcebdc94eb397df6c7b8f2294c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:01:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:01:37Z,use_quota=True,user_id='055436238f3a4e2b9a1ed648cd24d12f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:01:36 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-64ce3b7b-3038-4034-a80f-fc1660518386 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6ca179f-fe15-4f06-88ca-306084e5f1c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:01:36 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-64ce3b7b-3038-4034-a80f-fc1660518386 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6ca179f-fe15-4f06-88ca-306084e5f1c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:01:36 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-64ce3b7b-3038-4034-a80f-fc1660518386 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6422bc48-c1f7-4d84-b8c1-dea54ddddcd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:01:36 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-64ce3b7b-3038-4034-a80f-fc1660518386 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6422bc48-c1f7-4d84-b8c1-dea54ddddcd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a86ab290-d33a-477f-825e-d73c1b440034', 'volume_name': 'volume-a86ab290-d33a-477f-825e-d73c1b440034', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:01:36 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-64ce3b7b-3038-4034-a80f-fc1660518386 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b5be8b8-6f99-4cb5-892b-db80b2b17a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:01:36 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-64ce3b7b-3038-4034-a80f-fc1660518386 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b5be8b8-6f99-4cb5-892b-db80b2b17a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:01:36 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-64ce3b7b-3038-4034-a80f-fc1660518386 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d7dec6a-02af-4f2a-aa9c-1c288c043e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:01:36 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-64ce3b7b-3038-4034-a80f-fc1660518386 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Volume a86ab290-d33a-477f-825e-d73c1b440034: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a86ab290-d33a-477f-825e-d73c1b440034', 'volume_size': 1}
Jun 15 16:01:36 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-64ce3b7b-3038-4034-a80f-fc1660518386 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:01:37 devstack sudo[105126]: pam_unix(sudo:session): session closed for user root
Jun 15 16:01:37 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-39b66f60-a7c9-48b7-bd15-25444ef8e8e2 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-92da3b2a-4c57-4f07-8425-400adcbef4ce" returned: 0 in 0.864s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:01:37 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-39b66f60-a7c9-48b7-bd15-25444ef8e8e2 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] <== create_volume: return (2187ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 16:01:37 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-39b66f60-a7c9-48b7-bd15-25444ef8e8e2 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.189s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:01:37 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-82e90d72-28a2-44c6-8a9e-8b688aac7092 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.741s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:01:37 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-82e90d72-28a2-44c6-8a9e-8b688aac7092 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:01:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-450412176',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46cb7365-c079-4ee8-9dec-2a9563f44589,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ceaefcebdc94eb397df6c7b8f2294c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:01:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:01:35Z,use_quota=True,user_id='055436238f3a4e2b9a1ed648cd24d12f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 16:01:37 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-82e90d72-28a2-44c6-8a9e-8b688aac7092 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Creating volume 46cb7365-c079-4ee8-9dec-2a9563f44589 {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 16:01:37 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-82e90d72-28a2-44c6-8a9e-8b688aac7092 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:01:37 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-82e90d72-28a2-44c6-8a9e-8b688aac7092 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:01:37 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-82e90d72-28a2-44c6-8a9e-8b688aac7092 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:01:37 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-82e90d72-28a2-44c6-8a9e-8b688aac7092 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:01:37 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-82e90d72-28a2-44c6-8a9e-8b688aac7092 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:01:37 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-82e90d72-28a2-44c6-8a9e-8b688aac7092 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 16:01:37 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-82e90d72-28a2-44c6-8a9e-8b688aac7092 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 16:01:37 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-82e90d72-28a2-44c6-8a9e-8b688aac7092 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-46cb7365-c079-4ee8-9dec-2a9563f44589 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:01:37 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-39b66f60-a7c9-48b7-bd15-25444ef8e8e2 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e34703d-6251-49af-9a5a-7c76c7a1e384) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92da3b2a-4c57-4f07-8425-400adcbef4ce', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:01:37 devstack sudo[105134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-46cb7365-c079-4ee8-9dec-2a9563f44589 1073741824
Jun 15 16:01:37 devstack sudo[105134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:01:37 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-39b66f60-a7c9-48b7-bd15-25444ef8e8e2 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28ac4c04-dcdc-4877-bbc2-87f6e14589b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:01:37 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-39b66f60-a7c9-48b7-bd15-25444ef8e8e2 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Volume volume-92da3b2a-4c57-4f07-8425-400adcbef4ce (92da3b2a-4c57-4f07-8425-400adcbef4ce): created successfully
Jun 15 16:01:37 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-39b66f60-a7c9-48b7-bd15-25444ef8e8e2 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28ac4c04-dcdc-4877-bbc2-87f6e14589b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:01:37 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-39b66f60-a7c9-48b7-bd15-25444ef8e8e2 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Flow 'volume_create_manager' (28075432-b258-40f8-8a08-53e5710b4f86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:01:37 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-39b66f60-a7c9-48b7-bd15-25444ef8e8e2 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Created volume successfully.
Jun 15 16:01:37 devstack sudo[105131]: pam_unix(sudo:session): session closed for user root
Jun 15 16:01:37 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-a14d8192-e7ed-4322-bf97-f8988dd957b7 tempest-VolumesGetTest-1408686534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-9a0e2e0a-80fa-4f2b-8dea-a0f1bd53cfe3" returned: 0 in 0.728s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:01:37 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-a14d8192-e7ed-4322-bf97-f8988dd957b7 tempest-VolumesGetTest-1408686534 None] Lock "cinder-quobyte-9a0e2e0a-80fa-4f2b-8dea-a0f1bd53cfe3" released by "delete_volume" :: held 1.987s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:01:37 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-a14d8192-e7ed-4322-bf97-f8988dd957b7 tempest-VolumesGetTest-1408686534 None] Created reservations ['3455f822-47c0-4670-bdc4-07401946a434', '625c2161-0a61-4fc0-8a78-69c42e2475b9', '9cb0eee6-e5c8-45f6-9152-b855b15042f9', '43b1b933-0f1f-452f-abb3-89fe49ab3e9f'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 16:01:37 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-a14d8192-e7ed-4322-bf97-f8988dd957b7 tempest-VolumesGetTest-1408686534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:01:37 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-a14d8192-e7ed-4322-bf97-f8988dd957b7 tempest-VolumesGetTest-1408686534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:01:37 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-a14d8192-e7ed-4322-bf97-f8988dd957b7 tempest-VolumesGetTest-1408686534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:01:37 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-a14d8192-e7ed-4322-bf97-f8988dd957b7 tempest-VolumesGetTest-1408686534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:01:37 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-a14d8192-e7ed-4322-bf97-f8988dd957b7 tempest-VolumesGetTest-1408686534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:01:37 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-a14d8192-e7ed-4322-bf97-f8988dd957b7 tempest-VolumesGetTest-1408686534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:01:37 devstack sudo[105139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 16:01:37 devstack sudo[105139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:01:37 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-39df96b0-cf1d-41cf-b551-2f383710776d tempest-VolumesGetTest-1408686534 None] Acquiring lock "cinder-24558490-eb43-4adc-b875-52a19506064a-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:01:37 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-39df96b0-cf1d-41cf-b551-2f383710776d tempest-VolumesGetTest-1408686534 None] Lock "cinder-24558490-eb43-4adc-b875-52a19506064a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:01:37 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-39df96b0-cf1d-41cf-b551-2f383710776d tempest-VolumesGetTest-1408686534 None] Acquiring lock "cinder-quobyte-24558490-eb43-4adc-b875-52a19506064a" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:01:37 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-39df96b0-cf1d-41cf-b551-2f383710776d tempest-VolumesGetTest-1408686534 None] Lock "cinder-quobyte-24558490-eb43-4adc-b875-52a19506064a" acquired by "delete_volume" :: waited 0.018s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:01:37 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[109577d0-4db4-4fcc-ac9b-3d36cffe263e]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:01:37 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-39df96b0-cf1d-41cf-b551-2f383710776d tempest-VolumesGetTest-1408686534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-24558490-eb43-4adc-b875-52a19506064a {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:01:38 devstack sudo[105144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-24558490-eb43-4adc-b875-52a19506064a
Jun 15 16:01:38 devstack sudo[105144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:01:38 devstack sudo[105134]: pam_unix(sudo:session): session closed for user root
Jun 15 16:01:38 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-82e90d72-28a2-44c6-8a9e-8b688aac7092 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-46cb7365-c079-4ee8-9dec-2a9563f44589 1073741824" returned: 0 in 1.095s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:01:38 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-82e90d72-28a2-44c6-8a9e-8b688aac7092 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-46cb7365-c079-4ee8-9dec-2a9563f44589 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:01:38 devstack sudo[105147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-46cb7365-c079-4ee8-9dec-2a9563f44589
Jun 15 16:01:38 devstack sudo[105147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:01:38 devstack sudo[105139]: pam_unix(sudo:session): session closed for user root
Jun 15 16:01:38 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-a14d8192-e7ed-4322-bf97-f8988dd957b7 tempest-VolumesGetTest-1408686534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.758s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:01:38 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-a14d8192-e7ed-4322-bf97-f8988dd957b7 tempest-VolumesGetTest-1408686534 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 16:01:38 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-a14d8192-e7ed-4322-bf97-f8988dd957b7 tempest-VolumesGetTest-1408686534 None] Deleted volume successfully.
Jun 15 16:01:38 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-a14d8192-e7ed-4322-bf97-f8988dd957b7 tempest-VolumesGetTest-1408686534 None] Lock "cinder-9a0e2e0a-80fa-4f2b-8dea-a0f1bd53cfe3-delete_volume" released by "delete_volume" :: held 3.031s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:01:38 devstack sudo[105144]: pam_unix(sudo:session): session closed for user root
Jun 15 16:01:38 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-39df96b0-cf1d-41cf-b551-2f383710776d tempest-VolumesGetTest-1408686534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-24558490-eb43-4adc-b875-52a19506064a" returned: 0 in 0.784s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:01:38 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-39df96b0-cf1d-41cf-b551-2f383710776d tempest-VolumesGetTest-1408686534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-24558490-eb43-4adc-b875-52a19506064a {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:01:38 devstack sudo[105153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-24558490-eb43-4adc-b875-52a19506064a
Jun 15 16:01:38 devstack sudo[105153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:01:38 devstack sudo[105147]: pam_unix(sudo:session): session closed for user root
Jun 15 16:01:38 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-82e90d72-28a2-44c6-8a9e-8b688aac7092 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-46cb7365-c079-4ee8-9dec-2a9563f44589" returned: 0 in 0.619s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:01:38 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-82e90d72-28a2-44c6-8a9e-8b688aac7092 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] <== create_volume: return (1770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 16:01:38 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-82e90d72-28a2-44c6-8a9e-8b688aac7092 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.775s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:01:38 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-0e28c734-993b-4d75-b6f7-ece3c1514cdb tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.947s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:01:38 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-0e28c734-993b-4d75-b6f7-ece3c1514cdb tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:01:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-347760951',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9db40b65-f88c-468e-8ba2-72e6901da642,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ceaefcebdc94eb397df6c7b8f2294c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:01:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:01:36Z,use_quota=True,user_id='055436238f3a4e2b9a1ed648cd24d12f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 16:01:38 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-0e28c734-993b-4d75-b6f7-ece3c1514cdb tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Creating volume 9db40b65-f88c-468e-8ba2-72e6901da642 {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 16:01:38 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-0e28c734-993b-4d75-b6f7-ece3c1514cdb tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:01:38 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-0e28c734-993b-4d75-b6f7-ece3c1514cdb tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:01:38 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-0e28c734-993b-4d75-b6f7-ece3c1514cdb tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:01:38 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-0e28c734-993b-4d75-b6f7-ece3c1514cdb tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:01:38 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-0e28c734-993b-4d75-b6f7-ece3c1514cdb tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:01:38 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-0e28c734-993b-4d75-b6f7-ece3c1514cdb tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 16:01:38 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-0e28c734-993b-4d75-b6f7-ece3c1514cdb tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 16:01:38 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-0e28c734-993b-4d75-b6f7-ece3c1514cdb tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-9db40b65-f88c-468e-8ba2-72e6901da642 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:01:38 devstack sudo[105156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-9db40b65-f88c-468e-8ba2-72e6901da642 1073741824
Jun 15 16:01:38 devstack sudo[105156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:01:38 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-82e90d72-28a2-44c6-8a9e-8b688aac7092 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82ac1108-0e2c-4b4d-b2ce-f8bfb4308fb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46cb7365-c079-4ee8-9dec-2a9563f44589', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:01:38 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-82e90d72-28a2-44c6-8a9e-8b688aac7092 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (889ea78a-9114-42e0-9cb6-32c3bf0f1c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:01:38 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-82e90d72-28a2-44c6-8a9e-8b688aac7092 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Volume volume-46cb7365-c079-4ee8-9dec-2a9563f44589 (46cb7365-c079-4ee8-9dec-2a9563f44589): created successfully
Jun 15 16:01:38 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-82e90d72-28a2-44c6-8a9e-8b688aac7092 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (889ea78a-9114-42e0-9cb6-32c3bf0f1c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:01:38 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-82e90d72-28a2-44c6-8a9e-8b688aac7092 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Flow 'volume_create_manager' (d243d131-8f7d-468e-ac18-a18209202867) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:01:38 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-82e90d72-28a2-44c6-8a9e-8b688aac7092 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Created volume successfully.
Jun 15 16:01:39 devstack sudo[105153]: pam_unix(sudo:session): session closed for user root
Jun 15 16:01:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-39df96b0-cf1d-41cf-b551-2f383710776d tempest-VolumesGetTest-1408686534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-24558490-eb43-4adc-b875-52a19506064a" returned: 0 in 0.618s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:01:39 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-39df96b0-cf1d-41cf-b551-2f383710776d tempest-VolumesGetTest-1408686534 None] Lock "cinder-quobyte-24558490-eb43-4adc-b875-52a19506064a" released by "delete_volume" :: held 1.455s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:01:39 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-39df96b0-cf1d-41cf-b551-2f383710776d tempest-VolumesGetTest-1408686534 None] Created reservations ['30b4eac1-877a-493c-a89a-4110697c6959', '314fdad9-2dcf-451f-8b21-c5da9394250a', '6b2652e9-dd95-4713-b67c-b5b033b31bfc', '26abfa0d-738b-4c7b-b928-e8deeb670d99'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 16:01:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-39df96b0-cf1d-41cf-b551-2f383710776d tempest-VolumesGetTest-1408686534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:01:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-39df96b0-cf1d-41cf-b551-2f383710776d tempest-VolumesGetTest-1408686534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:01:39 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-39df96b0-cf1d-41cf-b551-2f383710776d tempest-VolumesGetTest-1408686534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:01:39 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-39df96b0-cf1d-41cf-b551-2f383710776d tempest-VolumesGetTest-1408686534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:01:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-39df96b0-cf1d-41cf-b551-2f383710776d tempest-VolumesGetTest-1408686534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:01:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-39df96b0-cf1d-41cf-b551-2f383710776d tempest-VolumesGetTest-1408686534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:01:39 devstack sudo[105159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 16:01:39 devstack sudo[105159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:01:39 devstack sudo[105156]: pam_unix(sudo:session): session closed for user root
Jun 15 16:01:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-0e28c734-993b-4d75-b6f7-ece3c1514cdb tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-9db40b65-f88c-468e-8ba2-72e6901da642 1073741824" returned: 0 in 0.861s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:01:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-0e28c734-993b-4d75-b6f7-ece3c1514cdb tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-9db40b65-f88c-468e-8ba2-72e6901da642 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:01:39 devstack sudo[105164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-9db40b65-f88c-468e-8ba2-72e6901da642
Jun 15 16:01:39 devstack sudo[105164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:01:40 devstack sudo[105159]: pam_unix(sudo:session): session closed for user root
Jun 15 16:01:40 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-39df96b0-cf1d-41cf-b551-2f383710776d tempest-VolumesGetTest-1408686534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.667s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:01:40 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-39df96b0-cf1d-41cf-b551-2f383710776d tempest-VolumesGetTest-1408686534 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 16:01:40 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-39df96b0-cf1d-41cf-b551-2f383710776d tempest-VolumesGetTest-1408686534 None] Deleted volume successfully.
Jun 15 16:01:40 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-39df96b0-cf1d-41cf-b551-2f383710776d tempest-VolumesGetTest-1408686534 None] Lock "cinder-24558490-eb43-4adc-b875-52a19506064a-delete_volume" released by "delete_volume" :: held 2.340s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:01:40 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-22e8fa1c-cd52-48a6-b6fc-026a85607d59 tempest-VolumesGetTest-1408686534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 16:01:40 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-22e8fa1c-cd52-48a6-b6fc-026a85607d59 tempest-VolumesGetTest-1408686534 None] Flow 'volume_create_manager' (45720ce0-238e-4f4c-afd3-3b6682efeb43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:01:40 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-22e8fa1c-cd52-48a6-b6fc-026a85607d59 tempest-VolumesGetTest-1408686534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (523e7fe7-188f-4f4c-a0be-dc12c69cfcd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:01:40 devstack sudo[105164]: pam_unix(sudo:session): session closed for user root
Jun 15 16:01:40 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-0e28c734-993b-4d75-b6f7-ece3c1514cdb tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-9db40b65-f88c-468e-8ba2-72e6901da642" returned: 0 in 0.683s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:01:40 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-0e28c734-993b-4d75-b6f7-ece3c1514cdb tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] <== create_volume: return (1596ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 16:01:40 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-0e28c734-993b-4d75-b6f7-ece3c1514cdb tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.601s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:01:40 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-1fea9c76-d33b-4bf4-b0dc-2174043ed23c tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.102s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:01:40 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-1fea9c76-d33b-4bf4-b0dc-2174043ed23c tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:01:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-17748402',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9f1b2e9-a68d-4f8b-b733-d453511f3ce1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ceaefcebdc94eb397df6c7b8f2294c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:01:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:01:36Z,use_quota=True,user_id='055436238f3a4e2b9a1ed648cd24d12f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 16:01:40 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-1fea9c76-d33b-4bf4-b0dc-2174043ed23c tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Creating volume d9f1b2e9-a68d-4f8b-b733-d453511f3ce1 {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 16:01:40 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-1fea9c76-d33b-4bf4-b0dc-2174043ed23c tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:01:40 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-1fea9c76-d33b-4bf4-b0dc-2174043ed23c tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:01:40 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-1fea9c76-d33b-4bf4-b0dc-2174043ed23c tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:01:40 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-1fea9c76-d33b-4bf4-b0dc-2174043ed23c tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:01:40 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-1fea9c76-d33b-4bf4-b0dc-2174043ed23c tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:01:40 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-1fea9c76-d33b-4bf4-b0dc-2174043ed23c tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 16:01:40 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-1fea9c76-d33b-4bf4-b0dc-2174043ed23c tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 16:01:40 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-1fea9c76-d33b-4bf4-b0dc-2174043ed23c tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-d9f1b2e9-a68d-4f8b-b733-d453511f3ce1 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:01:40 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-22e8fa1c-cd52-48a6-b6fc-026a85607d59 tempest-VolumesGetTest-1408686534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (523e7fe7-188f-4f4c-a0be-dc12c69cfcd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:01:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1739151343',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51d196b8-a6c9-4d2d-af5a-def5370dd0d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b89be12fba7e480f872e67eec6dca5e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:01:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:01:40Z,use_quota=True,user_id='6fadaeabe0e54ddfaeda00f848c0c309',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:01:40 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-22e8fa1c-cd52-48a6-b6fc-026a85607d59 tempest-VolumesGetTest-1408686534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c89a3831-ea0b-4a7e-a32b-584bd1e8bc6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:01:40 devstack sudo[105168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-d9f1b2e9-a68d-4f8b-b733-d453511f3ce1 1073741824
Jun 15 16:01:40 devstack sudo[105168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:01:40 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-22e8fa1c-cd52-48a6-b6fc-026a85607d59 tempest-VolumesGetTest-1408686534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c89a3831-ea0b-4a7e-a32b-584bd1e8bc6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:01:40 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-22e8fa1c-cd52-48a6-b6fc-026a85607d59 tempest-VolumesGetTest-1408686534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db008ca9-c9d0-4944-978f-53611a723c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:01:40 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-22e8fa1c-cd52-48a6-b6fc-026a85607d59 tempest-VolumesGetTest-1408686534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db008ca9-c9d0-4944-978f-53611a723c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51d196b8-a6c9-4d2d-af5a-def5370dd0d3', 'volume_name': 'volume-51d196b8-a6c9-4d2d-af5a-def5370dd0d3', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:01:40 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-22e8fa1c-cd52-48a6-b6fc-026a85607d59 tempest-VolumesGetTest-1408686534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deee2840-39c1-49b4-93ff-fd506ab12701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:01:40 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-22e8fa1c-cd52-48a6-b6fc-026a85607d59 tempest-VolumesGetTest-1408686534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deee2840-39c1-49b4-93ff-fd506ab12701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:01:40 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-22e8fa1c-cd52-48a6-b6fc-026a85607d59 tempest-VolumesGetTest-1408686534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5599821f-5137-443b-8184-471461ca766d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:01:40 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-22e8fa1c-cd52-48a6-b6fc-026a85607d59 tempest-VolumesGetTest-1408686534 None] Volume 51d196b8-a6c9-4d2d-af5a-def5370dd0d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51d196b8-a6c9-4d2d-af5a-def5370dd0d3', 'volume_size': 1}
Jun 15 16:01:40 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-22e8fa1c-cd52-48a6-b6fc-026a85607d59 tempest-VolumesGetTest-1408686534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:01:40 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-0e28c734-993b-4d75-b6f7-ece3c1514cdb tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4acd61a-ee0e-4a59-8a6d-52c2545ac6ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9db40b65-f88c-468e-8ba2-72e6901da642', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:01:40 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-0e28c734-993b-4d75-b6f7-ece3c1514cdb tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a28356e-dfe5-4f83-9b5e-4bb6f615d7c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:01:40 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-0e28c734-993b-4d75-b6f7-ece3c1514cdb tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Volume volume-9db40b65-f88c-468e-8ba2-72e6901da642 (9db40b65-f88c-468e-8ba2-72e6901da642): created successfully
Jun 15 16:01:40 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-0e28c734-993b-4d75-b6f7-ece3c1514cdb tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a28356e-dfe5-4f83-9b5e-4bb6f615d7c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:01:40 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-0e28c734-993b-4d75-b6f7-ece3c1514cdb tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Flow 'volume_create_manager' (60d1407d-b401-42c1-8c13-bb64cd9bf417) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:01:40 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-0e28c734-993b-4d75-b6f7-ece3c1514cdb tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Created volume successfully.
Jun 15 16:01:41 devstack sudo[105168]: pam_unix(sudo:session): session closed for user root
Jun 15 16:01:41 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-1fea9c76-d33b-4bf4-b0dc-2174043ed23c tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-d9f1b2e9-a68d-4f8b-b733-d453511f3ce1 1073741824" returned: 0 in 0.854s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:01:41 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-1fea9c76-d33b-4bf4-b0dc-2174043ed23c tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-d9f1b2e9-a68d-4f8b-b733-d453511f3ce1 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:01:41 devstack sudo[105174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-d9f1b2e9-a68d-4f8b-b733-d453511f3ce1
Jun 15 16:01:41 devstack sudo[105174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:01:42 devstack sudo[105174]: pam_unix(sudo:session): session closed for user root
Jun 15 16:01:42 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-1fea9c76-d33b-4bf4-b0dc-2174043ed23c tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-d9f1b2e9-a68d-4f8b-b733-d453511f3ce1" returned: 0 in 0.629s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:01:42 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-1fea9c76-d33b-4bf4-b0dc-2174043ed23c tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] <== create_volume: return (1529ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 16:01:42 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-1fea9c76-d33b-4bf4-b0dc-2174043ed23c tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.533s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:01:42 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-64ce3b7b-3038-4034-a80f-fc1660518386 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.048s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:01:42 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-64ce3b7b-3038-4034-a80f-fc1660518386 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:01:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2089136954',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a86ab290-d33a-477f-825e-d73c1b440034,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ceaefcebdc94eb397df6c7b8f2294c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:01:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:01:37Z,use_quota=True,user_id='055436238f3a4e2b9a1ed648cd24d12f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 16:01:42 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-64ce3b7b-3038-4034-a80f-fc1660518386 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Creating volume a86ab290-d33a-477f-825e-d73c1b440034 {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 16:01:42 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-64ce3b7b-3038-4034-a80f-fc1660518386 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:01:42 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-64ce3b7b-3038-4034-a80f-fc1660518386 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:01:42 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-64ce3b7b-3038-4034-a80f-fc1660518386 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:01:42 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-64ce3b7b-3038-4034-a80f-fc1660518386 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:01:42 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-64ce3b7b-3038-4034-a80f-fc1660518386 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:01:42 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-64ce3b7b-3038-4034-a80f-fc1660518386 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 16:01:42 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-64ce3b7b-3038-4034-a80f-fc1660518386 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 16:01:42 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-64ce3b7b-3038-4034-a80f-fc1660518386 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a86ab290-d33a-477f-825e-d73c1b440034 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:01:42 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-1fea9c76-d33b-4bf4-b0dc-2174043ed23c tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aecbad18-2764-4347-99bd-eaa0bcf89703) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9f1b2e9-a68d-4f8b-b733-d453511f3ce1', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:01:42 devstack sudo[105177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a86ab290-d33a-477f-825e-d73c1b440034 1073741824
Jun 15 16:01:42 devstack sudo[105177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:01:42 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-1fea9c76-d33b-4bf4-b0dc-2174043ed23c tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b738cd2-e960-4f42-ba1a-95075e4bfebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:01:42 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-1fea9c76-d33b-4bf4-b0dc-2174043ed23c tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Volume volume-d9f1b2e9-a68d-4f8b-b733-d453511f3ce1 (d9f1b2e9-a68d-4f8b-b733-d453511f3ce1): created successfully
Jun 15 16:01:42 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-1fea9c76-d33b-4bf4-b0dc-2174043ed23c tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b738cd2-e960-4f42-ba1a-95075e4bfebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:01:42 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-1fea9c76-d33b-4bf4-b0dc-2174043ed23c tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Flow 'volume_create_manager' (ee95fcfb-caeb-4efb-9268-58013fa04566) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:01:42 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-1fea9c76-d33b-4bf4-b0dc-2174043ed23c tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Created volume successfully.
Jun 15 16:01:43 devstack sudo[105177]: pam_unix(sudo:session): session closed for user root
Jun 15 16:01:43 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-64ce3b7b-3038-4034-a80f-fc1660518386 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a86ab290-d33a-477f-825e-d73c1b440034 1073741824" returned: 0 in 0.991s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:01:43 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-64ce3b7b-3038-4034-a80f-fc1660518386 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a86ab290-d33a-477f-825e-d73c1b440034 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:01:43 devstack sudo[105183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a86ab290-d33a-477f-825e-d73c1b440034
Jun 15 16:01:43 devstack sudo[105183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:01:43 devstack sudo[105183]: pam_unix(sudo:session): session closed for user root
Jun 15 16:01:43 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-64ce3b7b-3038-4034-a80f-fc1660518386 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a86ab290-d33a-477f-825e-d73c1b440034" returned: 0 in 0.753s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:01:43 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-64ce3b7b-3038-4034-a80f-fc1660518386 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] <== create_volume: return (1801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 16:01:43 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-64ce3b7b-3038-4034-a80f-fc1660518386 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.805s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:01:43 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-22e8fa1c-cd52-48a6-b6fc-026a85607d59 tempest-VolumesGetTest-1408686534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.279s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:01:43 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-22e8fa1c-cd52-48a6-b6fc-026a85607d59 tempest-VolumesGetTest-1408686534 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:01:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1739151343',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51d196b8-a6c9-4d2d-af5a-def5370dd0d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b89be12fba7e480f872e67eec6dca5e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:01:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:01:40Z,use_quota=True,user_id='6fadaeabe0e54ddfaeda00f848c0c309',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 16:01:43 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-22e8fa1c-cd52-48a6-b6fc-026a85607d59 tempest-VolumesGetTest-1408686534 None] Creating volume 51d196b8-a6c9-4d2d-af5a-def5370dd0d3 {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 16:01:43 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-22e8fa1c-cd52-48a6-b6fc-026a85607d59 tempest-VolumesGetTest-1408686534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:01:43 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-22e8fa1c-cd52-48a6-b6fc-026a85607d59 tempest-VolumesGetTest-1408686534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:01:43 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-22e8fa1c-cd52-48a6-b6fc-026a85607d59 tempest-VolumesGetTest-1408686534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:01:43 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-22e8fa1c-cd52-48a6-b6fc-026a85607d59 tempest-VolumesGetTest-1408686534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:01:43 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-22e8fa1c-cd52-48a6-b6fc-026a85607d59 tempest-VolumesGetTest-1408686534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:01:43 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-22e8fa1c-cd52-48a6-b6fc-026a85607d59 tempest-VolumesGetTest-1408686534 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 16:01:43 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-22e8fa1c-cd52-48a6-b6fc-026a85607d59 tempest-VolumesGetTest-1408686534 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 16:01:43 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-22e8fa1c-cd52-48a6-b6fc-026a85607d59 tempest-VolumesGetTest-1408686534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-51d196b8-a6c9-4d2d-af5a-def5370dd0d3 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:01:43 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-64ce3b7b-3038-4034-a80f-fc1660518386 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d7dec6a-02af-4f2a-aa9c-1c288c043e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a86ab290-d33a-477f-825e-d73c1b440034', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:01:43 devstack sudo[105186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-51d196b8-a6c9-4d2d-af5a-def5370dd0d3 1073741824
Jun 15 16:01:43 devstack sudo[105186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:01:43 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-64ce3b7b-3038-4034-a80f-fc1660518386 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (496c3634-0eaf-4f91-8638-79ac452ad5af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:01:43 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-64ce3b7b-3038-4034-a80f-fc1660518386 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Volume volume-a86ab290-d33a-477f-825e-d73c1b440034 (a86ab290-d33a-477f-825e-d73c1b440034): created successfully
Jun 15 16:01:43 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-64ce3b7b-3038-4034-a80f-fc1660518386 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (496c3634-0eaf-4f91-8638-79ac452ad5af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:01:43 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-64ce3b7b-3038-4034-a80f-fc1660518386 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Flow 'volume_create_manager' (40ace148-ad85-43d7-af39-6f6aaf9218a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:01:43 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-64ce3b7b-3038-4034-a80f-fc1660518386 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Created volume successfully.
Jun 15 16:01:44 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-d752620a-e620-4f26-8f24-f15d43feab9f tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Acquiring lock "cinder-a86ab290-d33a-477f-825e-d73c1b440034-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:01:44 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-d752620a-e620-4f26-8f24-f15d43feab9f tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Lock "cinder-a86ab290-d33a-477f-825e-d73c1b440034-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:01:44 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-d752620a-e620-4f26-8f24-f15d43feab9f tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Acquiring lock "cinder-quobyte-a86ab290-d33a-477f-825e-d73c1b440034" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:01:44 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-d752620a-e620-4f26-8f24-f15d43feab9f tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Lock "cinder-quobyte-a86ab290-d33a-477f-825e-d73c1b440034" acquired by "delete_volume" :: waited 0.021s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:01:44 devstack sudo[105186]: pam_unix(sudo:session): session closed for user root
Jun 15 16:01:44 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-22e8fa1c-cd52-48a6-b6fc-026a85607d59 tempest-VolumesGetTest-1408686534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-51d196b8-a6c9-4d2d-af5a-def5370dd0d3 1073741824" returned: 0 in 1.026s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:01:44 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb964d05-a5b3-408e-97cb-2843bfe13e7c]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:01:44 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-d752620a-e620-4f26-8f24-f15d43feab9f tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a86ab290-d33a-477f-825e-d73c1b440034 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:01:44 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-22e8fa1c-cd52-48a6-b6fc-026a85607d59 tempest-VolumesGetTest-1408686534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-51d196b8-a6c9-4d2d-af5a-def5370dd0d3 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:01:44 devstack sudo[105212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-51d196b8-a6c9-4d2d-af5a-def5370dd0d3
Jun 15 16:01:44 devstack sudo[105212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:01:45 devstack sudo[105211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a86ab290-d33a-477f-825e-d73c1b440034
Jun 15 16:01:45 devstack sudo[105211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:01:45 devstack sudo[105212]: pam_unix(sudo:session): session closed for user root
Jun 15 16:01:45 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-22e8fa1c-cd52-48a6-b6fc-026a85607d59 tempest-VolumesGetTest-1408686534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-51d196b8-a6c9-4d2d-af5a-def5370dd0d3" returned: 0 in 0.712s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:01:45 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-22e8fa1c-cd52-48a6-b6fc-026a85607d59 tempest-VolumesGetTest-1408686534 None] <== create_volume: return (1792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 16:01:45 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-22e8fa1c-cd52-48a6-b6fc-026a85607d59 tempest-VolumesGetTest-1408686534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.796s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:01:45 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-22e8fa1c-cd52-48a6-b6fc-026a85607d59 tempest-VolumesGetTest-1408686534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5599821f-5137-443b-8184-471461ca766d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51d196b8-a6c9-4d2d-af5a-def5370dd0d3', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:01:45 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-22e8fa1c-cd52-48a6-b6fc-026a85607d59 tempest-VolumesGetTest-1408686534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94808526-bd0b-4be4-974d-83b627aa50e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:01:45 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-22e8fa1c-cd52-48a6-b6fc-026a85607d59 tempest-VolumesGetTest-1408686534 None] Volume volume-51d196b8-a6c9-4d2d-af5a-def5370dd0d3 (51d196b8-a6c9-4d2d-af5a-def5370dd0d3): created successfully
Jun 15 16:01:45 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-22e8fa1c-cd52-48a6-b6fc-026a85607d59 tempest-VolumesGetTest-1408686534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94808526-bd0b-4be4-974d-83b627aa50e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:01:45 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-22e8fa1c-cd52-48a6-b6fc-026a85607d59 tempest-VolumesGetTest-1408686534 None] Flow 'volume_create_manager' (45720ce0-238e-4f4c-afd3-3b6682efeb43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:01:45 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-22e8fa1c-cd52-48a6-b6fc-026a85607d59 tempest-VolumesGetTest-1408686534 None] Created volume successfully.
Jun 15 16:01:45 devstack sudo[105211]: pam_unix(sudo:session): session closed for user root
Jun 15 16:01:45 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-d752620a-e620-4f26-8f24-f15d43feab9f tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a86ab290-d33a-477f-825e-d73c1b440034" returned: 0 in 0.821s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:01:45 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-d752620a-e620-4f26-8f24-f15d43feab9f tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a86ab290-d33a-477f-825e-d73c1b440034 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:01:45 devstack sudo[105219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a86ab290-d33a-477f-825e-d73c1b440034
Jun 15 16:01:45 devstack sudo[105219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:01:46 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-470ca209-6915-4222-941b-af3827f4871f tempest-VolumesGetTest-1408686534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 16:01:46 devstack sudo[105219]: pam_unix(sudo:session): session closed for user root
Jun 15 16:01:46 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-d752620a-e620-4f26-8f24-f15d43feab9f tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a86ab290-d33a-477f-825e-d73c1b440034" returned: 0 in 0.680s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:01:46 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-470ca209-6915-4222-941b-af3827f4871f tempest-VolumesGetTest-1408686534 None] Flow 'volume_create_manager' (180a7096-896b-47b2-997b-a34f820464a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:01:46 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-470ca209-6915-4222-941b-af3827f4871f tempest-VolumesGetTest-1408686534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b2132d2-953d-4590-b9ce-a9b63c70335b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:01:46 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-d752620a-e620-4f26-8f24-f15d43feab9f tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Lock "cinder-quobyte-a86ab290-d33a-477f-825e-d73c1b440034" released by "delete_volume" :: held 1.584s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:01:46 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-470ca209-6915-4222-941b-af3827f4871f tempest-VolumesGetTest-1408686534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b2132d2-953d-4590-b9ce-a9b63c70335b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:01:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1080136570',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a3306ef-a859-4436-bb7b-446bcdddccdb,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b89be12fba7e480f872e67eec6dca5e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:01:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=51d196b8-a6c9-4d2d-af5a-def5370dd0d3,status='creating',terminated_at=None,updated_at=2026-06-15T14:01:46Z,use_quota=True,user_id='6fadaeabe0e54ddfaeda00f848c0c309',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:01:46 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-470ca209-6915-4222-941b-af3827f4871f tempest-VolumesGetTest-1408686534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b822637-fdab-4c2b-9f28-fd0f2e018286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:01:46 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-470ca209-6915-4222-941b-af3827f4871f tempest-VolumesGetTest-1408686534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b822637-fdab-4c2b-9f28-fd0f2e018286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:01:46 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-470ca209-6915-4222-941b-af3827f4871f tempest-VolumesGetTest-1408686534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2912fea-6b80-460c-be09-a1c42df5551e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:01:46 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-470ca209-6915-4222-941b-af3827f4871f tempest-VolumesGetTest-1408686534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2912fea-6b80-460c-be09-a1c42df5551e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '7a3306ef-a859-4436-bb7b-446bcdddccdb', 'volume_name': 'volume-7a3306ef-a859-4436-bb7b-446bcdddccdb', 'volume_size': 1, 'source_volid': '51d196b8-a6c9-4d2d-af5a-def5370dd0d3', 'source_volstatus': 'available'}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:01:46 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-470ca209-6915-4222-941b-af3827f4871f tempest-VolumesGetTest-1408686534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a628471-f536-499f-acab-7b777617de9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:01:46 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-470ca209-6915-4222-941b-af3827f4871f tempest-VolumesGetTest-1408686534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a628471-f536-499f-acab-7b777617de9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:01:46 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-470ca209-6915-4222-941b-af3827f4871f tempest-VolumesGetTest-1408686534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7be2148e-4521-47a0-bcd3-07aef905132b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:01:46 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-470ca209-6915-4222-941b-af3827f4871f tempest-VolumesGetTest-1408686534 None] Volume 7a3306ef-a859-4436-bb7b-446bcdddccdb: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-7a3306ef-a859-4436-bb7b-446bcdddccdb', 'volume_size': 1, 'source_volid': '51d196b8-a6c9-4d2d-af5a-def5370dd0d3', 'source_volstatus': 'available'}
Jun 15 16:01:46 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-470ca209-6915-4222-941b-af3827f4871f tempest-VolumesGetTest-1408686534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:01:46 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-470ca209-6915-4222-941b-af3827f4871f tempest-VolumesGetTest-1408686534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:01:46 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-470ca209-6915-4222-941b-af3827f4871f tempest-VolumesGetTest-1408686534 None] Cloning volume 51d196b8-a6c9-4d2d-af5a-def5370dd0d3 to volume 7a3306ef-a859-4436-bb7b-446bcdddccdb
Jun 15 16:01:46 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-470ca209-6915-4222-941b-af3827f4871f tempest-VolumesGetTest-1408686534 None] Creating offline snapshot 4ceb2b90-58a7-4cf3-96ea-62eff9d1b44b of volume 51d196b8-a6c9-4d2d-af5a-def5370dd0d3 {{(pid=91863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 15 16:01:46 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-d752620a-e620-4f26-8f24-f15d43feab9f tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Created reservations ['72ca4cc2-199e-4af8-b1a3-b885a4e2462f', '0a32df9c-c602-4657-b92c-e51c85f5477f', '0533abaf-91f1-41c1-8605-a18b1ab6c9e3', '6371079c-a5a0-4618-8e80-5bb3b60b3199'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 16:01:46 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c805833-0c08-4375-bb9c-b7d3a3a1bd33]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:01:46 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-470ca209-6915-4222-941b-af3827f4871f tempest-VolumesGetTest-1408686534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-51d196b8-a6c9-4d2d-af5a-def5370dd0d3 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:01:46 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-d752620a-e620-4f26-8f24-f15d43feab9f tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:01:46 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-d752620a-e620-4f26-8f24-f15d43feab9f tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:01:46 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-d752620a-e620-4f26-8f24-f15d43feab9f tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:01:46 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-d752620a-e620-4f26-8f24-f15d43feab9f tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:01:46 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-d752620a-e620-4f26-8f24-f15d43feab9f tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:01:46 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-d752620a-e620-4f26-8f24-f15d43feab9f tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:01:46 devstack sudo[105223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 16:01:46 devstack sudo[105222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-51d196b8-a6c9-4d2d-af5a-def5370dd0d3
Jun 15 16:01:46 devstack sudo[105222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:01:46 devstack sudo[105223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:01:47 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-1cfa450d-d0f8-4370-bc65-be7d2519fbce tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Acquiring lock "cinder-d9f1b2e9-a68d-4f8b-b733-d453511f3ce1-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:01:47 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-1cfa450d-d0f8-4370-bc65-be7d2519fbce tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Lock "cinder-d9f1b2e9-a68d-4f8b-b733-d453511f3ce1-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:01:47 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-1cfa450d-d0f8-4370-bc65-be7d2519fbce tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Acquiring lock "cinder-quobyte-d9f1b2e9-a68d-4f8b-b733-d453511f3ce1" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:01:47 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-1cfa450d-d0f8-4370-bc65-be7d2519fbce tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Lock "cinder-quobyte-d9f1b2e9-a68d-4f8b-b733-d453511f3ce1" acquired by "delete_volume" :: waited 0.028s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:01:47 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[59c6cc54-09da-4f68-ad3a-f1f65279a037]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:01:47 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-1cfa450d-d0f8-4370-bc65-be7d2519fbce tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-d9f1b2e9-a68d-4f8b-b733-d453511f3ce1 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:01:47 devstack sudo[105226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-d9f1b2e9-a68d-4f8b-b733-d453511f3ce1
Jun 15 16:01:47 devstack sudo[105226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:01:47 devstack sudo[105223]: pam_unix(sudo:session): session closed for user root
Jun 15 16:01:47 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-d752620a-e620-4f26-8f24-f15d43feab9f tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.699s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:01:47 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-d752620a-e620-4f26-8f24-f15d43feab9f tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 16:01:47 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-d752620a-e620-4f26-8f24-f15d43feab9f tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Deleted volume successfully.
Jun 15 16:01:47 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-d752620a-e620-4f26-8f24-f15d43feab9f tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Lock "cinder-a86ab290-d33a-477f-825e-d73c1b440034-delete_volume" released by "delete_volume" :: held 2.677s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:01:47 devstack sudo[105222]: pam_unix(sudo:session): session closed for user root
Jun 15 16:01:47 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-470ca209-6915-4222-941b-af3827f4871f tempest-VolumesGetTest-1408686534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-51d196b8-a6c9-4d2d-af5a-def5370dd0d3" returned: 0 in 0.890s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:01:47 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-470ca209-6915-4222-941b-af3827f4871f tempest-VolumesGetTest-1408686534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-51d196b8-a6c9-4d2d-af5a-def5370dd0d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-51d196b8-a6c9-4d2d-af5a-def5370dd0d3.4ceb2b90-58a7-4cf3-96ea-62eff9d1b44b 1G {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:01:47 devstack sudo[105232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-51d196b8-a6c9-4d2d-af5a-def5370dd0d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-51d196b8-a6c9-4d2d-af5a-def5370dd0d3.4ceb2b90-58a7-4cf3-96ea-62eff9d1b44b 1G
Jun 15 16:01:47 devstack sudo[105232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:01:47 devstack sudo[105226]: pam_unix(sudo:session): session closed for user root
Jun 15 16:01:48 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-1cfa450d-d0f8-4370-bc65-be7d2519fbce tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-d9f1b2e9-a68d-4f8b-b733-d453511f3ce1" returned: 0 in 0.812s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:01:48 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-1cfa450d-d0f8-4370-bc65-be7d2519fbce tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-d9f1b2e9-a68d-4f8b-b733-d453511f3ce1 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:01:48 devstack sudo[105241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-d9f1b2e9-a68d-4f8b-b733-d453511f3ce1
Jun 15 16:01:48 devstack sudo[105241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:01:48 devstack sudo[105232]: pam_unix(sudo:session): session closed for user root
Jun 15 16:01:48 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-470ca209-6915-4222-941b-af3827f4871f tempest-VolumesGetTest-1408686534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-51d196b8-a6c9-4d2d-af5a-def5370dd0d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-51d196b8-a6c9-4d2d-af5a-def5370dd0d3.4ceb2b90-58a7-4cf3-96ea-62eff9d1b44b 1G" returned: 0 in 0.918s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:01:48 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-470ca209-6915-4222-941b-af3827f4871f tempest-VolumesGetTest-1408686534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51d196b8-a6c9-4d2d-af5a-def5370dd0d3 -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-51d196b8-a6c9-4d2d-af5a-def5370dd0d3.4ceb2b90-58a7-4cf3-96ea-62eff9d1b44b {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:01:48 devstack sudo[105247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51d196b8-a6c9-4d2d-af5a-def5370dd0d3 -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-51d196b8-a6c9-4d2d-af5a-def5370dd0d3.4ceb2b90-58a7-4cf3-96ea-62eff9d1b44b
Jun 15 16:01:48 devstack sudo[105247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:01:48 devstack sudo[105241]: pam_unix(sudo:session): session closed for user root
Jun 15 16:01:48 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-1cfa450d-d0f8-4370-bc65-be7d2519fbce tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-d9f1b2e9-a68d-4f8b-b733-d453511f3ce1" returned: 0 in 0.684s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:01:48 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-1cfa450d-d0f8-4370-bc65-be7d2519fbce tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Lock "cinder-quobyte-d9f1b2e9-a68d-4f8b-b733-d453511f3ce1" released by "delete_volume" :: held 1.561s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:01:48 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-1cfa450d-d0f8-4370-bc65-be7d2519fbce tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Created reservations ['e571507d-932c-4063-b7c6-c2caa8be41d6', 'c52c0e1e-d01f-4a98-a3f5-100cee8f9fb2', '581c0941-cb60-4a1e-b2c1-707fe72ed424', 'af2f50de-3465-462b-bc0d-1dd03caa02e4'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 16:01:48 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-1cfa450d-d0f8-4370-bc65-be7d2519fbce tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:01:48 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-1cfa450d-d0f8-4370-bc65-be7d2519fbce tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:01:48 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-1cfa450d-d0f8-4370-bc65-be7d2519fbce tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:01:48 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-1cfa450d-d0f8-4370-bc65-be7d2519fbce tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:01:48 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-1cfa450d-d0f8-4370-bc65-be7d2519fbce tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:01:48 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-1cfa450d-d0f8-4370-bc65-be7d2519fbce tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:01:48 devstack sudo[105250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 16:01:48 devstack sudo[105250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:01:49 devstack sudo[105247]: pam_unix(sudo:session): session closed for user root
Jun 15 16:01:49 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-470ca209-6915-4222-941b-af3827f4871f tempest-VolumesGetTest-1408686534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51d196b8-a6c9-4d2d-af5a-def5370dd0d3 -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-51d196b8-a6c9-4d2d-af5a-def5370dd0d3.4ceb2b90-58a7-4cf3-96ea-62eff9d1b44b" returned: 0 in 0.728s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:01:49 devstack cinder-volume[91863]: WARNING cinder.volume.drivers.remotefs [None req-470ca209-6915-4222-941b-af3827f4871f tempest-VolumesGetTest-1408686534 None] /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-51d196b8-a6c9-4d2d-af5a-def5370dd0d3.4ceb2b90-58a7-4cf3-96ea-62eff9d1b44b is being set with open permissions: ugo+rw
Jun 15 16:01:49 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-470ca209-6915-4222-941b-af3827f4871f tempest-VolumesGetTest-1408686534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-51d196b8-a6c9-4d2d-af5a-def5370dd0d3.4ceb2b90-58a7-4cf3-96ea-62eff9d1b44b {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:01:49 devstack sudo[105255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-51d196b8-a6c9-4d2d-af5a-def5370dd0d3.4ceb2b90-58a7-4cf3-96ea-62eff9d1b44b
Jun 15 16:01:49 devstack sudo[105255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:01:49 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-574c94a0-6946-4c9a-80ac-7a2a6c767a1f tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Acquiring lock "cinder-9db40b65-f88c-468e-8ba2-72e6901da642-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:01:49 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-574c94a0-6946-4c9a-80ac-7a2a6c767a1f tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Lock "cinder-9db40b65-f88c-468e-8ba2-72e6901da642-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:01:49 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-574c94a0-6946-4c9a-80ac-7a2a6c767a1f tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Acquiring lock "cinder-quobyte-9db40b65-f88c-468e-8ba2-72e6901da642" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:01:49 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-574c94a0-6946-4c9a-80ac-7a2a6c767a1f tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Lock "cinder-quobyte-9db40b65-f88c-468e-8ba2-72e6901da642" acquired by "delete_volume" :: waited 0.026s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:01:49 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f2f9d2-2826-4d5c-95d1-534b6eed2c1a]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:01:49 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-574c94a0-6946-4c9a-80ac-7a2a6c767a1f tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-9db40b65-f88c-468e-8ba2-72e6901da642 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:01:49 devstack sudo[105250]: pam_unix(sudo:session): session closed for user root
Jun 15 16:01:49 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-1cfa450d-d0f8-4370-bc65-be7d2519fbce tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.669s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:01:49 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-1cfa450d-d0f8-4370-bc65-be7d2519fbce tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 16:01:49 devstack sudo[105258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-9db40b65-f88c-468e-8ba2-72e6901da642
Jun 15 16:01:49 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-1cfa450d-d0f8-4370-bc65-be7d2519fbce tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Deleted volume successfully.
Jun 15 16:01:49 devstack sudo[105258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:01:49 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-1cfa450d-d0f8-4370-bc65-be7d2519fbce tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Lock "cinder-d9f1b2e9-a68d-4f8b-b733-d453511f3ce1-delete_volume" released by "delete_volume" :: held 2.550s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:01:50 devstack sudo[105255]: pam_unix(sudo:session): session closed for user root
Jun 15 16:01:50 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-470ca209-6915-4222-941b-af3827f4871f tempest-VolumesGetTest-1408686534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-51d196b8-a6c9-4d2d-af5a-def5370dd0d3.4ceb2b90-58a7-4cf3-96ea-62eff9d1b44b" returned: 0 in 0.942s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:01:50 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-470ca209-6915-4222-941b-af3827f4871f tempest-VolumesGetTest-1408686534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-51d196b8-a6c9-4d2d-af5a-def5370dd0d3.info {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:01:50 devstack sudo[105315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-51d196b8-a6c9-4d2d-af5a-def5370dd0d3.info
Jun 15 16:01:50 devstack sudo[105315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:01:50 devstack sudo[105258]: pam_unix(sudo:session): session closed for user root
Jun 15 16:01:50 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-574c94a0-6946-4c9a-80ac-7a2a6c767a1f tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-9db40b65-f88c-468e-8ba2-72e6901da642" returned: 0 in 1.490s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:01:50 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-574c94a0-6946-4c9a-80ac-7a2a6c767a1f tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-9db40b65-f88c-468e-8ba2-72e6901da642 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:01:50 devstack sudo[105330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-9db40b65-f88c-468e-8ba2-72e6901da642
Jun 15 16:01:50 devstack sudo[105330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:01:51 devstack sudo[105315]: pam_unix(sudo:session): session closed for user root
Jun 15 16:01:51 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-470ca209-6915-4222-941b-af3827f4871f tempest-VolumesGetTest-1408686534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-51d196b8-a6c9-4d2d-af5a-def5370dd0d3.info" returned: 0 in 0.884s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:01:51 devstack cinder-volume[91863]: WARNING cinder.volume.drivers.remotefs [None req-470ca209-6915-4222-941b-af3827f4871f tempest-VolumesGetTest-1408686534 None] /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-51d196b8-a6c9-4d2d-af5a-def5370dd0d3.info is being set with open permissions: ugo+rw
Jun 15 16:01:51 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-470ca209-6915-4222-941b-af3827f4871f tempest-VolumesGetTest-1408686534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-51d196b8-a6c9-4d2d-af5a-def5370dd0d3.info {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:01:51 devstack sudo[105335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-51d196b8-a6c9-4d2d-af5a-def5370dd0d3.info
Jun 15 16:01:51 devstack sudo[105335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:01:51 devstack sudo[105330]: pam_unix(sudo:session): session closed for user root
Jun 15 16:01:51 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-574c94a0-6946-4c9a-80ac-7a2a6c767a1f tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-9db40b65-f88c-468e-8ba2-72e6901da642" returned: 0 in 0.855s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:01:51 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-574c94a0-6946-4c9a-80ac-7a2a6c767a1f tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Lock "cinder-quobyte-9db40b65-f88c-468e-8ba2-72e6901da642" released by "delete_volume" :: held 2.407s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:01:51 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-574c94a0-6946-4c9a-80ac-7a2a6c767a1f tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Created reservations ['2effd433-cadb-4055-9eaf-d6b55097c950', 'f773b053-c1c5-40f8-aede-fba39538f508', 'be39ca9e-a405-4412-865c-418d1800b19f', 'b36487d9-4910-499b-bf75-c5f5530207ea'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 16:01:51 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-574c94a0-6946-4c9a-80ac-7a2a6c767a1f tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:01:51 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-574c94a0-6946-4c9a-80ac-7a2a6c767a1f tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:01:51 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-574c94a0-6946-4c9a-80ac-7a2a6c767a1f tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:01:51 devstack sudo[105335]: pam_unix(sudo:session): session closed for user root
Jun 15 16:01:51 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-574c94a0-6946-4c9a-80ac-7a2a6c767a1f tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:01:51 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-574c94a0-6946-4c9a-80ac-7a2a6c767a1f tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:01:51 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-574c94a0-6946-4c9a-80ac-7a2a6c767a1f tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:01:51 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-470ca209-6915-4222-941b-af3827f4871f tempest-VolumesGetTest-1408686534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-51d196b8-a6c9-4d2d-af5a-def5370dd0d3.info" returned: 0 in 0.931s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:01:51 devstack sudo[105339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 16:01:51 devstack sudo[105339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:01:52 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-470ca209-6915-4222-941b-af3827f4871f tempest-VolumesGetTest-1408686534 None] Acquiring lock "cinder-quobyte-7a3306ef-a859-4436-bb7b-446bcdddccdb" by "_copy_volume_from_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:01:52 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-470ca209-6915-4222-941b-af3827f4871f tempest-VolumesGetTest-1408686534 None] Lock "cinder-quobyte-7a3306ef-a859-4436-bb7b-446bcdddccdb" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:01:52 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-470ca209-6915-4222-941b-af3827f4871f tempest-VolumesGetTest-1408686534 None] snapshot: 4ceb2b90-58a7-4cf3-96ea-62eff9d1b44b, volume: 7a3306ef-a859-4436-bb7b-446bcdddccdb,  {{(pid=91863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 15 16:01:52 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-470ca209-6915-4222-941b-af3827f4871f tempest-VolumesGetTest-1408686534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:01:52 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-470ca209-6915-4222-941b-af3827f4871f tempest-VolumesGetTest-1408686534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:01:52 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-470ca209-6915-4222-941b-af3827f4871f tempest-VolumesGetTest-1408686534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:01:52 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-470ca209-6915-4222-941b-af3827f4871f tempest-VolumesGetTest-1408686534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:01:52 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-470ca209-6915-4222-941b-af3827f4871f tempest-VolumesGetTest-1408686534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:01:52 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[46bc6d98-ee9a-44dc-95bc-30db4a99dded]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:01:52 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-470ca209-6915-4222-941b-af3827f4871f tempest-VolumesGetTest-1408686534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-51d196b8-a6c9-4d2d-af5a-def5370dd0d3.4ceb2b90-58a7-4cf3-96ea-62eff9d1b44b {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:01:52 devstack sudo[105341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-51d196b8-a6c9-4d2d-af5a-def5370dd0d3.4ceb2b90-58a7-4cf3-96ea-62eff9d1b44b
Jun 15 16:01:52 devstack sudo[105341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:01:52 devstack sudo[105339]: pam_unix(sudo:session): session closed for user root
Jun 15 16:01:52 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-574c94a0-6946-4c9a-80ac-7a2a6c767a1f tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.773s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:01:52 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-574c94a0-6946-4c9a-80ac-7a2a6c767a1f tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 16:01:52 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-574c94a0-6946-4c9a-80ac-7a2a6c767a1f tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Deleted volume successfully.
Jun 15 16:01:52 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-574c94a0-6946-4c9a-80ac-7a2a6c767a1f tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Lock "cinder-9db40b65-f88c-468e-8ba2-72e6901da642-delete_volume" released by "delete_volume" :: held 3.505s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:01:52 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-390e1505-b229-41ce-80a3-a22cd9236d14 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Acquiring lock "cinder-46cb7365-c079-4ee8-9dec-2a9563f44589-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:01:52 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-390e1505-b229-41ce-80a3-a22cd9236d14 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Lock "cinder-46cb7365-c079-4ee8-9dec-2a9563f44589-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:01:52 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-390e1505-b229-41ce-80a3-a22cd9236d14 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Acquiring lock "cinder-quobyte-46cb7365-c079-4ee8-9dec-2a9563f44589" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:01:53 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-390e1505-b229-41ce-80a3-a22cd9236d14 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Lock "cinder-quobyte-46cb7365-c079-4ee8-9dec-2a9563f44589" acquired by "delete_volume" :: waited 0.052s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:01:53 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c9dc52-691c-4c82-ab2c-1a5c377bf636]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:01:53 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-390e1505-b229-41ce-80a3-a22cd9236d14 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-46cb7365-c079-4ee8-9dec-2a9563f44589 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:01:53 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-40c084cd-8cd6-44e4-9f49-64d6bd0796b2 tempest-VolumesActionsTest-1879812582 None] Acquiring lock "cinder-15763aef-e495-466a-b919-a0bb6171f0cf" by "attach_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:01:53 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-40c084cd-8cd6-44e4-9f49-64d6bd0796b2 tempest-VolumesActionsTest-1879812582 None] Lock "cinder-15763aef-e495-466a-b919-a0bb6171f0cf" acquired by "attach_volume" :: waited 0.043s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:01:53 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-40c084cd-8cd6-44e4-9f49-64d6bd0796b2 tempest-VolumesActionsTest-1879812582 None] Attaching volume 15763aef-e495-466a-b919-a0bb6171f0cf to instance e27baa4f-8f97-4c09-8816-cf2916b40393 at mountpoint /dev/vdb on host None.
Jun 15 16:01:53 devstack sudo[105344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-46cb7365-c079-4ee8-9dec-2a9563f44589
Jun 15 16:01:53 devstack sudo[105344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:01:53 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-40c084cd-8cd6-44e4-9f49-64d6bd0796b2 tempest-VolumesActionsTest-1879812582 None] Attach volume completed successfully.
Jun 15 16:01:53 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-40c084cd-8cd6-44e4-9f49-64d6bd0796b2 tempest-VolumesActionsTest-1879812582 None] Lock "cinder-15763aef-e495-466a-b919-a0bb6171f0cf" released by "attach_volume" :: held 0.149s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:01:53 devstack sudo[105341]: pam_unix(sudo:session): session closed for user root
Jun 15 16:01:53 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-470ca209-6915-4222-941b-af3827f4871f tempest-VolumesGetTest-1408686534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-51d196b8-a6c9-4d2d-af5a-def5370dd0d3.4ceb2b90-58a7-4cf3-96ea-62eff9d1b44b" returned: 0 in 1.259s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:01:53 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-470ca209-6915-4222-941b-af3827f4871f tempest-VolumesGetTest-1408686534 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51d196b8-a6c9-4d2d-af5a-def5370dd0d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 16:01:53 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-470ca209-6915-4222-941b-af3827f4871f tempest-VolumesGetTest-1408686534 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-51d196b8-a6c9-4d2d-af5a-def5370dd0d3 {{(pid=91863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 15 16:01:53 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-470ca209-6915-4222-941b-af3827f4871f tempest-VolumesGetTest-1408686534 None] Creating direct copy from snapshot {{(pid=91863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 15 16:01:53 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[09beb0ff-3503-4ff8-86cb-a48a21be7d38]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:01:53 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-470ca209-6915-4222-941b-af3827f4871f tempest-VolumesGetTest-1408686534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-51d196b8-a6c9-4d2d-af5a-def5370dd0d3 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:01:53 devstack sudo[105349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-51d196b8-a6c9-4d2d-af5a-def5370dd0d3
Jun 15 16:01:53 devstack sudo[105349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:01:53 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-f5b0b2d8-7d02-4937-8b44-6426da77d89d tempest-VolumesActionsTest-1879812582 None] Acquiring lock "cinder-15763aef-e495-466a-b919-a0bb6171f0cf-detach_volume" by "detach_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:01:54 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-f5b0b2d8-7d02-4937-8b44-6426da77d89d tempest-VolumesActionsTest-1879812582 None] Lock "cinder-15763aef-e495-466a-b919-a0bb6171f0cf-detach_volume" acquired by "detach_volume" :: waited 0.042s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:01:54 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-f5b0b2d8-7d02-4937-8b44-6426da77d89d tempest-VolumesActionsTest-1879812582 None] Detaching volume 15763aef-e495-466a-b919-a0bb6171f0cf from instance e27baa4f-8f97-4c09-8816-cf2916b40393.
Jun 15 16:01:54 devstack sudo[105344]: pam_unix(sudo:session): session closed for user root
Jun 15 16:01:54 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-390e1505-b229-41ce-80a3-a22cd9236d14 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-46cb7365-c079-4ee8-9dec-2a9563f44589" returned: 0 in 1.016s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:01:54 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-390e1505-b229-41ce-80a3-a22cd9236d14 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-46cb7365-c079-4ee8-9dec-2a9563f44589 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:01:54 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-f5b0b2d8-7d02-4937-8b44-6426da77d89d tempest-VolumesActionsTest-1879812582 None] Detach volume completed successfully.
Jun 15 16:01:54 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-f5b0b2d8-7d02-4937-8b44-6426da77d89d tempest-VolumesActionsTest-1879812582 None] Lock "cinder-15763aef-e495-466a-b919-a0bb6171f0cf-detach_volume" released by "detach_volume" :: held 0.162s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:01:54 devstack sudo[105354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-46cb7365-c079-4ee8-9dec-2a9563f44589
Jun 15 16:01:54 devstack sudo[105354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:01:54 devstack sudo[105349]: pam_unix(sudo:session): session closed for user root
Jun 15 16:01:54 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-470ca209-6915-4222-941b-af3827f4871f tempest-VolumesGetTest-1408686534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-51d196b8-a6c9-4d2d-af5a-def5370dd0d3" returned: 0 in 1.027s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:01:54 devstack cinder-volume[91863]: DEBUG cinder.utils [None req-470ca209-6915-4222-941b-af3827f4871f tempest-VolumesGetTest-1408686534 None] Path /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-7a3306ef-a859-4436-bb7b-446bcdddccdb not found in is_blk_device check {{(pid=91863) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 15 16:01:54 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-470ca209-6915-4222-941b-af3827f4871f tempest-VolumesGetTest-1408686534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-51d196b8-a6c9-4d2d-af5a-def5370dd0d3 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-7a3306ef-a859-4436-bb7b-446bcdddccdb {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:01:54 devstack sudo[105359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-51d196b8-a6c9-4d2d-af5a-def5370dd0d3 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-7a3306ef-a859-4436-bb7b-446bcdddccdb
Jun 15 16:01:54 devstack sudo[105359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:01:55 devstack sudo[105354]: pam_unix(sudo:session): session closed for user root
Jun 15 16:01:55 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-390e1505-b229-41ce-80a3-a22cd9236d14 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-46cb7365-c079-4ee8-9dec-2a9563f44589" returned: 0 in 0.907s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:01:55 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-390e1505-b229-41ce-80a3-a22cd9236d14 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Lock "cinder-quobyte-46cb7365-c079-4ee8-9dec-2a9563f44589" released by "delete_volume" :: held 2.035s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:01:55 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-390e1505-b229-41ce-80a3-a22cd9236d14 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Created reservations ['c9dbc9cf-048f-4cce-884f-88048a792fd3', '6a87e595-0134-4d90-b0fe-125e0f4f62fd', '6baab929-4a5a-46dc-8688-fa6c6b29bda9', '894b3537-ef9b-4396-abca-27ac8b69532e'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 16:01:55 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-390e1505-b229-41ce-80a3-a22cd9236d14 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:01:55 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-390e1505-b229-41ce-80a3-a22cd9236d14 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:01:55 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-390e1505-b229-41ce-80a3-a22cd9236d14 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:01:55 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-390e1505-b229-41ce-80a3-a22cd9236d14 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:01:55 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-390e1505-b229-41ce-80a3-a22cd9236d14 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:01:55 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-390e1505-b229-41ce-80a3-a22cd9236d14 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:01:55 devstack sudo[105366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 16:01:55 devstack sudo[105366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:01:55 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-52d5bf58-1256-45a3-9e34-69125bbd197b tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Acquiring lock "cinder-92da3b2a-4c57-4f07-8425-400adcbef4ce-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:01:55 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-52d5bf58-1256-45a3-9e34-69125bbd197b tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Lock "cinder-92da3b2a-4c57-4f07-8425-400adcbef4ce-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:01:55 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-52d5bf58-1256-45a3-9e34-69125bbd197b tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Acquiring lock "cinder-quobyte-92da3b2a-4c57-4f07-8425-400adcbef4ce" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:01:55 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-52d5bf58-1256-45a3-9e34-69125bbd197b tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Lock "cinder-quobyte-92da3b2a-4c57-4f07-8425-400adcbef4ce" acquired by "delete_volume" :: waited 0.017s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:01:55 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e9f0ae-1130-42a4-942b-9d9b5ab8b887]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:01:55 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-52d5bf58-1256-45a3-9e34-69125bbd197b tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-92da3b2a-4c57-4f07-8425-400adcbef4ce {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:01:55 devstack sudo[105371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-92da3b2a-4c57-4f07-8425-400adcbef4ce
Jun 15 16:01:55 devstack sudo[105371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:01:57 devstack sudo[105366]: pam_unix(sudo:session): session closed for user root
Jun 15 16:01:57 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-390e1505-b229-41ce-80a3-a22cd9236d14 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 2.184s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:01:57 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-390e1505-b229-41ce-80a3-a22cd9236d14 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 16:01:57 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-390e1505-b229-41ce-80a3-a22cd9236d14 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Deleted volume successfully.
Jun 15 16:01:57 devstack sudo[105371]: pam_unix(sudo:session): session closed for user root
Jun 15 16:01:57 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-52d5bf58-1256-45a3-9e34-69125bbd197b tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-92da3b2a-4c57-4f07-8425-400adcbef4ce" returned: 0 in 2.514s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:01:57 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-52d5bf58-1256-45a3-9e34-69125bbd197b tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-92da3b2a-4c57-4f07-8425-400adcbef4ce {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:01:58 devstack sudo[105420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-92da3b2a-4c57-4f07-8425-400adcbef4ce
Jun 15 16:01:58 devstack sudo[105420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:01:58 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-390e1505-b229-41ce-80a3-a22cd9236d14 tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Lock "cinder-46cb7365-c079-4ee8-9dec-2a9563f44589-delete_volume" released by "delete_volume" :: held 5.357s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:01:59 devstack sudo[105420]: pam_unix(sudo:session): session closed for user root
Jun 15 16:01:59 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-52d5bf58-1256-45a3-9e34-69125bbd197b tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-92da3b2a-4c57-4f07-8425-400adcbef4ce" returned: 0 in 1.657s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:01:59 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-52d5bf58-1256-45a3-9e34-69125bbd197b tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Lock "cinder-quobyte-92da3b2a-4c57-4f07-8425-400adcbef4ce" released by "delete_volume" :: held 4.234s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:02:00 devstack sudo[105359]: pam_unix(sudo:session): session closed for user root
Jun 15 16:02:00 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-470ca209-6915-4222-941b-af3827f4871f tempest-VolumesGetTest-1408686534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-51d196b8-a6c9-4d2d-af5a-def5370dd0d3 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-7a3306ef-a859-4436-bb7b-446bcdddccdb" returned: 0 in 6.418s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:02:00 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad7e98d-7d15-48d4-a2d7-2603898e299a]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:02:00 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-470ca209-6915-4222-941b-af3827f4871f tempest-VolumesGetTest-1408686534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-51d196b8-a6c9-4d2d-af5a-def5370dd0d3 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:02:00 devstack sudo[105423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-51d196b8-a6c9-4d2d-af5a-def5370dd0d3
Jun 15 16:02:00 devstack sudo[105423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:02:01 devstack sudo[105423]: pam_unix(sudo:session): session closed for user root
Jun 15 16:02:01 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-470ca209-6915-4222-941b-af3827f4871f tempest-VolumesGetTest-1408686534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-51d196b8-a6c9-4d2d-af5a-def5370dd0d3" returned: 0 in 0.856s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:02:01 devstack cinder-volume[91863]: DEBUG cinder.image.image_utils [None req-470ca209-6915-4222-941b-af3827f4871f tempest-VolumesGetTest-1408686534 None] Image conversion details: src /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-51d196b8-a6c9-4d2d-af5a-def5370dd0d3, size 1024.00 MB, duration 6.42 sec, destination /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-7a3306ef-a859-4436-bb7b-446bcdddccdb {{(pid=91863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 15 16:02:01 devstack cinder-volume[91863]: INFO cinder.image.image_utils [None req-470ca209-6915-4222-941b-af3827f4871f tempest-VolumesGetTest-1408686534 None] Converted 1024.00 MB image at 159.51 MB/s
Jun 15 16:02:01 devstack cinder-volume[91863]: WARNING cinder.volume.drivers.remotefs [None req-470ca209-6915-4222-941b-af3827f4871f tempest-VolumesGetTest-1408686534 None] /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-7a3306ef-a859-4436-bb7b-446bcdddccdb is being set with open permissions: ugo+rw
Jun 15 16:02:01 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-470ca209-6915-4222-941b-af3827f4871f tempest-VolumesGetTest-1408686534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-7a3306ef-a859-4436-bb7b-446bcdddccdb {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:02:01 devstack sudo[105429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-7a3306ef-a859-4436-bb7b-446bcdddccdb
Jun 15 16:02:01 devstack sudo[105429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:02:02 devstack sudo[105429]: pam_unix(sudo:session): session closed for user root
Jun 15 16:02:02 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-470ca209-6915-4222-941b-af3827f4871f tempest-VolumesGetTest-1408686534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-7a3306ef-a859-4436-bb7b-446bcdddccdb" returned: 0 in 0.657s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:02:02 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-470ca209-6915-4222-941b-af3827f4871f tempest-VolumesGetTest-1408686534 None] Lock "cinder-quobyte-7a3306ef-a859-4436-bb7b-446bcdddccdb" released by "_copy_volume_from_snapshot" :: held 10.352s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:02:02 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-52d5bf58-1256-45a3-9e34-69125bbd197b tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Created reservations ['e1f63085-5549-444b-adf3-008e03060391', '9977923e-3157-47a6-8b07-2d42c912f5e0', '185332e2-a559-4317-a309-3acd9a2c23b1', '0ffd3eae-370e-4f99-86ca-bb742a105f15'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 16:02:02 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-470ca209-6915-4222-941b-af3827f4871f tempest-VolumesGetTest-1408686534 None] Acquiring lock "cinder-quobyte-4ceb2b90-58a7-4cf3-96ea-62eff9d1b44b" by "_delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:02:02 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-470ca209-6915-4222-941b-af3827f4871f tempest-VolumesGetTest-1408686534 None] Lock "cinder-quobyte-4ceb2b90-58a7-4cf3-96ea-62eff9d1b44b" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:02:02 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-470ca209-6915-4222-941b-af3827f4871f tempest-VolumesGetTest-1408686534 None] Deleting offline snapshot 4ceb2b90-58a7-4cf3-96ea-62eff9d1b44b of volume 51d196b8-a6c9-4d2d-af5a-def5370dd0d3 {{(pid=91863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 15 16:02:02 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-470ca209-6915-4222-941b-af3827f4871f tempest-VolumesGetTest-1408686534 None] snapshot_file for this snap is: volume-51d196b8-a6c9-4d2d-af5a-def5370dd0d3.4ceb2b90-58a7-4cf3-96ea-62eff9d1b44b {{(pid=91863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 15 16:02:02 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae1c9f3-8edf-448a-95e8-39a3be7bc300]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:02:02 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-470ca209-6915-4222-941b-af3827f4871f tempest-VolumesGetTest-1408686534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-51d196b8-a6c9-4d2d-af5a-def5370dd0d3.4ceb2b90-58a7-4cf3-96ea-62eff9d1b44b {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:02:03 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-52d5bf58-1256-45a3-9e34-69125bbd197b tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:02:03 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-52d5bf58-1256-45a3-9e34-69125bbd197b tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:02:03 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-52d5bf58-1256-45a3-9e34-69125bbd197b tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:02:03 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-52d5bf58-1256-45a3-9e34-69125bbd197b tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:02:03 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-52d5bf58-1256-45a3-9e34-69125bbd197b tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:02:03 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-52d5bf58-1256-45a3-9e34-69125bbd197b tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:02:03 devstack sudo[105434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 16:02:03 devstack sudo[105434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:02:03 devstack sudo[105433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-51d196b8-a6c9-4d2d-af5a-def5370dd0d3.4ceb2b90-58a7-4cf3-96ea-62eff9d1b44b
Jun 15 16:02:03 devstack sudo[105433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:02:03 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-4cc6ee43-396b-446d-b01e-9eb536a63ade tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Acquiring lock "cinder-90d8e416-e33c-44f8-9c2d-1d92666af647-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:02:03 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-4cc6ee43-396b-446d-b01e-9eb536a63ade tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Lock "cinder-90d8e416-e33c-44f8-9c2d-1d92666af647-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:02:03 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-4cc6ee43-396b-446d-b01e-9eb536a63ade tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Acquiring lock "cinder-quobyte-90d8e416-e33c-44f8-9c2d-1d92666af647" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:02:03 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-4cc6ee43-396b-446d-b01e-9eb536a63ade tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Lock "cinder-quobyte-90d8e416-e33c-44f8-9c2d-1d92666af647" acquired by "delete_volume" :: waited 0.019s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:02:03 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d55ac5-8f60-4d7c-9f19-1f54b34e8cad]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:02:03 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-4cc6ee43-396b-446d-b01e-9eb536a63ade tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-90d8e416-e33c-44f8-9c2d-1d92666af647 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:02:03 devstack sudo[105437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-90d8e416-e33c-44f8-9c2d-1d92666af647
Jun 15 16:02:03 devstack sudo[105437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:02:03 devstack sudo[105433]: pam_unix(sudo:session): session closed for user root
Jun 15 16:02:03 devstack sudo[105434]: pam_unix(sudo:session): session closed for user root
Jun 15 16:02:03 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-470ca209-6915-4222-941b-af3827f4871f tempest-VolumesGetTest-1408686534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-51d196b8-a6c9-4d2d-af5a-def5370dd0d3.4ceb2b90-58a7-4cf3-96ea-62eff9d1b44b" returned: 0 in 0.780s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:02:03 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-470ca209-6915-4222-941b-af3827f4871f tempest-VolumesGetTest-1408686534 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51d196b8-a6c9-4d2d-af5a-def5370dd0d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 16:02:03 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-52d5bf58-1256-45a3-9e34-69125bbd197b tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.709s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:02:03 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-52d5bf58-1256-45a3-9e34-69125bbd197b tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 16:02:03 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-52d5bf58-1256-45a3-9e34-69125bbd197b tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Deleted volume successfully.
Jun 15 16:02:03 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7936ef16-f5eb-43cd-8d50-0f0b57dd2dea]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:02:03 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-470ca209-6915-4222-941b-af3827f4871f tempest-VolumesGetTest-1408686534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-51d196b8-a6c9-4d2d-af5a-def5370dd0d3 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:02:03 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-52d5bf58-1256-45a3-9e34-69125bbd197b tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Lock "cinder-92da3b2a-4c57-4f07-8425-400adcbef4ce-delete_volume" released by "delete_volume" :: held 8.480s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:02:03 devstack sudo[105443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-51d196b8-a6c9-4d2d-af5a-def5370dd0d3
Jun 15 16:02:03 devstack sudo[105443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:02:04 devstack sudo[105437]: pam_unix(sudo:session): session closed for user root
Jun 15 16:02:04 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-4cc6ee43-396b-446d-b01e-9eb536a63ade tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-90d8e416-e33c-44f8-9c2d-1d92666af647" returned: 0 in 0.799s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:02:04 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-4cc6ee43-396b-446d-b01e-9eb536a63ade tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-90d8e416-e33c-44f8-9c2d-1d92666af647 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:02:04 devstack sudo[105449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-90d8e416-e33c-44f8-9c2d-1d92666af647
Jun 15 16:02:04 devstack sudo[105449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:02:04 devstack sudo[105443]: pam_unix(sudo:session): session closed for user root
Jun 15 16:02:04 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-470ca209-6915-4222-941b-af3827f4871f tempest-VolumesGetTest-1408686534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-51d196b8-a6c9-4d2d-af5a-def5370dd0d3" returned: 0 in 0.809s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:02:04 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-470ca209-6915-4222-941b-af3827f4871f tempest-VolumesGetTest-1408686534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-51d196b8-a6c9-4d2d-af5a-def5370dd0d3.4ceb2b90-58a7-4cf3-96ea-62eff9d1b44b {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:02:04 devstack sudo[105455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-51d196b8-a6c9-4d2d-af5a-def5370dd0d3.4ceb2b90-58a7-4cf3-96ea-62eff9d1b44b
Jun 15 16:02:04 devstack sudo[105455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:02:05 devstack sudo[105449]: pam_unix(sudo:session): session closed for user root
Jun 15 16:02:05 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-4cc6ee43-396b-446d-b01e-9eb536a63ade tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-90d8e416-e33c-44f8-9c2d-1d92666af647" returned: 0 in 0.652s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:02:05 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-4cc6ee43-396b-446d-b01e-9eb536a63ade tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Lock "cinder-quobyte-90d8e416-e33c-44f8-9c2d-1d92666af647" released by "delete_volume" :: held 1.503s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:02:05 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-4cc6ee43-396b-446d-b01e-9eb536a63ade tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Created reservations ['a506ab6c-ae5c-4115-9e0d-6d26d2d1f7ce', '25de9c4a-96b1-4a44-8ed3-9ce41f6abbfe', 'fabbc1ca-218e-4cab-af4b-19f1ce512b07', 'aab5f11c-c289-44ff-a01c-7f1a9c8ab46c'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 16:02:05 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-4cc6ee43-396b-446d-b01e-9eb536a63ade tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:02:05 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-4cc6ee43-396b-446d-b01e-9eb536a63ade tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:02:05 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-4cc6ee43-396b-446d-b01e-9eb536a63ade tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:02:05 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-4cc6ee43-396b-446d-b01e-9eb536a63ade tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:02:05 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-4cc6ee43-396b-446d-b01e-9eb536a63ade tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:02:05 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-4cc6ee43-396b-446d-b01e-9eb536a63ade tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:02:05 devstack sudo[105465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 16:02:05 devstack sudo[105465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:02:05 devstack sudo[105455]: pam_unix(sudo:session): session closed for user root
Jun 15 16:02:05 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-470ca209-6915-4222-941b-af3827f4871f tempest-VolumesGetTest-1408686534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-51d196b8-a6c9-4d2d-af5a-def5370dd0d3.4ceb2b90-58a7-4cf3-96ea-62eff9d1b44b" returned: 0 in 0.745s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:02:05 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-470ca209-6915-4222-941b-af3827f4871f tempest-VolumesGetTest-1408686534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-51d196b8-a6c9-4d2d-af5a-def5370dd0d3.4ceb2b90-58a7-4cf3-96ea-62eff9d1b44b {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:02:05 devstack sudo[105467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-51d196b8-a6c9-4d2d-af5a-def5370dd0d3.4ceb2b90-58a7-4cf3-96ea-62eff9d1b44b
Jun 15 16:02:05 devstack sudo[105467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:02:05 devstack sudo[105465]: pam_unix(sudo:session): session closed for user root
Jun 15 16:02:05 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-4cc6ee43-396b-446d-b01e-9eb536a63ade tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.674s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:02:05 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-4cc6ee43-396b-446d-b01e-9eb536a63ade tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 16:02:05 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-4cc6ee43-396b-446d-b01e-9eb536a63ade tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Deleted volume successfully.
Jun 15 16:02:05 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-4cc6ee43-396b-446d-b01e-9eb536a63ade tempest-CreateVolumesFromSourceVolumeTest-1103175081 None] Lock "cinder-90d8e416-e33c-44f8-9c2d-1d92666af647-delete_volume" released by "delete_volume" :: held 2.433s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:02:05 devstack sudo[105467]: pam_unix(sudo:session): session closed for user root
Jun 15 16:02:05 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-470ca209-6915-4222-941b-af3827f4871f tempest-VolumesGetTest-1408686534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-51d196b8-a6c9-4d2d-af5a-def5370dd0d3.4ceb2b90-58a7-4cf3-96ea-62eff9d1b44b" returned: 0 in 0.619s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:02:06 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-470ca209-6915-4222-941b-af3827f4871f tempest-VolumesGetTest-1408686534 None] Lock "cinder-quobyte-4ceb2b90-58a7-4cf3-96ea-62eff9d1b44b" released by "_delete_snapshot" :: held 3.140s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:02:06 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-470ca209-6915-4222-941b-af3827f4871f tempest-VolumesGetTest-1408686534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 19.551s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:02:06 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-470ca209-6915-4222-941b-af3827f4871f tempest-VolumesGetTest-1408686534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7be2148e-4521-47a0-bcd3-07aef905132b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a3306ef-a859-4436-bb7b-446bcdddccdb', 'volume_size': 1, 'source_volid': '51d196b8-a6c9-4d2d-af5a-def5370dd0d3', 'source_volstatus': 'available'}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:02:06 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-470ca209-6915-4222-941b-af3827f4871f tempest-VolumesGetTest-1408686534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6c15c5f-0b7f-414f-b89a-2673b88d35be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:02:06 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-470ca209-6915-4222-941b-af3827f4871f tempest-VolumesGetTest-1408686534 None] Volume volume-7a3306ef-a859-4436-bb7b-446bcdddccdb (7a3306ef-a859-4436-bb7b-446bcdddccdb): created successfully
Jun 15 16:02:06 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-470ca209-6915-4222-941b-af3827f4871f tempest-VolumesGetTest-1408686534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6c15c5f-0b7f-414f-b89a-2673b88d35be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:02:06 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-470ca209-6915-4222-941b-af3827f4871f tempest-VolumesGetTest-1408686534 None] Flow 'volume_create_manager' (180a7096-896b-47b2-997b-a34f820464a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:02:06 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-470ca209-6915-4222-941b-af3827f4871f tempest-VolumesGetTest-1408686534 None] Created volume successfully.
Jun 15 16:02:07 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f40357b-dad7-4533-8a29-8c82c82fc74c tempest-VolumesGetTest-1408686534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 16:02:07 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-7f40357b-dad7-4533-8a29-8c82c82fc74c tempest-VolumesGetTest-1408686534 None] Flow 'volume_create_manager' (5af54fd6-bdf2-49b7-b4f8-a3812216f987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:02:07 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-7f40357b-dad7-4533-8a29-8c82c82fc74c tempest-VolumesGetTest-1408686534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e67ae488-8da8-4816-a0a1-b47b7f85c039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:02:07 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-7f40357b-dad7-4533-8a29-8c82c82fc74c tempest-VolumesGetTest-1408686534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e67ae488-8da8-4816-a0a1-b47b7f85c039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:02:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-114999157',display_name='tempest-VolumesGetTest-Volume-1605803268',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88bb877b-db88-4917-84de-71e9e5c46a06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b89be12fba7e480f872e67eec6dca5e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:02:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:02:07Z,use_quota=True,user_id='6fadaeabe0e54ddfaeda00f848c0c309',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:02:07 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-7f40357b-dad7-4533-8a29-8c82c82fc74c tempest-VolumesGetTest-1408686534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (515c9871-2d6b-4b19-a957-1f3db3358322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:02:07 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-7f40357b-dad7-4533-8a29-8c82c82fc74c tempest-VolumesGetTest-1408686534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (515c9871-2d6b-4b19-a957-1f3db3358322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:02:07 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-7f40357b-dad7-4533-8a29-8c82c82fc74c tempest-VolumesGetTest-1408686534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ba99a2d-9c7a-4e7d-8837-186baef2d93f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:02:07 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-7f40357b-dad7-4533-8a29-8c82c82fc74c tempest-VolumesGetTest-1408686534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ba99a2d-9c7a-4e7d-8837-186baef2d93f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88bb877b-db88-4917-84de-71e9e5c46a06', 'volume_name': 'volume-88bb877b-db88-4917-84de-71e9e5c46a06', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:02:07 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-7f40357b-dad7-4533-8a29-8c82c82fc74c tempest-VolumesGetTest-1408686534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (435c3f03-847e-4b25-ae2c-ee190eac2e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:02:07 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-7f40357b-dad7-4533-8a29-8c82c82fc74c tempest-VolumesGetTest-1408686534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (435c3f03-847e-4b25-ae2c-ee190eac2e6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:02:07 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-7f40357b-dad7-4533-8a29-8c82c82fc74c tempest-VolumesGetTest-1408686534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d77fd48-a71c-426d-9485-498fd204d2ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:02:07 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-7f40357b-dad7-4533-8a29-8c82c82fc74c tempest-VolumesGetTest-1408686534 None] Volume 88bb877b-db88-4917-84de-71e9e5c46a06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88bb877b-db88-4917-84de-71e9e5c46a06', 'volume_size': 1}
Jun 15 16:02:07 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-7f40357b-dad7-4533-8a29-8c82c82fc74c tempest-VolumesGetTest-1408686534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:02:07 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-7f40357b-dad7-4533-8a29-8c82c82fc74c tempest-VolumesGetTest-1408686534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:02:07 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-7f40357b-dad7-4533-8a29-8c82c82fc74c tempest-VolumesGetTest-1408686534 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:02:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-114999157',display_name='tempest-VolumesGetTest-Volume-1605803268',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88bb877b-db88-4917-84de-71e9e5c46a06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b89be12fba7e480f872e67eec6dca5e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:02:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:02:07Z,use_quota=True,user_id='6fadaeabe0e54ddfaeda00f848c0c309',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 16:02:07 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-7f40357b-dad7-4533-8a29-8c82c82fc74c tempest-VolumesGetTest-1408686534 None] Creating volume 88bb877b-db88-4917-84de-71e9e5c46a06 {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 16:02:07 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-7f40357b-dad7-4533-8a29-8c82c82fc74c tempest-VolumesGetTest-1408686534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:02:07 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-7f40357b-dad7-4533-8a29-8c82c82fc74c tempest-VolumesGetTest-1408686534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:02:07 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-7f40357b-dad7-4533-8a29-8c82c82fc74c tempest-VolumesGetTest-1408686534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:02:07 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-7f40357b-dad7-4533-8a29-8c82c82fc74c tempest-VolumesGetTest-1408686534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:02:07 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-7f40357b-dad7-4533-8a29-8c82c82fc74c tempest-VolumesGetTest-1408686534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:02:07 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-7f40357b-dad7-4533-8a29-8c82c82fc74c tempest-VolumesGetTest-1408686534 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 16:02:07 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-7f40357b-dad7-4533-8a29-8c82c82fc74c tempest-VolumesGetTest-1408686534 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 16:02:07 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-7f40357b-dad7-4533-8a29-8c82c82fc74c tempest-VolumesGetTest-1408686534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-88bb877b-db88-4917-84de-71e9e5c46a06 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:02:07 devstack sudo[105472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-88bb877b-db88-4917-84de-71e9e5c46a06 1073741824
Jun 15 16:02:07 devstack sudo[105472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:02:08 devstack sudo[105472]: pam_unix(sudo:session): session closed for user root
Jun 15 16:02:08 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-7f40357b-dad7-4533-8a29-8c82c82fc74c tempest-VolumesGetTest-1408686534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-88bb877b-db88-4917-84de-71e9e5c46a06 1073741824" returned: 0 in 0.974s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:02:08 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-7f40357b-dad7-4533-8a29-8c82c82fc74c tempest-VolumesGetTest-1408686534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-88bb877b-db88-4917-84de-71e9e5c46a06 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:02:08 devstack sudo[105478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-88bb877b-db88-4917-84de-71e9e5c46a06
Jun 15 16:02:08 devstack sudo[105478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:02:08 devstack sudo[105478]: pam_unix(sudo:session): session closed for user root
Jun 15 16:02:09 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-7f40357b-dad7-4533-8a29-8c82c82fc74c tempest-VolumesGetTest-1408686534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-88bb877b-db88-4917-84de-71e9e5c46a06" returned: 0 in 0.639s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:02:09 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-7f40357b-dad7-4533-8a29-8c82c82fc74c tempest-VolumesGetTest-1408686534 None] <== create_volume: return (1663ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 16:02:09 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-7f40357b-dad7-4533-8a29-8c82c82fc74c tempest-VolumesGetTest-1408686534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.665s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:02:09 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-7f40357b-dad7-4533-8a29-8c82c82fc74c tempest-VolumesGetTest-1408686534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d77fd48-a71c-426d-9485-498fd204d2ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88bb877b-db88-4917-84de-71e9e5c46a06', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:02:09 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-7f40357b-dad7-4533-8a29-8c82c82fc74c tempest-VolumesGetTest-1408686534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (566291a3-a83b-4f23-bf39-db39f5e095c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:02:09 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-7f40357b-dad7-4533-8a29-8c82c82fc74c tempest-VolumesGetTest-1408686534 None] Volume volume-88bb877b-db88-4917-84de-71e9e5c46a06 (88bb877b-db88-4917-84de-71e9e5c46a06): created successfully
Jun 15 16:02:09 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-7f40357b-dad7-4533-8a29-8c82c82fc74c tempest-VolumesGetTest-1408686534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (566291a3-a83b-4f23-bf39-db39f5e095c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:02:09 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-7f40357b-dad7-4533-8a29-8c82c82fc74c tempest-VolumesGetTest-1408686534 None] Flow 'volume_create_manager' (5af54fd6-bdf2-49b7-b4f8-a3812216f987) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:02:09 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-7f40357b-dad7-4533-8a29-8c82c82fc74c tempest-VolumesGetTest-1408686534 None] Created volume successfully.
Jun 15 16:02:09 devstack cinder-volume[91863]: DEBUG dbcounter [-] [91863] Writing DB stats cinder:DELETE=14,cinder:SELECT=113,cinder:UPDATE=142,cinder:INSERT=35 {{(pid=91863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 16:02:09 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6751f801-6521-4506-909c-c2b9036242a8 tempest-VolumesActionsTest-1879812582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:02:09 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6751f801-6521-4506-909c-c2b9036242a8 tempest-VolumesActionsTest-1879812582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:02:09 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f46b5d90-17b6-41ae-af1b-1afa9219a457]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:02:09 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6751f801-6521-4506-909c-c2b9036242a8 tempest-VolumesActionsTest-1879812582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-15763aef-e495-466a-b919-a0bb6171f0cf {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:02:09 devstack sudo[105481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-15763aef-e495-466a-b919-a0bb6171f0cf
Jun 15 16:02:09 devstack sudo[105481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:02:09 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-f245034e-0629-48af-8086-4535d1a43141 tempest-VolumesGetTest-1408686534 None] Acquiring lock "cinder-88bb877b-db88-4917-84de-71e9e5c46a06-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:02:09 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-f245034e-0629-48af-8086-4535d1a43141 tempest-VolumesGetTest-1408686534 None] Lock "cinder-88bb877b-db88-4917-84de-71e9e5c46a06-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:02:09 devstack cinder-volume[91863]: DEBUG dbcounter [-] [91863] Writing DB stats cinder:UPDATE=157,cinder:SELECT=109,cinder:INSERT=43,cinder:DELETE=13 {{(pid=91863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 16:02:09 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-f245034e-0629-48af-8086-4535d1a43141 tempest-VolumesGetTest-1408686534 None] Acquiring lock "cinder-quobyte-88bb877b-db88-4917-84de-71e9e5c46a06" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:02:09 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-f245034e-0629-48af-8086-4535d1a43141 tempest-VolumesGetTest-1408686534 None] Lock "cinder-quobyte-88bb877b-db88-4917-84de-71e9e5c46a06" acquired by "delete_volume" :: waited 0.023s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:02:09 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58e08de-ad89-491c-aa46-e6d385cd58de]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:02:09 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-f245034e-0629-48af-8086-4535d1a43141 tempest-VolumesGetTest-1408686534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-88bb877b-db88-4917-84de-71e9e5c46a06 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:02:09 devstack sudo[105483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-88bb877b-db88-4917-84de-71e9e5c46a06
Jun 15 16:02:09 devstack sudo[105483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:02:10 devstack sudo[105481]: pam_unix(sudo:session): session closed for user root
Jun 15 16:02:10 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6751f801-6521-4506-909c-c2b9036242a8 tempest-VolumesActionsTest-1879812582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-15763aef-e495-466a-b919-a0bb6171f0cf" returned: 0 in 0.793s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:02:10 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[00720e05-f305-4b25-aec4-f15c89791494]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:02:10 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6751f801-6521-4506-909c-c2b9036242a8 tempest-VolumesActionsTest-1879812582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-15763aef-e495-466a-b919-a0bb6171f0cf {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:02:10 devstack sudo[105488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-15763aef-e495-466a-b919-a0bb6171f0cf
Jun 15 16:02:10 devstack sudo[105488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:02:10 devstack sudo[105483]: pam_unix(sudo:session): session closed for user root
Jun 15 16:02:10 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-f245034e-0629-48af-8086-4535d1a43141 tempest-VolumesGetTest-1408686534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-88bb877b-db88-4917-84de-71e9e5c46a06" returned: 0 in 0.806s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:02:10 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-f245034e-0629-48af-8086-4535d1a43141 tempest-VolumesGetTest-1408686534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-88bb877b-db88-4917-84de-71e9e5c46a06 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:02:10 devstack sudo[105493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-88bb877b-db88-4917-84de-71e9e5c46a06
Jun 15 16:02:10 devstack sudo[105493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:02:11 devstack sudo[105488]: pam_unix(sudo:session): session closed for user root
Jun 15 16:02:11 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6751f801-6521-4506-909c-c2b9036242a8 tempest-VolumesActionsTest-1879812582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-15763aef-e495-466a-b919-a0bb6171f0cf" returned: 0 in 0.808s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:02:11 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6751f801-6521-4506-909c-c2b9036242a8 tempest-VolumesActionsTest-1879812582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-15763aef-e495-466a-b919-a0bb6171f0cf /opt/stack/data/cinder/conversion/15763aef-e495-466a-b919-a0bb6171f0cf.temp_image.5c178e8a-34f0-4bf3-bdec-c84773e47337_w8n_xiw.img {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:02:11 devstack sudo[105498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-15763aef-e495-466a-b919-a0bb6171f0cf /opt/stack/data/cinder/conversion/15763aef-e495-466a-b919-a0bb6171f0cf.temp_image.5c178e8a-34f0-4bf3-bdec-c84773e47337_w8n_xiw.img
Jun 15 16:02:11 devstack sudo[105498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:02:11 devstack sudo[105493]: pam_unix(sudo:session): session closed for user root
Jun 15 16:02:11 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-f245034e-0629-48af-8086-4535d1a43141 tempest-VolumesGetTest-1408686534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-88bb877b-db88-4917-84de-71e9e5c46a06" returned: 0 in 0.718s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:02:11 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-f245034e-0629-48af-8086-4535d1a43141 tempest-VolumesGetTest-1408686534 None] Lock "cinder-quobyte-88bb877b-db88-4917-84de-71e9e5c46a06" released by "delete_volume" :: held 1.590s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:02:11 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-f245034e-0629-48af-8086-4535d1a43141 tempest-VolumesGetTest-1408686534 None] Created reservations ['d46aef2a-8704-4d0b-8ad2-a567d3071bae', 'cb0ef1e5-250c-4ba4-9720-2046647878d7', '1cb62247-18ce-4ab3-bedc-c36a50d8d510', '396b686c-61e2-4cb6-93eb-a79cae81ed9e'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 16:02:11 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-f245034e-0629-48af-8086-4535d1a43141 tempest-VolumesGetTest-1408686534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:02:11 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-f245034e-0629-48af-8086-4535d1a43141 tempest-VolumesGetTest-1408686534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:02:11 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-f245034e-0629-48af-8086-4535d1a43141 tempest-VolumesGetTest-1408686534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:02:11 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-f245034e-0629-48af-8086-4535d1a43141 tempest-VolumesGetTest-1408686534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:02:11 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-f245034e-0629-48af-8086-4535d1a43141 tempest-VolumesGetTest-1408686534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:02:11 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-f245034e-0629-48af-8086-4535d1a43141 tempest-VolumesGetTest-1408686534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:02:11 devstack sudo[105501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 16:02:11 devstack sudo[105501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:02:11 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc4f0e14-87b7-4b37-a387-a8d48a8fa706 tempest-VolumeImageDependencyTests-407178336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 16:02:11 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-dc4f0e14-87b7-4b37-a387-a8d48a8fa706 tempest-VolumeImageDependencyTests-407178336 None] Flow 'volume_create_manager' (bb57c5b9-9f23-49b8-b6a4-adf02cb8f8ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:02:11 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-dc4f0e14-87b7-4b37-a387-a8d48a8fa706 tempest-VolumeImageDependencyTests-407178336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1e3ff01-396b-4aa5-abdc-83ba296af3ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:02:11 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-dc4f0e14-87b7-4b37-a387-a8d48a8fa706 tempest-VolumeImageDependencyTests-407178336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1e3ff01-396b-4aa5-abdc-83ba296af3ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:02:11Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01a59af1-ac60-436a-ba20-3de0dc1584a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74d360696c0d49bfa12f92777783b7c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:02:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:02:12Z,use_quota=True,user_id='14d9612c08db41ff9fefa034d2afd096',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:02:11 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-dc4f0e14-87b7-4b37-a387-a8d48a8fa706 tempest-VolumeImageDependencyTests-407178336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9448f5a6-004e-4043-94e2-b23a55a65a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:02:11 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-dc4f0e14-87b7-4b37-a387-a8d48a8fa706 tempest-VolumeImageDependencyTests-407178336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9448f5a6-004e-4043-94e2-b23a55a65a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:02:11 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-dc4f0e14-87b7-4b37-a387-a8d48a8fa706 tempest-VolumeImageDependencyTests-407178336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9a9fb47-925e-4964-a2a9-528ecbc1996a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:02:11 devstack cinder-volume[91863]: DEBUG cinder.image.glance [None req-dc4f0e14-87b7-4b37-a387-a8d48a8fa706 tempest-VolumeImageDependencyTests-407178336 None] Creating Keystone auth plugin from conf {{(pid=91863) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 15 16:02:12 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-dc4f0e14-87b7-4b37-a387-a8d48a8fa706 tempest-VolumeImageDependencyTests-407178336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9a9fb47-925e-4964-a2a9-528ecbc1996a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '01a59af1-ac60-436a-ba20-3de0dc1584a3', 'volume_name': 'volume-01a59af1-ac60-436a-ba20-3de0dc1584a3', 'volume_size': 1, 'image_id': 'fb3ca507-9420-4d4d-ab7b-85bc1a190c5a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fb3ca507-9420-4d4d-ab7b-85bc1a190c5a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c3005cefb023445a96e833d31fe1629e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '74d360696c0d49bfa12f92777783b7c3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'eaf33bf0ff662dc8a5043d188003edf1ff8dcda1206c4616a3bd9bfb33579b0494082a3f9024e6d472f4ea11397d5171ed3e066cf8c622c567c4be3a768eb2ad', 'id': 'fb3ca507-9420-4d4d-ab7b-85bc1a190c5a', 'created_at': datetime.datetime(2026, 6, 15, 14, 2, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 14, 2, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fb3ca507-9420-4d4d-ab7b-85bc1a190c5a/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7739545851c0>}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:02:12 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-dc4f0e14-87b7-4b37-a387-a8d48a8fa706 tempest-VolumeImageDependencyTests-407178336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (236aa34b-d8f7-488c-8742-9d8ea038c9fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:02:12 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-dc4f0e14-87b7-4b37-a387-a8d48a8fa706 tempest-VolumeImageDependencyTests-407178336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (236aa34b-d8f7-488c-8742-9d8ea038c9fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:02:12 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-dc4f0e14-87b7-4b37-a387-a8d48a8fa706 tempest-VolumeImageDependencyTests-407178336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (067e2ca4-697b-42f0-8d75-7e402634d0b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:02:12 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-dc4f0e14-87b7-4b37-a387-a8d48a8fa706 tempest-VolumeImageDependencyTests-407178336 None] Volume 01a59af1-ac60-436a-ba20-3de0dc1584a3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-01a59af1-ac60-436a-ba20-3de0dc1584a3', 'volume_size': 1, 'image_id': 'fb3ca507-9420-4d4d-ab7b-85bc1a190c5a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fb3ca507-9420-4d4d-ab7b-85bc1a190c5a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c3005cefb023445a96e833d31fe1629e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '74d360696c0d49bfa12f92777783b7c3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'eaf33bf0ff662dc8a5043d188003edf1ff8dcda1206c4616a3bd9bfb33579b0494082a3f9024e6d472f4ea11397d5171ed3e066cf8c622c567c4be3a768eb2ad', 'id': 'fb3ca507-9420-4d4d-ab7b-85bc1a190c5a', 'created_at': datetime.datetime(2026, 6, 15, 14, 2, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 14, 2, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fb3ca507-9420-4d4d-ab7b-85bc1a190c5a/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7739545851c0>}
Jun 15 16:02:12 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc4f0e14-87b7-4b37-a387-a8d48a8fa706 tempest-VolumeImageDependencyTests-407178336 None] Trying to clone 01a59af1-ac60-436a-ba20-3de0dc1584a3 from image fb3ca507-9420-4d4d-ab7b-85bc1a190c5a at location (None, [{'url': 'file:///opt/stack/data/glance/images/fb3ca507-9420-4d4d-ab7b-85bc1a190c5a', 'metadata': {}}]). {{(pid=91863) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jun 15 16:02:12 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-e9fa1142-1a55-4895-b319-eca11557219e tempest-VolumesGetTest-1408686534 None] Acquiring lock "cinder-7a3306ef-a859-4436-bb7b-446bcdddccdb-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:02:12 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-e9fa1142-1a55-4895-b319-eca11557219e tempest-VolumesGetTest-1408686534 None] Lock "cinder-7a3306ef-a859-4436-bb7b-446bcdddccdb-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:02:12 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-e9fa1142-1a55-4895-b319-eca11557219e tempest-VolumesGetTest-1408686534 None] Acquiring lock "cinder-quobyte-7a3306ef-a859-4436-bb7b-446bcdddccdb" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:02:12 devstack cinder-volume[91863]: DEBUG cinder.image.image_utils [None req-dc4f0e14-87b7-4b37-a387-a8d48a8fa706 tempest-VolumeImageDependencyTests-407178336 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fb3ca507-9420-4d4d-ab7b-85bc1a190c5a_hevtc2a7devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=91863) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 15 16:02:12 devstack cinder-volume[91863]: INFO cinder.image.image_utils [None req-dc4f0e14-87b7-4b37-a387-a8d48a8fa706 tempest-VolumeImageDependencyTests-407178336 None] Image download 0.00 MB at 0.00 MB/s
Jun 15 16:02:12 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-e9fa1142-1a55-4895-b319-eca11557219e tempest-VolumesGetTest-1408686534 None] Lock "cinder-quobyte-7a3306ef-a859-4436-bb7b-446bcdddccdb" acquired by "delete_volume" :: waited 0.077s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:02:12 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff3446f3-984c-413e-9c29-ce9fecea8f26]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:02:12 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-e9fa1142-1a55-4895-b319-eca11557219e tempest-VolumesGetTest-1408686534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-7a3306ef-a859-4436-bb7b-446bcdddccdb {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:02:12 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e449383-ef58-4e92-8122-4f7bd041a18b]: (4, 'raw') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:02:12 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-dc4f0e14-87b7-4b37-a387-a8d48a8fa706 tempest-VolumeImageDependencyTests-407178336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fb3ca507-9420-4d4d-ab7b-85bc1a190c5a_hevtc2a7devstack@QuobyteHD {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:02:12 devstack sudo[105501]: pam_unix(sudo:session): session closed for user root
Jun 15 16:02:12 devstack sudo[105514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-7a3306ef-a859-4436-bb7b-446bcdddccdb
Jun 15 16:02:12 devstack sudo[105514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:02:12 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-f245034e-0629-48af-8086-4535d1a43141 tempest-VolumesGetTest-1408686534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 1.476s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:02:12 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-f245034e-0629-48af-8086-4535d1a43141 tempest-VolumesGetTest-1408686534 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 16:02:12 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-f245034e-0629-48af-8086-4535d1a43141 tempest-VolumesGetTest-1408686534 None] Deleted volume successfully.
Jun 15 16:02:12 devstack sudo[105515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fb3ca507-9420-4d4d-ab7b-85bc1a190c5a_hevtc2a7devstack@QuobyteHD
Jun 15 16:02:12 devstack sudo[105515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:02:12 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-f245034e-0629-48af-8086-4535d1a43141 tempest-VolumesGetTest-1408686534 None] Lock "cinder-88bb877b-db88-4917-84de-71e9e5c46a06-delete_volume" released by "delete_volume" :: held 3.413s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:02:14 devstack sudo[105515]: pam_unix(sudo:session): session closed for user root
Jun 15 16:02:14 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-dc4f0e14-87b7-4b37-a387-a8d48a8fa706 tempest-VolumeImageDependencyTests-407178336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fb3ca507-9420-4d4d-ab7b-85bc1a190c5a_hevtc2a7devstack@QuobyteHD" returned: 0 in 1.478s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:02:14 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-dc4f0e14-87b7-4b37-a387-a8d48a8fa706 tempest-VolumeImageDependencyTests-407178336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fb3ca507-9420-4d4d-ab7b-85bc1a190c5a_hevtc2a7devstack@QuobyteHD {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:02:14 devstack sudo[105514]: pam_unix(sudo:session): session closed for user root
Jun 15 16:02:14 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-e9fa1142-1a55-4895-b319-eca11557219e tempest-VolumesGetTest-1408686534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-7a3306ef-a859-4436-bb7b-446bcdddccdb" returned: 0 in 1.638s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:02:14 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-e9fa1142-1a55-4895-b319-eca11557219e tempest-VolumesGetTest-1408686534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-7a3306ef-a859-4436-bb7b-446bcdddccdb {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:02:14 devstack sudo[105526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-7a3306ef-a859-4436-bb7b-446bcdddccdb
Jun 15 16:02:14 devstack sudo[105526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:02:14 devstack sudo[105525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fb3ca507-9420-4d4d-ab7b-85bc1a190c5a_hevtc2a7devstack@QuobyteHD
Jun 15 16:02:14 devstack sudo[105525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:02:15 devstack sudo[105525]: pam_unix(sudo:session): session closed for user root
Jun 15 16:02:15 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-dc4f0e14-87b7-4b37-a387-a8d48a8fa706 tempest-VolumeImageDependencyTests-407178336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fb3ca507-9420-4d4d-ab7b-85bc1a190c5a_hevtc2a7devstack@QuobyteHD" returned: 1 in 1.258s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:02:15 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-dc4f0e14-87b7-4b37-a387-a8d48a8fa706 tempest-VolumeImageDependencyTests-407178336 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fb3ca507-9420-4d4d-ab7b-85bc1a190c5a_hevtc2a7devstack@QuobyteHD' failed. Not Retrying. {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 15 16:02:15 devstack cinder-volume[91863]: DEBUG cinder.image.image_utils [None req-dc4f0e14-87b7-4b37-a387-a8d48a8fa706 tempest-VolumeImageDependencyTests-407178336 None] Temporary image fb3ca507-9420-4d4d-ab7b-85bc1a190c5a is fetched for user 14d9612c08db41ff9fefa034d2afd096. {{(pid=91863) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 15 16:02:15 devstack sudo[105526]: pam_unix(sudo:session): session closed for user root
Jun 15 16:02:15 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-e9fa1142-1a55-4895-b319-eca11557219e tempest-VolumesGetTest-1408686534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-7a3306ef-a859-4436-bb7b-446bcdddccdb" returned: 0 in 1.244s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:02:15 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-e9fa1142-1a55-4895-b319-eca11557219e tempest-VolumesGetTest-1408686534 None] Lock "cinder-quobyte-7a3306ef-a859-4436-bb7b-446bcdddccdb" released by "delete_volume" :: held 2.994s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:02:15 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2500246-3d67-4ccb-8c71-b238babc234a]: (4, 'raw') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:02:15 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-dc4f0e14-87b7-4b37-a387-a8d48a8fa706 tempest-VolumeImageDependencyTests-407178336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fb3ca507-9420-4d4d-ab7b-85bc1a190c5a_hevtc2a7devstack@QuobyteHD {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:02:15 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-e9fa1142-1a55-4895-b319-eca11557219e tempest-VolumesGetTest-1408686534 None] Created reservations ['df5e886b-6219-4246-ba0d-ae2dc1e6e965', 'e5b01a14-6128-4ba3-bbdf-2c54aa14e3a9', 'a55486ed-d975-4cbc-a938-540c4a510cef', '5ff7c737-fa26-4c40-87e6-4a47c8c1d9c7'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 16:02:15 devstack sudo[105535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fb3ca507-9420-4d4d-ab7b-85bc1a190c5a_hevtc2a7devstack@QuobyteHD
Jun 15 16:02:15 devstack sudo[105535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:02:15 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-e9fa1142-1a55-4895-b319-eca11557219e tempest-VolumesGetTest-1408686534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:02:15 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-e9fa1142-1a55-4895-b319-eca11557219e tempest-VolumesGetTest-1408686534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:02:15 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-e9fa1142-1a55-4895-b319-eca11557219e tempest-VolumesGetTest-1408686534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:02:15 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-e9fa1142-1a55-4895-b319-eca11557219e tempest-VolumesGetTest-1408686534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:02:15 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-e9fa1142-1a55-4895-b319-eca11557219e tempest-VolumesGetTest-1408686534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:02:15 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-e9fa1142-1a55-4895-b319-eca11557219e tempest-VolumesGetTest-1408686534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:02:16 devstack sudo[105537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 16:02:16 devstack sudo[105537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:02:16 devstack sudo[105498]: pam_unix(sudo:session): session closed for user root
Jun 15 16:02:16 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6751f801-6521-4506-909c-c2b9036242a8 tempest-VolumesActionsTest-1879812582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-15763aef-e495-466a-b919-a0bb6171f0cf /opt/stack/data/cinder/conversion/15763aef-e495-466a-b919-a0bb6171f0cf.temp_image.5c178e8a-34f0-4bf3-bdec-c84773e47337_w8n_xiw.img" returned: 0 in 5.422s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:02:16 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e90eae5a-9de4-44dc-98b2-6427cfb2f287]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:02:16 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6751f801-6521-4506-909c-c2b9036242a8 tempest-VolumesActionsTest-1879812582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-15763aef-e495-466a-b919-a0bb6171f0cf {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:02:16 devstack sudo[105539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-15763aef-e495-466a-b919-a0bb6171f0cf
Jun 15 16:02:16 devstack sudo[105539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:02:16 devstack sudo[105535]: pam_unix(sudo:session): session closed for user root
Jun 15 16:02:16 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-dc4f0e14-87b7-4b37-a387-a8d48a8fa706 tempest-VolumeImageDependencyTests-407178336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fb3ca507-9420-4d4d-ab7b-85bc1a190c5a_hevtc2a7devstack@QuobyteHD" returned: 0 in 1.153s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:02:16 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-dc4f0e14-87b7-4b37-a387-a8d48a8fa706 tempest-VolumeImageDependencyTests-407178336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fb3ca507-9420-4d4d-ab7b-85bc1a190c5a_hevtc2a7devstack@QuobyteHD {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:02:16 devstack sudo[105537]: pam_unix(sudo:session): session closed for user root
Jun 15 16:02:16 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-e9fa1142-1a55-4895-b319-eca11557219e tempest-VolumesGetTest-1408686534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.866s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:02:16 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-e9fa1142-1a55-4895-b319-eca11557219e tempest-VolumesGetTest-1408686534 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 16:02:16 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-e9fa1142-1a55-4895-b319-eca11557219e tempest-VolumesGetTest-1408686534 None] Deleted volume successfully.
Jun 15 16:02:16 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-e9fa1142-1a55-4895-b319-eca11557219e tempest-VolumesGetTest-1408686534 None] Lock "cinder-7a3306ef-a859-4436-bb7b-446bcdddccdb-delete_volume" released by "delete_volume" :: held 4.563s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:02:16 devstack sudo[105544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fb3ca507-9420-4d4d-ab7b-85bc1a190c5a_hevtc2a7devstack@QuobyteHD
Jun 15 16:02:16 devstack sudo[105544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:02:16 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-f41dce00-c3ff-40bf-9556-0d9dae05dcca tempest-VolumesGetTest-1408686534 None] Acquiring lock "cinder-51d196b8-a6c9-4d2d-af5a-def5370dd0d3-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:02:16 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-f41dce00-c3ff-40bf-9556-0d9dae05dcca tempest-VolumesGetTest-1408686534 None] Lock "cinder-51d196b8-a6c9-4d2d-af5a-def5370dd0d3-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:02:17 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-f41dce00-c3ff-40bf-9556-0d9dae05dcca tempest-VolumesGetTest-1408686534 None] Acquiring lock "cinder-quobyte-51d196b8-a6c9-4d2d-af5a-def5370dd0d3" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:02:17 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-f41dce00-c3ff-40bf-9556-0d9dae05dcca tempest-VolumesGetTest-1408686534 None] Lock "cinder-quobyte-51d196b8-a6c9-4d2d-af5a-def5370dd0d3" acquired by "delete_volume" :: waited 0.013s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:02:17 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b2f679e-06db-4204-b07d-1be110989437]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:02:17 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-f41dce00-c3ff-40bf-9556-0d9dae05dcca tempest-VolumesGetTest-1408686534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-51d196b8-a6c9-4d2d-af5a-def5370dd0d3 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:02:17 devstack sudo[105546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-51d196b8-a6c9-4d2d-af5a-def5370dd0d3
Jun 15 16:02:17 devstack sudo[105546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:02:17 devstack sudo[105539]: pam_unix(sudo:session): session closed for user root
Jun 15 16:02:17 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6751f801-6521-4506-909c-c2b9036242a8 tempest-VolumesActionsTest-1879812582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-15763aef-e495-466a-b919-a0bb6171f0cf" returned: 0 in 0.947s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:02:17 devstack cinder-volume[91863]: DEBUG cinder.image.image_utils [None req-6751f801-6521-4506-909c-c2b9036242a8 tempest-VolumesActionsTest-1879812582 None] Image conversion details: src /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-15763aef-e495-466a-b919-a0bb6171f0cf, size 1024.00 MB, duration 5.42 sec, destination /opt/stack/data/cinder/conversion/15763aef-e495-466a-b919-a0bb6171f0cf.temp_image.5c178e8a-34f0-4bf3-bdec-c84773e47337_w8n_xiw.img {{(pid=91863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 15 16:02:17 devstack cinder-volume[91863]: INFO cinder.image.image_utils [None req-6751f801-6521-4506-909c-c2b9036242a8 tempest-VolumesActionsTest-1879812582 None] Converted 1024.00 MB image at 188.80 MB/s
Jun 15 16:02:17 devstack cinder-volume[91863]: DEBUG cinder.image.image_utils [None req-6751f801-6521-4506-909c-c2b9036242a8 tempest-VolumesActionsTest-1879812582 None] 5c178e8a-34f0-4bf3-bdec-c84773e47337 was raw, no need to convert to raw {{(pid=91863) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}}
Jun 15 16:02:17 devstack sudo[105544]: pam_unix(sudo:session): session closed for user root
Jun 15 16:02:17 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-dc4f0e14-87b7-4b37-a387-a8d48a8fa706 tempest-VolumeImageDependencyTests-407178336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fb3ca507-9420-4d4d-ab7b-85bc1a190c5a_hevtc2a7devstack@QuobyteHD" returned: 1 in 0.751s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:02:17 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-dc4f0e14-87b7-4b37-a387-a8d48a8fa706 tempest-VolumeImageDependencyTests-407178336 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fb3ca507-9420-4d4d-ab7b-85bc1a190c5a_hevtc2a7devstack@QuobyteHD' failed. Not Retrying. {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 15 16:02:17 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-dc4f0e14-87b7-4b37-a387-a8d48a8fa706 tempest-VolumeImageDependencyTests-407178336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:02:17 devstack sudo[105546]: pam_unix(sudo:session): session closed for user root
Jun 15 16:02:17 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-f41dce00-c3ff-40bf-9556-0d9dae05dcca tempest-VolumesGetTest-1408686534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-51d196b8-a6c9-4d2d-af5a-def5370dd0d3" returned: 0 in 0.756s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:02:17 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-f41dce00-c3ff-40bf-9556-0d9dae05dcca tempest-VolumesGetTest-1408686534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-51d196b8-a6c9-4d2d-af5a-def5370dd0d3 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:02:17 devstack sudo[105557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-51d196b8-a6c9-4d2d-af5a-def5370dd0d3
Jun 15 16:02:17 devstack sudo[105557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:02:18 devstack sudo[105557]: pam_unix(sudo:session): session closed for user root
Jun 15 16:02:18 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-f41dce00-c3ff-40bf-9556-0d9dae05dcca tempest-VolumesGetTest-1408686534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-51d196b8-a6c9-4d2d-af5a-def5370dd0d3" returned: 0 in 0.585s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:02:18 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-f41dce00-c3ff-40bf-9556-0d9dae05dcca tempest-VolumesGetTest-1408686534 None] Lock "cinder-quobyte-51d196b8-a6c9-4d2d-af5a-def5370dd0d3" released by "delete_volume" :: held 1.400s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:02:18 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-f41dce00-c3ff-40bf-9556-0d9dae05dcca tempest-VolumesGetTest-1408686534 None] Created reservations ['0edb5a21-bf9a-4ca7-93e1-853adb03b589', '3d7af881-4402-4517-a02a-5cc8e9919d37', '7557c066-238e-4e7c-b02f-19f2546ef959', '2271fb69-7d61-4b81-8d6e-a7ef95801f67'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 16:02:18 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-f41dce00-c3ff-40bf-9556-0d9dae05dcca tempest-VolumesGetTest-1408686534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:02:18 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-f41dce00-c3ff-40bf-9556-0d9dae05dcca tempest-VolumesGetTest-1408686534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:02:18 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-f41dce00-c3ff-40bf-9556-0d9dae05dcca tempest-VolumesGetTest-1408686534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:02:18 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-f41dce00-c3ff-40bf-9556-0d9dae05dcca tempest-VolumesGetTest-1408686534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:02:18 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-f41dce00-c3ff-40bf-9556-0d9dae05dcca tempest-VolumesGetTest-1408686534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:02:18 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-f41dce00-c3ff-40bf-9556-0d9dae05dcca tempest-VolumesGetTest-1408686534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:02:18 devstack sudo[105560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 16:02:18 devstack sudo[105560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:02:19 devstack sudo[105560]: pam_unix(sudo:session): session closed for user root
Jun 15 16:02:19 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-f41dce00-c3ff-40bf-9556-0d9dae05dcca tempest-VolumesGetTest-1408686534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.629s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:02:19 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-f41dce00-c3ff-40bf-9556-0d9dae05dcca tempest-VolumesGetTest-1408686534 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 16:02:19 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-f41dce00-c3ff-40bf-9556-0d9dae05dcca tempest-VolumesGetTest-1408686534 None] Deleted volume successfully.
Jun 15 16:02:19 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-f41dce00-c3ff-40bf-9556-0d9dae05dcca tempest-VolumesGetTest-1408686534 None] Lock "cinder-51d196b8-a6c9-4d2d-af5a-def5370dd0d3-delete_volume" released by "delete_volume" :: held 2.268s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:02:20 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd831b22-124b-4ef8-abc1-e9a0f931d745 tempest-VolumesGetTest-1408686534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 16:02:20 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-fd831b22-124b-4ef8-abc1-e9a0f931d745 tempest-VolumesGetTest-1408686534 None] Flow 'volume_create_manager' (ade85a22-10eb-47fc-b36f-6b1d386cf356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:02:20 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-fd831b22-124b-4ef8-abc1-e9a0f931d745 tempest-VolumesGetTest-1408686534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f89a8abf-964c-4e97-8a5d-a21f11e09f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:02:20 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-fd831b22-124b-4ef8-abc1-e9a0f931d745 tempest-VolumesGetTest-1408686534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f89a8abf-964c-4e97-8a5d-a21f11e09f77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:02:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1556053803',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b6792ae-7ea5-47b1-bddb-0b0b89ff3d40,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b89be12fba7e480f872e67eec6dca5e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:02:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:02:20Z,use_quota=True,user_id='6fadaeabe0e54ddfaeda00f848c0c309',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:02:20 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-fd831b22-124b-4ef8-abc1-e9a0f931d745 tempest-VolumesGetTest-1408686534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8238f8bf-db43-4b56-88bb-3f919b50a906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:02:20 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-fd831b22-124b-4ef8-abc1-e9a0f931d745 tempest-VolumesGetTest-1408686534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8238f8bf-db43-4b56-88bb-3f919b50a906) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:02:20 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-fd831b22-124b-4ef8-abc1-e9a0f931d745 tempest-VolumesGetTest-1408686534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc6722b9-59c0-4011-9c4d-eabeb5b6d3e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:02:20 devstack cinder-volume[91863]: DEBUG cinder.image.glance [None req-fd831b22-124b-4ef8-abc1-e9a0f931d745 tempest-VolumesGetTest-1408686534 None] Creating Keystone auth plugin from conf {{(pid=91863) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 15 16:02:20 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-fd831b22-124b-4ef8-abc1-e9a0f931d745 tempest-VolumesGetTest-1408686534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc6722b9-59c0-4011-9c4d-eabeb5b6d3e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5b6792ae-7ea5-47b1-bddb-0b0b89ff3d40', 'volume_name': 'volume-5b6792ae-7ea5-47b1-bddb-0b0b89ff3d40', 'volume_size': 1, 'image_id': '43adaed4-5eec-483a-aa2b-0818266a94f1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/43adaed4-5eec-483a-aa2b-0818266a94f1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '601536f092c54cdc9ee754c7b1abc241', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '43adaed4-5eec-483a-aa2b-0818266a94f1', 'created_at': datetime.datetime(2026, 6, 15, 13, 42, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 13, 42, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/43adaed4-5eec-483a-aa2b-0818266a94f1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x77395471b290>}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:02:20 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-fd831b22-124b-4ef8-abc1-e9a0f931d745 tempest-VolumesGetTest-1408686534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (413bc6ad-337b-49e4-9eeb-1c65206f722d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:02:20 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-fd831b22-124b-4ef8-abc1-e9a0f931d745 tempest-VolumesGetTest-1408686534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (413bc6ad-337b-49e4-9eeb-1c65206f722d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:02:20 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-fd831b22-124b-4ef8-abc1-e9a0f931d745 tempest-VolumesGetTest-1408686534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9176c6ad-725e-4f8b-ab4f-f7843aeb3e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:02:20 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-fd831b22-124b-4ef8-abc1-e9a0f931d745 tempest-VolumesGetTest-1408686534 None] Volume 5b6792ae-7ea5-47b1-bddb-0b0b89ff3d40: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5b6792ae-7ea5-47b1-bddb-0b0b89ff3d40', 'volume_size': 1, 'image_id': '43adaed4-5eec-483a-aa2b-0818266a94f1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/43adaed4-5eec-483a-aa2b-0818266a94f1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '601536f092c54cdc9ee754c7b1abc241', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '43adaed4-5eec-483a-aa2b-0818266a94f1', 'created_at': datetime.datetime(2026, 6, 15, 13, 42, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 13, 42, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/43adaed4-5eec-483a-aa2b-0818266a94f1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x77395471b290>}
Jun 15 16:02:20 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd831b22-124b-4ef8-abc1-e9a0f931d745 tempest-VolumesGetTest-1408686534 None] Trying to clone 5b6792ae-7ea5-47b1-bddb-0b0b89ff3d40 from image 43adaed4-5eec-483a-aa2b-0818266a94f1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/43adaed4-5eec-483a-aa2b-0818266a94f1', 'metadata': {}}]). {{(pid=91863) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jun 15 16:02:20 devstack cinder-volume[91863]: DEBUG cinder.image.image_utils [None req-fd831b22-124b-4ef8-abc1-e9a0f931d745 tempest-VolumesGetTest-1408686534 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_43adaed4-5eec-483a-aa2b-0818266a94f1_oabono_6devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=91863) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 15 16:02:20 devstack cinder-volume[91863]: INFO cinder.image.image_utils [None req-fd831b22-124b-4ef8-abc1-e9a0f931d745 tempest-VolumesGetTest-1408686534 None] Image download 20.69 MB at 20.69 MB/s
Jun 15 16:02:20 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[6759ce0d-a715-4e40-92a8-39aadefa43cb]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:02:20 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-fd831b22-124b-4ef8-abc1-e9a0f931d745 tempest-VolumesGetTest-1408686534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_43adaed4-5eec-483a-aa2b-0818266a94f1_oabono_6devstack@QuobyteHD {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:02:20 devstack sudo[105565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_43adaed4-5eec-483a-aa2b-0818266a94f1_oabono_6devstack@QuobyteHD
Jun 15 16:02:20 devstack sudo[105565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:02:21 devstack sudo[105565]: pam_unix(sudo:session): session closed for user root
Jun 15 16:02:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-fd831b22-124b-4ef8-abc1-e9a0f931d745 tempest-VolumesGetTest-1408686534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_43adaed4-5eec-483a-aa2b-0818266a94f1_oabono_6devstack@QuobyteHD" returned: 0 in 0.687s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:02:21 devstack cinder-volume[91863]: DEBUG cinder.image.image_utils [None req-fd831b22-124b-4ef8-abc1-e9a0f931d745 tempest-VolumesGetTest-1408686534 None] Temporary image 43adaed4-5eec-483a-aa2b-0818266a94f1 is fetched for user 6fadaeabe0e54ddfaeda00f848c0c309. {{(pid=91863) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 15 16:02:21 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9348a20-1f0a-4c4c-b721-9f34e303121f]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:02:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-fd831b22-124b-4ef8-abc1-e9a0f931d745 tempest-VolumesGetTest-1408686534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_43adaed4-5eec-483a-aa2b-0818266a94f1_oabono_6devstack@QuobyteHD {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:02:21 devstack sudo[105570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_43adaed4-5eec-483a-aa2b-0818266a94f1_oabono_6devstack@QuobyteHD
Jun 15 16:02:21 devstack sudo[105570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:02:22 devstack sudo[105570]: pam_unix(sudo:session): session closed for user root
Jun 15 16:02:22 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-fd831b22-124b-4ef8-abc1-e9a0f931d745 tempest-VolumesGetTest-1408686534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_43adaed4-5eec-483a-aa2b-0818266a94f1_oabono_6devstack@QuobyteHD" returned: 0 in 0.680s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:02:22 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-fd831b22-124b-4ef8-abc1-e9a0f931d745 tempest-VolumesGetTest-1408686534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:02:31 devstack sudo[105582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 16:02:31 devstack cinder-volume[91863]: DEBUG oslo_service.periodic_task [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 16:02:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:02:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:02:31 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:02:31 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:02:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:02:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:02:31 devstack sudo[105582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:02:31 devstack cinder-volume[91863]: DEBUG dbcounter [-] [91863] Writing DB stats cinder:SELECT=18,cinder:INSERT=8,cinder:UPDATE=27,cinder:DELETE=2 {{(pid=91863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 16:02:31 devstack cinder-volume[91863]: DEBUG dbcounter [-] [91863] Writing DB stats cinder:UPDATE=23,cinder:SELECT=21,cinder:INSERT=6,cinder:DELETE=1 {{(pid=91863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 16:02:31 devstack sudo[105582]: pam_unix(sudo:session): session closed for user root
Jun 15 16:02:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.727s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:02:31 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 16:02:31 devstack cinder-volume[91863]: DEBUG oslo_service.periodic_task [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Running periodic task VolumeManager._thread_info {{(pid=91863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 16:02:31 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] thread count: 28 {{(pid=91863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 15 16:02:31 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] thread info: [<_MainThread(MainThread, started 131088232640640)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131088122704576)>, <Thread(Thread-3 (stat_writer), started daemon 131088123058112)>, <Thread(Rabbit-heartbeat, started daemon 131088121268864)>, <Thread(Thread-5 (_runner), started daemon 131088121904192)>, <Thread(Thread-7 (_runner), started daemon 131088122037248)>, <Thread(fd_logger, started daemon 131088119630784)>, <Thread(privsep_reader, started daemon 131088119781440)>, <Thread(tpool_thread_0, started daemon 131088111617728)>, <Thread(tpool_thread_1, started daemon 131088103225024)>, <Thread(tpool_thread_2, started daemon 131088094832320)>, <Thread(tpool_thread_3, started daemon 131088086439616)>, <Thread(tpool_thread_4, started daemon 131088078046912)>, <Thread(tpool_thread_5, started daemon 131088069654208)>, <Thread(tpool_thread_6, started daemon 131088061261504)>, <Thread(tpool_thread_7, started daemon 131088052868800)>, <Thread(tpool_thread_8, started daemon 131088044476096)>, <Thread(tpool_thread_9, started daemon 131088036083392)>, <Thread(tpool_thread_10, started daemon 131088027690688)>, <Thread(tpool_thread_11, started daemon 131088019297984)>, <Thread(tpool_thread_12, started daemon 131088010905280)>, <Thread(tpool_thread_13, started daemon 131088002512576)>, <Thread(tpool_thread_14, started daemon 131087994119872)>, <Thread(tpool_thread_15, started daemon 131087985727168)>, <Thread(tpool_thread_16, started daemon 131087977334464)>, <Thread(tpool_thread_17, started daemon 131087968941760)>, <Thread(tpool_thread_18, started daemon 131087960549056)>, <Thread(tpool_thread_19, started daemon 131087952156352)>] {{(pid=91863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 15 16:02:37 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6751f801-6521-4506-909c-c2b9036242a8 tempest-VolumesActionsTest-1879812582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 27.830s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:02:37 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6751f801-6521-4506-909c-c2b9036242a8 tempest-VolumesActionsTest-1879812582 None] Uploaded volume to glance image-id: 5c178e8a-34f0-4bf3-bdec-c84773e47337. {{(pid=91863) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Jun 15 16:02:37 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-dc4f0e14-87b7-4b37-a387-a8d48a8fa706 tempest-VolumeImageDependencyTests-407178336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.697s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:02:37 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-dc4f0e14-87b7-4b37-a387-a8d48a8fa706 tempest-VolumeImageDependencyTests-407178336 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:02:11Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01a59af1-ac60-436a-ba20-3de0dc1584a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74d360696c0d49bfa12f92777783b7c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:02:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:02:12Z,use_quota=True,user_id='14d9612c08db41ff9fefa034d2afd096',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 16:02:37 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-dc4f0e14-87b7-4b37-a387-a8d48a8fa706 tempest-VolumeImageDependencyTests-407178336 None] Creating volume 01a59af1-ac60-436a-ba20-3de0dc1584a3 {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 16:02:37 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-dc4f0e14-87b7-4b37-a387-a8d48a8fa706 tempest-VolumeImageDependencyTests-407178336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:02:37 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-dc4f0e14-87b7-4b37-a387-a8d48a8fa706 tempest-VolumeImageDependencyTests-407178336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:02:37 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-dc4f0e14-87b7-4b37-a387-a8d48a8fa706 tempest-VolumeImageDependencyTests-407178336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:02:37 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-dc4f0e14-87b7-4b37-a387-a8d48a8fa706 tempest-VolumeImageDependencyTests-407178336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:02:37 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-dc4f0e14-87b7-4b37-a387-a8d48a8fa706 tempest-VolumeImageDependencyTests-407178336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:02:37 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-dc4f0e14-87b7-4b37-a387-a8d48a8fa706 tempest-VolumeImageDependencyTests-407178336 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 16:02:37 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-dc4f0e14-87b7-4b37-a387-a8d48a8fa706 tempest-VolumeImageDependencyTests-407178336 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 16:02:37 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-dc4f0e14-87b7-4b37-a387-a8d48a8fa706 tempest-VolumeImageDependencyTests-407178336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-01a59af1-ac60-436a-ba20-3de0dc1584a3 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:02:37 devstack sudo[105622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-01a59af1-ac60-436a-ba20-3de0dc1584a3 1073741824
Jun 15 16:02:37 devstack sudo[105622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:02:37 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-6751f801-6521-4506-909c-c2b9036242a8 tempest-VolumesActionsTest-1879812582 None] Copy volume to image completed successfully.
Jun 15 16:02:38 devstack sudo[105622]: pam_unix(sudo:session): session closed for user root
Jun 15 16:02:38 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-dc4f0e14-87b7-4b37-a387-a8d48a8fa706 tempest-VolumeImageDependencyTests-407178336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-01a59af1-ac60-436a-ba20-3de0dc1584a3 1073741824" returned: 0 in 0.971s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:02:38 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-dc4f0e14-87b7-4b37-a387-a8d48a8fa706 tempest-VolumeImageDependencyTests-407178336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-01a59af1-ac60-436a-ba20-3de0dc1584a3 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:02:38 devstack sudo[105628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-01a59af1-ac60-436a-ba20-3de0dc1584a3
Jun 15 16:02:38 devstack sudo[105628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:02:38 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-82a81654-d0c1-4d3a-a8fe-06131894c8c8 tempest-VolumesActionsTest-1879812582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:02:38 devstack sudo[105628]: pam_unix(sudo:session): session closed for user root
Jun 15 16:02:38 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-dc4f0e14-87b7-4b37-a387-a8d48a8fa706 tempest-VolumeImageDependencyTests-407178336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-01a59af1-ac60-436a-ba20-3de0dc1584a3" returned: 0 in 0.643s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:02:38 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-dc4f0e14-87b7-4b37-a387-a8d48a8fa706 tempest-VolumeImageDependencyTests-407178336 None] <== create_volume: return (1657ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 16:02:38 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-dc4f0e14-87b7-4b37-a387-a8d48a8fa706 tempest-VolumeImageDependencyTests-407178336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.660s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:02:38 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-fd831b22-124b-4ef8-abc1-e9a0f931d745 tempest-VolumesGetTest-1408686534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.606s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:02:38 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-fd831b22-124b-4ef8-abc1-e9a0f931d745 tempest-VolumesGetTest-1408686534 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:02:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1556053803',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b6792ae-7ea5-47b1-bddb-0b0b89ff3d40,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b89be12fba7e480f872e67eec6dca5e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:02:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:02:20Z,use_quota=True,user_id='6fadaeabe0e54ddfaeda00f848c0c309',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 16:02:38 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-fd831b22-124b-4ef8-abc1-e9a0f931d745 tempest-VolumesGetTest-1408686534 None] Creating volume 5b6792ae-7ea5-47b1-bddb-0b0b89ff3d40 {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 16:02:38 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-fd831b22-124b-4ef8-abc1-e9a0f931d745 tempest-VolumesGetTest-1408686534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:02:38 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-fd831b22-124b-4ef8-abc1-e9a0f931d745 tempest-VolumesGetTest-1408686534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:02:38 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-fd831b22-124b-4ef8-abc1-e9a0f931d745 tempest-VolumesGetTest-1408686534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:02:38 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-fd831b22-124b-4ef8-abc1-e9a0f931d745 tempest-VolumesGetTest-1408686534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:02:38 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-fd831b22-124b-4ef8-abc1-e9a0f931d745 tempest-VolumesGetTest-1408686534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:02:38 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-fd831b22-124b-4ef8-abc1-e9a0f931d745 tempest-VolumesGetTest-1408686534 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 16:02:38 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-fd831b22-124b-4ef8-abc1-e9a0f931d745 tempest-VolumesGetTest-1408686534 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 16:02:38 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-fd831b22-124b-4ef8-abc1-e9a0f931d745 tempest-VolumesGetTest-1408686534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5b6792ae-7ea5-47b1-bddb-0b0b89ff3d40 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:02:38 devstack sudo[105631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5b6792ae-7ea5-47b1-bddb-0b0b89ff3d40 1073741824
Jun 15 16:02:38 devstack sudo[105631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:02:38 devstack cinder-volume[91863]: DEBUG cinder.volume.volume_utils [None req-dc4f0e14-87b7-4b37-a387-a8d48a8fa706 tempest-VolumeImageDependencyTests-407178336 None] Attempting download of fb3ca507-9420-4d4d-ab7b-85bc1a190c5a ((None, [{'url': 'file:///opt/stack/data/glance/images/fb3ca507-9420-4d4d-ab7b-85bc1a190c5a', 'metadata': {}}])) to volume 01a59af1-ac60-436a-ba20-3de0dc1584a3. {{(pid=91863) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 15 16:02:38 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c8c061e-f98b-44db-975f-da0cafccf129]: (4, 'raw') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:02:38 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-dc4f0e14-87b7-4b37-a387-a8d48a8fa706 tempest-VolumeImageDependencyTests-407178336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fb3ca507-9420-4d4d-ab7b-85bc1a190c5a_l4po2u3x {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:02:39 devstack sudo[105633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fb3ca507-9420-4d4d-ab7b-85bc1a190c5a_l4po2u3x
Jun 15 16:02:39 devstack sudo[105633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:02:39 devstack sudo[105633]: pam_unix(sudo:session): session closed for user root
Jun 15 16:02:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-dc4f0e14-87b7-4b37-a387-a8d48a8fa706 tempest-VolumeImageDependencyTests-407178336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fb3ca507-9420-4d4d-ab7b-85bc1a190c5a_l4po2u3x" returned: 0 in 0.704s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:02:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-dc4f0e14-87b7-4b37-a387-a8d48a8fa706 tempest-VolumeImageDependencyTests-407178336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fb3ca507-9420-4d4d-ab7b-85bc1a190c5a_l4po2u3x {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:02:39 devstack sudo[105631]: pam_unix(sudo:session): session closed for user root
Jun 15 16:02:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-fd831b22-124b-4ef8-abc1-e9a0f931d745 tempest-VolumesGetTest-1408686534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5b6792ae-7ea5-47b1-bddb-0b0b89ff3d40 1073741824" returned: 0 in 0.904s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:02:39 devstack sudo[105640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fb3ca507-9420-4d4d-ab7b-85bc1a190c5a_l4po2u3x
Jun 15 16:02:39 devstack sudo[105640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:02:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-fd831b22-124b-4ef8-abc1-e9a0f931d745 tempest-VolumesGetTest-1408686534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5b6792ae-7ea5-47b1-bddb-0b0b89ff3d40 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:02:39 devstack sudo[105642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5b6792ae-7ea5-47b1-bddb-0b0b89ff3d40
Jun 15 16:02:39 devstack sudo[105642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:02:40 devstack sudo[105642]: pam_unix(sudo:session): session closed for user root
Jun 15 16:02:40 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-fd831b22-124b-4ef8-abc1-e9a0f931d745 tempest-VolumesGetTest-1408686534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5b6792ae-7ea5-47b1-bddb-0b0b89ff3d40" returned: 0 in 0.585s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:02:40 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-fd831b22-124b-4ef8-abc1-e9a0f931d745 tempest-VolumesGetTest-1408686534 None] <== create_volume: return (1543ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 16:02:40 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-fd831b22-124b-4ef8-abc1-e9a0f931d745 tempest-VolumesGetTest-1408686534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.547s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:02:40 devstack sudo[105640]: pam_unix(sudo:session): session closed for user root
Jun 15 16:02:40 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-82a81654-d0c1-4d3a-a8fe-06131894c8c8 tempest-VolumesActionsTest-1879812582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 2.026s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:02:40 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-dc4f0e14-87b7-4b37-a387-a8d48a8fa706 tempest-VolumeImageDependencyTests-407178336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fb3ca507-9420-4d4d-ab7b-85bc1a190c5a_l4po2u3x" returned: 1 in 0.750s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:02:40 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-dc4f0e14-87b7-4b37-a387-a8d48a8fa706 tempest-VolumeImageDependencyTests-407178336 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fb3ca507-9420-4d4d-ab7b-85bc1a190c5a_l4po2u3x' failed. Not Retrying. {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 15 16:02:40 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0150f4d-49ac-4cc6-94a7-507adf490611]: (4, 'raw') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:02:40 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-dc4f0e14-87b7-4b37-a387-a8d48a8fa706 tempest-VolumeImageDependencyTests-407178336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fb3ca507-9420-4d4d-ab7b-85bc1a190c5a_hevtc2a7devstack@QuobyteHD {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:02:40 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[97a8f8ec-c7a2-4ddf-8794-5e7a8956ed3f]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:02:40 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-82a81654-d0c1-4d3a-a8fe-06131894c8c8 tempest-VolumesActionsTest-1879812582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-15763aef-e495-466a-b919-a0bb6171f0cf {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:02:40 devstack cinder-volume[91863]: DEBUG cinder.volume.volume_utils [None req-fd831b22-124b-4ef8-abc1-e9a0f931d745 tempest-VolumesGetTest-1408686534 None] Attempting download of 43adaed4-5eec-483a-aa2b-0818266a94f1 ((None, [{'url': 'file:///opt/stack/data/glance/images/43adaed4-5eec-483a-aa2b-0818266a94f1', 'metadata': {}}])) to volume 5b6792ae-7ea5-47b1-bddb-0b0b89ff3d40. {{(pid=91863) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 15 16:02:40 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d66af8f-8278-4ebf-9d06-22587cf23386]: (4, 'raw') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:02:40 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-fd831b22-124b-4ef8-abc1-e9a0f931d745 tempest-VolumesGetTest-1408686534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_43adaed4-5eec-483a-aa2b-0818266a94f1_0wz2d1fx {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:02:40 devstack sudo[105647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fb3ca507-9420-4d4d-ab7b-85bc1a190c5a_hevtc2a7devstack@QuobyteHD
Jun 15 16:02:40 devstack sudo[105647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:02:40 devstack sudo[105648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-15763aef-e495-466a-b919-a0bb6171f0cf
Jun 15 16:02:40 devstack sudo[105648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:02:40 devstack sudo[105649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_43adaed4-5eec-483a-aa2b-0818266a94f1_0wz2d1fx
Jun 15 16:02:40 devstack sudo[105649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:02:41 devstack sudo[105648]: pam_unix(sudo:session): session closed for user root
Jun 15 16:02:41 devstack sudo[105649]: pam_unix(sudo:session): session closed for user root
Jun 15 16:02:41 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-82a81654-d0c1-4d3a-a8fe-06131894c8c8 tempest-VolumesActionsTest-1879812582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-15763aef-e495-466a-b919-a0bb6171f0cf" returned: 0 in 0.803s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:02:41 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-fd831b22-124b-4ef8-abc1-e9a0f931d745 tempest-VolumesGetTest-1408686534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_43adaed4-5eec-483a-aa2b-0818266a94f1_0wz2d1fx" returned: 0 in 0.719s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:02:41 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-fd831b22-124b-4ef8-abc1-e9a0f931d745 tempest-VolumesGetTest-1408686534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_43adaed4-5eec-483a-aa2b-0818266a94f1_0wz2d1fx {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:02:41 devstack sudo[105647]: pam_unix(sudo:session): session closed for user root
Jun 15 16:02:41 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-dc4f0e14-87b7-4b37-a387-a8d48a8fa706 tempest-VolumeImageDependencyTests-407178336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fb3ca507-9420-4d4d-ab7b-85bc1a190c5a_hevtc2a7devstack@QuobyteHD" returned: 0 in 0.834s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:02:41 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-dc4f0e14-87b7-4b37-a387-a8d48a8fa706 tempest-VolumeImageDependencyTests-407178336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fb3ca507-9420-4d4d-ab7b-85bc1a190c5a_hevtc2a7devstack@QuobyteHD {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:02:41 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff8fca0-7e56-45c3-902d-68c7c0680c92]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:02:41 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-82a81654-d0c1-4d3a-a8fe-06131894c8c8 tempest-VolumesActionsTest-1879812582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-15763aef-e495-466a-b919-a0bb6171f0cf {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:02:41 devstack sudo[105660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_43adaed4-5eec-483a-aa2b-0818266a94f1_0wz2d1fx
Jun 15 16:02:41 devstack sudo[105660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:02:41 devstack sudo[105661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fb3ca507-9420-4d4d-ab7b-85bc1a190c5a_hevtc2a7devstack@QuobyteHD
Jun 15 16:02:41 devstack sudo[105661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:02:41 devstack sudo[105662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-15763aef-e495-466a-b919-a0bb6171f0cf
Jun 15 16:02:41 devstack sudo[105662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:02:42 devstack sudo[105661]: pam_unix(sudo:session): session closed for user root
Jun 15 16:02:42 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-dc4f0e14-87b7-4b37-a387-a8d48a8fa706 tempest-VolumeImageDependencyTests-407178336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fb3ca507-9420-4d4d-ab7b-85bc1a190c5a_hevtc2a7devstack@QuobyteHD" returned: 1 in 0.747s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:02:42 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-dc4f0e14-87b7-4b37-a387-a8d48a8fa706 tempest-VolumeImageDependencyTests-407178336 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fb3ca507-9420-4d4d-ab7b-85bc1a190c5a_hevtc2a7devstack@QuobyteHD' failed. Not Retrying. {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 15 16:02:42 devstack cinder-volume[91863]: DEBUG cinder.image.image_utils [None req-dc4f0e14-87b7-4b37-a387-a8d48a8fa706 tempest-VolumeImageDependencyTests-407178336 None] fb3ca507-9420-4d4d-ab7b-85bc1a190c5a was raw, converting to raw {{(pid=91863) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 15 16:02:42 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-dc4f0e14-87b7-4b37-a387-a8d48a8fa706 tempest-VolumeImageDependencyTests-407178336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_fb3ca507-9420-4d4d-ab7b-85bc1a190c5a_hevtc2a7devstack@QuobyteHD /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-01a59af1-ac60-436a-ba20-3de0dc1584a3 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:02:42 devstack sudo[105675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_fb3ca507-9420-4d4d-ab7b-85bc1a190c5a_hevtc2a7devstack@QuobyteHD /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-01a59af1-ac60-436a-ba20-3de0dc1584a3
Jun 15 16:02:42 devstack sudo[105675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:02:42 devstack sudo[105662]: pam_unix(sudo:session): session closed for user root
Jun 15 16:02:42 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-82a81654-d0c1-4d3a-a8fe-06131894c8c8 tempest-VolumesActionsTest-1879812582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-15763aef-e495-466a-b919-a0bb6171f0cf" returned: 0 in 0.817s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:02:42 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-82a81654-d0c1-4d3a-a8fe-06131894c8c8 tempest-VolumesActionsTest-1879812582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-15763aef-e495-466a-b919-a0bb6171f0cf /opt/stack/data/cinder/conversion/15763aef-e495-466a-b919-a0bb6171f0cf.temp_image.78a85ea5-a48e-4da7-b006-84d16f5da0562z203k9m.img {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:02:42 devstack sudo[105660]: pam_unix(sudo:session): session closed for user root
Jun 15 16:02:42 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-fd831b22-124b-4ef8-abc1-e9a0f931d745 tempest-VolumesGetTest-1408686534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_43adaed4-5eec-483a-aa2b-0818266a94f1_0wz2d1fx" returned: 1 in 0.853s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:02:42 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-fd831b22-124b-4ef8-abc1-e9a0f931d745 tempest-VolumesGetTest-1408686534 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_43adaed4-5eec-483a-aa2b-0818266a94f1_0wz2d1fx' failed. Not Retrying. {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 15 16:02:42 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f183c71b-7caf-41d7-8bf8-35c52e1bf217]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:02:42 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-fd831b22-124b-4ef8-abc1-e9a0f931d745 tempest-VolumesGetTest-1408686534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_43adaed4-5eec-483a-aa2b-0818266a94f1_oabono_6devstack@QuobyteHD {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:02:42 devstack sudo[105677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-15763aef-e495-466a-b919-a0bb6171f0cf /opt/stack/data/cinder/conversion/15763aef-e495-466a-b919-a0bb6171f0cf.temp_image.78a85ea5-a48e-4da7-b006-84d16f5da0562z203k9m.img
Jun 15 16:02:42 devstack sudo[105677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:02:42 devstack sudo[105678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_43adaed4-5eec-483a-aa2b-0818266a94f1_oabono_6devstack@QuobyteHD
Jun 15 16:02:42 devstack sudo[105678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:02:42 devstack sudo[105675]: pam_unix(sudo:session): session closed for user root
Jun 15 16:02:42 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-dc4f0e14-87b7-4b37-a387-a8d48a8fa706 tempest-VolumeImageDependencyTests-407178336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_fb3ca507-9420-4d4d-ab7b-85bc1a190c5a_hevtc2a7devstack@QuobyteHD /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-01a59af1-ac60-436a-ba20-3de0dc1584a3" returned: 0 in 0.755s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:02:42 devstack cinder-volume[91863]: DEBUG cinder.image.image_utils [None req-dc4f0e14-87b7-4b37-a387-a8d48a8fa706 tempest-VolumeImageDependencyTests-407178336 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fb3ca507-9420-4d4d-ab7b-85bc1a190c5a_hevtc2a7devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-01a59af1-ac60-436a-ba20-3de0dc1584a3 {{(pid=91863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 15 16:02:42 devstack cinder-volume[91863]: INFO cinder.image.image_utils [None req-dc4f0e14-87b7-4b37-a387-a8d48a8fa706 tempest-VolumeImageDependencyTests-407178336 None] Converted 0.00 MB image at 0.00 MB/s
Jun 15 16:02:42 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-dc4f0e14-87b7-4b37-a387-a8d48a8fa706 tempest-VolumeImageDependencyTests-407178336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-01a59af1-ac60-436a-ba20-3de0dc1584a3 1G {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:02:42 devstack sudo[105697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-01a59af1-ac60-436a-ba20-3de0dc1584a3 1G
Jun 15 16:02:42 devstack sudo[105697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:02:43 devstack sudo[105678]: pam_unix(sudo:session): session closed for user root
Jun 15 16:02:43 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-fd831b22-124b-4ef8-abc1-e9a0f931d745 tempest-VolumesGetTest-1408686534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_43adaed4-5eec-483a-aa2b-0818266a94f1_oabono_6devstack@QuobyteHD" returned: 0 in 0.920s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:02:43 devstack cinder-volume[91863]: DEBUG cinder.image.image_utils [None req-fd831b22-124b-4ef8-abc1-e9a0f931d745 tempest-VolumesGetTest-1408686534 None] 43adaed4-5eec-483a-aa2b-0818266a94f1 was qcow2, converting to raw {{(pid=91863) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 15 16:02:43 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-fd831b22-124b-4ef8-abc1-e9a0f931d745 tempest-VolumesGetTest-1408686534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_43adaed4-5eec-483a-aa2b-0818266a94f1_oabono_6devstack@QuobyteHD /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5b6792ae-7ea5-47b1-bddb-0b0b89ff3d40 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:02:43 devstack sudo[105699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_43adaed4-5eec-483a-aa2b-0818266a94f1_oabono_6devstack@QuobyteHD /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5b6792ae-7ea5-47b1-bddb-0b0b89ff3d40
Jun 15 16:02:43 devstack sudo[105699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:02:44 devstack sudo[105697]: pam_unix(sudo:session): session closed for user root
Jun 15 16:02:44 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-dc4f0e14-87b7-4b37-a387-a8d48a8fa706 tempest-VolumeImageDependencyTests-407178336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-01a59af1-ac60-436a-ba20-3de0dc1584a3 1G" returned: 0 in 1.771s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:02:44 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[449a5a66-0e02-485d-bd06-a53d31fbb3b6]: (4, 'raw') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:02:44 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-dc4f0e14-87b7-4b37-a387-a8d48a8fa706 tempest-VolumeImageDependencyTests-407178336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-01a59af1-ac60-436a-ba20-3de0dc1584a3 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:02:44 devstack sudo[105712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-01a59af1-ac60-436a-ba20-3de0dc1584a3
Jun 15 16:02:44 devstack sudo[105712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:02:46 devstack sudo[105712]: pam_unix(sudo:session): session closed for user root
Jun 15 16:02:46 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-dc4f0e14-87b7-4b37-a387-a8d48a8fa706 tempest-VolumeImageDependencyTests-407178336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-01a59af1-ac60-436a-ba20-3de0dc1584a3" returned: 0 in 1.388s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:02:46 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-dc4f0e14-87b7-4b37-a387-a8d48a8fa706 tempest-VolumeImageDependencyTests-407178336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-01a59af1-ac60-436a-ba20-3de0dc1584a3 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:02:46 devstack sudo[105716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-01a59af1-ac60-436a-ba20-3de0dc1584a3
Jun 15 16:02:46 devstack sudo[105716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:02:47 devstack sudo[105699]: pam_unix(sudo:session): session closed for user root
Jun 15 16:02:47 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-fd831b22-124b-4ef8-abc1-e9a0f931d745 tempest-VolumesGetTest-1408686534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_43adaed4-5eec-483a-aa2b-0818266a94f1_oabono_6devstack@QuobyteHD /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5b6792ae-7ea5-47b1-bddb-0b0b89ff3d40" returned: 0 in 4.229s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:02:47 devstack cinder-volume[91863]: DEBUG cinder.image.image_utils [None req-fd831b22-124b-4ef8-abc1-e9a0f931d745 tempest-VolumesGetTest-1408686534 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_43adaed4-5eec-483a-aa2b-0818266a94f1_oabono_6devstack@QuobyteHD, size 112.00 MB, duration 4.23 sec, destination /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5b6792ae-7ea5-47b1-bddb-0b0b89ff3d40 {{(pid=91863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 15 16:02:47 devstack cinder-volume[91863]: INFO cinder.image.image_utils [None req-fd831b22-124b-4ef8-abc1-e9a0f931d745 tempest-VolumesGetTest-1408686534 None] Converted 112.00 MB image at 26.46 MB/s
Jun 15 16:02:47 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-fd831b22-124b-4ef8-abc1-e9a0f931d745 tempest-VolumesGetTest-1408686534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5b6792ae-7ea5-47b1-bddb-0b0b89ff3d40 1G {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:02:47 devstack sudo[105720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5b6792ae-7ea5-47b1-bddb-0b0b89ff3d40 1G
Jun 15 16:02:47 devstack sudo[105720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:02:47 devstack sudo[105716]: pam_unix(sudo:session): session closed for user root
Jun 15 16:02:47 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-dc4f0e14-87b7-4b37-a387-a8d48a8fa706 tempest-VolumeImageDependencyTests-407178336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-01a59af1-ac60-436a-ba20-3de0dc1584a3" returned: 1 in 1.606s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:02:47 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-dc4f0e14-87b7-4b37-a387-a8d48a8fa706 tempest-VolumeImageDependencyTests-407178336 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-01a59af1-ac60-436a-ba20-3de0dc1584a3' failed. Not Retrying. {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 15 16:02:47 devstack cinder-volume[91863]: DEBUG cinder.volume.volume_utils [None req-dc4f0e14-87b7-4b37-a387-a8d48a8fa706 tempest-VolumeImageDependencyTests-407178336 None] Downloaded image fb3ca507-9420-4d4d-ab7b-85bc1a190c5a ((None, [{'url': 'file:///opt/stack/data/glance/images/fb3ca507-9420-4d4d-ab7b-85bc1a190c5a', 'metadata': {}}])) to volume 01a59af1-ac60-436a-ba20-3de0dc1584a3 successfully. {{(pid=91863) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 15 16:02:47 devstack cinder-volume[91863]: DEBUG cinder.image.image_utils [None req-dc4f0e14-87b7-4b37-a387-a8d48a8fa706 tempest-VolumeImageDependencyTests-407178336 None] Temporary image fb3ca507-9420-4d4d-ab7b-85bc1a190c5a for user 14d9612c08db41ff9fefa034d2afd096 is deleted. {{(pid=91863) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 15 16:02:47 devstack cinder-volume[91863]: DEBUG cinder.volume.volume_utils [None req-dc4f0e14-87b7-4b37-a387-a8d48a8fa706 tempest-VolumeImageDependencyTests-407178336 None] Marking volume 01a59af1-ac60-436a-ba20-3de0dc1584a3 as bootable. {{(pid=91863) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 15 16:02:47 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc4f0e14-87b7-4b37-a387-a8d48a8fa706 tempest-VolumeImageDependencyTests-407178336 None] Copying metadata from image fb3ca507-9420-4d4d-ab7b-85bc1a190c5a to 01a59af1-ac60-436a-ba20-3de0dc1584a3. {{(pid=91863) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 15 16:02:47 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc4f0e14-87b7-4b37-a387-a8d48a8fa706 tempest-VolumeImageDependencyTests-407178336 None] Creating volume glance metadata for volume 01a59af1-ac60-436a-ba20-3de0dc1584a3 backed by image fb3ca507-9420-4d4d-ab7b-85bc1a190c5a with: {'image_id': 'fb3ca507-9420-4d4d-ab7b-85bc1a190c5a', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'c3005cefb023445a96e833d31fe1629e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=91863) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 15 16:02:47 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-dc4f0e14-87b7-4b37-a387-a8d48a8fa706 tempest-VolumeImageDependencyTests-407178336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (067e2ca4-697b-42f0-8d75-7e402634d0b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01a59af1-ac60-436a-ba20-3de0dc1584a3', 'volume_size': 1, 'image_id': 'fb3ca507-9420-4d4d-ab7b-85bc1a190c5a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fb3ca507-9420-4d4d-ab7b-85bc1a190c5a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c3005cefb023445a96e833d31fe1629e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '74d360696c0d49bfa12f92777783b7c3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'eaf33bf0ff662dc8a5043d188003edf1ff8dcda1206c4616a3bd9bfb33579b0494082a3f9024e6d472f4ea11397d5171ed3e066cf8c622c567c4be3a768eb2ad', 'id': 'fb3ca507-9420-4d4d-ab7b-85bc1a190c5a', 'created_at': datetime.datetime(2026, 6, 15, 14, 2, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 14, 2, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fb3ca507-9420-4d4d-ab7b-85bc1a190c5a/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7739545851c0>}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:02:47 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-dc4f0e14-87b7-4b37-a387-a8d48a8fa706 tempest-VolumeImageDependencyTests-407178336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2c56d82-0c01-4f4f-aa86-cee2192e7f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:02:47 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-dc4f0e14-87b7-4b37-a387-a8d48a8fa706 tempest-VolumeImageDependencyTests-407178336 None] Volume volume-01a59af1-ac60-436a-ba20-3de0dc1584a3 (01a59af1-ac60-436a-ba20-3de0dc1584a3): created successfully
Jun 15 16:02:47 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-dc4f0e14-87b7-4b37-a387-a8d48a8fa706 tempest-VolumeImageDependencyTests-407178336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2c56d82-0c01-4f4f-aa86-cee2192e7f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:02:47 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-dc4f0e14-87b7-4b37-a387-a8d48a8fa706 tempest-VolumeImageDependencyTests-407178336 None] Flow 'volume_create_manager' (bb57c5b9-9f23-49b8-b6a4-adf02cb8f8ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:02:47 devstack sudo[105677]: pam_unix(sudo:session): session closed for user root
Jun 15 16:02:47 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-82a81654-d0c1-4d3a-a8fe-06131894c8c8 tempest-VolumesActionsTest-1879812582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-15763aef-e495-466a-b919-a0bb6171f0cf /opt/stack/data/cinder/conversion/15763aef-e495-466a-b919-a0bb6171f0cf.temp_image.78a85ea5-a48e-4da7-b006-84d16f5da0562z203k9m.img" returned: 0 in 5.715s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:02:47 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-dc4f0e14-87b7-4b37-a387-a8d48a8fa706 tempest-VolumeImageDependencyTests-407178336 None] Created volume successfully.
Jun 15 16:02:47 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d94426a4-8526-4f55-9c97-6c2a083997db]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:02:47 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-82a81654-d0c1-4d3a-a8fe-06131894c8c8 tempest-VolumesActionsTest-1879812582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-15763aef-e495-466a-b919-a0bb6171f0cf {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:02:47 devstack sudo[105723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-15763aef-e495-466a-b919-a0bb6171f0cf
Jun 15 16:02:47 devstack sudo[105723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:02:48 devstack sudo[105720]: pam_unix(sudo:session): session closed for user root
Jun 15 16:02:48 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-fd831b22-124b-4ef8-abc1-e9a0f931d745 tempest-VolumesGetTest-1408686534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5b6792ae-7ea5-47b1-bddb-0b0b89ff3d40 1G" returned: 0 in 0.997s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:02:48 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d87c99-f4b4-4855-90f5-5df97d9202f0]: (4, 'raw') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:02:48 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-fd831b22-124b-4ef8-abc1-e9a0f931d745 tempest-VolumesGetTest-1408686534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5b6792ae-7ea5-47b1-bddb-0b0b89ff3d40 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:02:48 devstack sudo[105729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5b6792ae-7ea5-47b1-bddb-0b0b89ff3d40
Jun 15 16:02:48 devstack sudo[105729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:02:48 devstack sudo[105723]: pam_unix(sudo:session): session closed for user root
Jun 15 16:02:48 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-82a81654-d0c1-4d3a-a8fe-06131894c8c8 tempest-VolumesActionsTest-1879812582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-15763aef-e495-466a-b919-a0bb6171f0cf" returned: 0 in 0.971s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:02:48 devstack cinder-volume[91863]: DEBUG cinder.image.image_utils [None req-82a81654-d0c1-4d3a-a8fe-06131894c8c8 tempest-VolumesActionsTest-1879812582 None] Image conversion details: src /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-15763aef-e495-466a-b919-a0bb6171f0cf, size 1024.00 MB, duration 5.72 sec, destination /opt/stack/data/cinder/conversion/15763aef-e495-466a-b919-a0bb6171f0cf.temp_image.78a85ea5-a48e-4da7-b006-84d16f5da0562z203k9m.img {{(pid=91863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 15 16:02:48 devstack cinder-volume[91863]: INFO cinder.image.image_utils [None req-82a81654-d0c1-4d3a-a8fe-06131894c8c8 tempest-VolumesActionsTest-1879812582 None] Converted 1024.00 MB image at 179.14 MB/s
Jun 15 16:02:48 devstack cinder-volume[91863]: DEBUG cinder.image.image_utils [None req-82a81654-d0c1-4d3a-a8fe-06131894c8c8 tempest-VolumesActionsTest-1879812582 None] 78a85ea5-a48e-4da7-b006-84d16f5da056 was raw, converting to qcow2 {{(pid=91863) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}}
Jun 15 16:02:48 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf405c9-01c9-480f-b32b-e7a90d66b492]: (4, 'raw') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:02:48 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-82a81654-d0c1-4d3a-a8fe-06131894c8c8 tempest-VolumesActionsTest-1879812582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/15763aef-e495-466a-b919-a0bb6171f0cf.temp_image.78a85ea5-a48e-4da7-b006-84d16f5da0562z203k9m.img {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:02:48 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-9cc435df-8991-4bbb-b0ef-bc2bd602dc89 tempest-VolumeImageDependencyTests-407178336 None] Acquiring lock "cinder-01a59af1-ac60-436a-ba20-3de0dc1584a3-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:02:49 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-9cc435df-8991-4bbb-b0ef-bc2bd602dc89 tempest-VolumeImageDependencyTests-407178336 None] Lock "cinder-01a59af1-ac60-436a-ba20-3de0dc1584a3-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:02:49 devstack sudo[105734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/15763aef-e495-466a-b919-a0bb6171f0cf.temp_image.78a85ea5-a48e-4da7-b006-84d16f5da0562z203k9m.img
Jun 15 16:02:49 devstack sudo[105734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:02:49 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-9cc435df-8991-4bbb-b0ef-bc2bd602dc89 tempest-VolumeImageDependencyTests-407178336 None] Acquiring lock "cinder-quobyte-01a59af1-ac60-436a-ba20-3de0dc1584a3" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:02:49 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-9cc435df-8991-4bbb-b0ef-bc2bd602dc89 tempest-VolumeImageDependencyTests-407178336 None] Lock "cinder-quobyte-01a59af1-ac60-436a-ba20-3de0dc1584a3" acquired by "delete_volume" :: waited 0.026s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:02:49 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6751094-c39a-4edf-94bc-3749a477aec2]: (4, 'raw') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:02:49 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-9cc435df-8991-4bbb-b0ef-bc2bd602dc89 tempest-VolumeImageDependencyTests-407178336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-01a59af1-ac60-436a-ba20-3de0dc1584a3 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:02:49 devstack sudo[105729]: pam_unix(sudo:session): session closed for user root
Jun 15 16:02:49 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-fd831b22-124b-4ef8-abc1-e9a0f931d745 tempest-VolumesGetTest-1408686534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5b6792ae-7ea5-47b1-bddb-0b0b89ff3d40" returned: 0 in 0.801s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:02:49 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-fd831b22-124b-4ef8-abc1-e9a0f931d745 tempest-VolumesGetTest-1408686534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5b6792ae-7ea5-47b1-bddb-0b0b89ff3d40 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:02:49 devstack sudo[105738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-01a59af1-ac60-436a-ba20-3de0dc1584a3
Jun 15 16:02:49 devstack sudo[105738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:02:49 devstack sudo[105739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5b6792ae-7ea5-47b1-bddb-0b0b89ff3d40
Jun 15 16:02:49 devstack sudo[105739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:02:49 devstack sudo[105734]: pam_unix(sudo:session): session closed for user root
Jun 15 16:02:49 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-82a81654-d0c1-4d3a-a8fe-06131894c8c8 tempest-VolumesActionsTest-1879812582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/15763aef-e495-466a-b919-a0bb6171f0cf.temp_image.78a85ea5-a48e-4da7-b006-84d16f5da0562z203k9m.img" returned: 0 in 0.886s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:02:49 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-82a81654-d0c1-4d3a-a8fe-06131894c8c8 tempest-VolumesActionsTest-1879812582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/15763aef-e495-466a-b919-a0bb6171f0cf.temp_image.78a85ea5-a48e-4da7-b006-84d16f5da0562z203k9m.img {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:02:49 devstack sudo[105738]: pam_unix(sudo:session): session closed for user root
Jun 15 16:02:49 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-9cc435df-8991-4bbb-b0ef-bc2bd602dc89 tempest-VolumeImageDependencyTests-407178336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-01a59af1-ac60-436a-ba20-3de0dc1584a3" returned: 0 in 0.712s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:02:49 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-9cc435df-8991-4bbb-b0ef-bc2bd602dc89 tempest-VolumeImageDependencyTests-407178336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-01a59af1-ac60-436a-ba20-3de0dc1584a3 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:02:49 devstack sudo[105739]: pam_unix(sudo:session): session closed for user root
Jun 15 16:02:49 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-fd831b22-124b-4ef8-abc1-e9a0f931d745 tempest-VolumesGetTest-1408686534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5b6792ae-7ea5-47b1-bddb-0b0b89ff3d40" returned: 1 in 0.724s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:02:49 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-fd831b22-124b-4ef8-abc1-e9a0f931d745 tempest-VolumesGetTest-1408686534 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5b6792ae-7ea5-47b1-bddb-0b0b89ff3d40' failed. Not Retrying. {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 15 16:02:49 devstack cinder-volume[91863]: DEBUG cinder.volume.volume_utils [None req-fd831b22-124b-4ef8-abc1-e9a0f931d745 tempest-VolumesGetTest-1408686534 None] Downloaded image 43adaed4-5eec-483a-aa2b-0818266a94f1 ((None, [{'url': 'file:///opt/stack/data/glance/images/43adaed4-5eec-483a-aa2b-0818266a94f1', 'metadata': {}}])) to volume 5b6792ae-7ea5-47b1-bddb-0b0b89ff3d40 successfully. {{(pid=91863) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 15 16:02:49 devstack sudo[105748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/15763aef-e495-466a-b919-a0bb6171f0cf.temp_image.78a85ea5-a48e-4da7-b006-84d16f5da0562z203k9m.img
Jun 15 16:02:49 devstack sudo[105748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:02:49 devstack cinder-volume[91863]: DEBUG cinder.image.image_utils [None req-fd831b22-124b-4ef8-abc1-e9a0f931d745 tempest-VolumesGetTest-1408686534 None] Temporary image 43adaed4-5eec-483a-aa2b-0818266a94f1 for user 6fadaeabe0e54ddfaeda00f848c0c309 is deleted. {{(pid=91863) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 15 16:02:49 devstack cinder-volume[91863]: DEBUG cinder.volume.volume_utils [None req-fd831b22-124b-4ef8-abc1-e9a0f931d745 tempest-VolumesGetTest-1408686534 None] Marking volume 5b6792ae-7ea5-47b1-bddb-0b0b89ff3d40 as bootable. {{(pid=91863) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 15 16:02:49 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd831b22-124b-4ef8-abc1-e9a0f931d745 tempest-VolumesGetTest-1408686534 None] Copying metadata from image 43adaed4-5eec-483a-aa2b-0818266a94f1 to 5b6792ae-7ea5-47b1-bddb-0b0b89ff3d40. {{(pid=91863) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 15 16:02:49 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd831b22-124b-4ef8-abc1-e9a0f931d745 tempest-VolumesGetTest-1408686534 None] Creating volume glance metadata for volume 5b6792ae-7ea5-47b1-bddb-0b0b89ff3d40 backed by image 43adaed4-5eec-483a-aa2b-0818266a94f1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '43adaed4-5eec-483a-aa2b-0818266a94f1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=91863) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 15 16:02:49 devstack sudo[105750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-01a59af1-ac60-436a-ba20-3de0dc1584a3
Jun 15 16:02:49 devstack sudo[105750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:02:50 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-fd831b22-124b-4ef8-abc1-e9a0f931d745 tempest-VolumesGetTest-1408686534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9176c6ad-725e-4f8b-ab4f-f7843aeb3e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b6792ae-7ea5-47b1-bddb-0b0b89ff3d40', 'volume_size': 1, 'image_id': '43adaed4-5eec-483a-aa2b-0818266a94f1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/43adaed4-5eec-483a-aa2b-0818266a94f1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '601536f092c54cdc9ee754c7b1abc241', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '43adaed4-5eec-483a-aa2b-0818266a94f1', 'created_at': datetime.datetime(2026, 6, 15, 13, 42, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 13, 42, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/43adaed4-5eec-483a-aa2b-0818266a94f1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x77395471b290>}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:02:50 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-fd831b22-124b-4ef8-abc1-e9a0f931d745 tempest-VolumesGetTest-1408686534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc1f3403-75fb-4f36-bc0f-525d4ef4b1c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:02:50 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-fd831b22-124b-4ef8-abc1-e9a0f931d745 tempest-VolumesGetTest-1408686534 None] Volume volume-5b6792ae-7ea5-47b1-bddb-0b0b89ff3d40 (5b6792ae-7ea5-47b1-bddb-0b0b89ff3d40): created successfully
Jun 15 16:02:50 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-fd831b22-124b-4ef8-abc1-e9a0f931d745 tempest-VolumesGetTest-1408686534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc1f3403-75fb-4f36-bc0f-525d4ef4b1c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:02:50 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-fd831b22-124b-4ef8-abc1-e9a0f931d745 tempest-VolumesGetTest-1408686534 None] Flow 'volume_create_manager' (ade85a22-10eb-47fc-b36f-6b1d386cf356) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:02:50 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-fd831b22-124b-4ef8-abc1-e9a0f931d745 tempest-VolumesGetTest-1408686534 None] Created volume successfully.
Jun 15 16:02:50 devstack sudo[105748]: pam_unix(sudo:session): session closed for user root
Jun 15 16:02:50 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-82a81654-d0c1-4d3a-a8fe-06131894c8c8 tempest-VolumesActionsTest-1879812582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/15763aef-e495-466a-b919-a0bb6171f0cf.temp_image.78a85ea5-a48e-4da7-b006-84d16f5da0562z203k9m.img" returned: 1 in 0.776s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:02:50 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-82a81654-d0c1-4d3a-a8fe-06131894c8c8 tempest-VolumesActionsTest-1879812582 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/15763aef-e495-466a-b919-a0bb6171f0cf.temp_image.78a85ea5-a48e-4da7-b006-84d16f5da0562z203k9m.img' failed. Not Retrying. {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 15 16:02:50 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-82a81654-d0c1-4d3a-a8fe-06131894c8c8 tempest-VolumesActionsTest-1879812582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/15763aef-e495-466a-b919-a0bb6171f0cf.temp_image.78a85ea5-a48e-4da7-b006-84d16f5da0562z203k9m.img /opt/stack/data/cinder/conversion/vol_upload_d_bex9n9 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:02:50 devstack sudo[105758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/15763aef-e495-466a-b919-a0bb6171f0cf.temp_image.78a85ea5-a48e-4da7-b006-84d16f5da0562z203k9m.img /opt/stack/data/cinder/conversion/vol_upload_d_bex9n9
Jun 15 16:02:50 devstack sudo[105758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:02:50 devstack sudo[105750]: pam_unix(sudo:session): session closed for user root
Jun 15 16:02:50 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-9cc435df-8991-4bbb-b0ef-bc2bd602dc89 tempest-VolumeImageDependencyTests-407178336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-01a59af1-ac60-436a-ba20-3de0dc1584a3" returned: 1 in 0.836s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:02:50 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-9cc435df-8991-4bbb-b0ef-bc2bd602dc89 tempest-VolumeImageDependencyTests-407178336 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-01a59af1-ac60-436a-ba20-3de0dc1584a3' failed. Not Retrying. {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 15 16:02:50 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-9cc435df-8991-4bbb-b0ef-bc2bd602dc89 tempest-VolumeImageDependencyTests-407178336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-01a59af1-ac60-436a-ba20-3de0dc1584a3 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:02:50 devstack sudo[105761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-01a59af1-ac60-436a-ba20-3de0dc1584a3
Jun 15 16:02:50 devstack sudo[105761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:02:50 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fe52537-805a-45db-bd6f-0f4f84042baf tempest-VolumesGetTest-1408686534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 16:02:50 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5fe52537-805a-45db-bd6f-0f4f84042baf tempest-VolumesGetTest-1408686534 None] Flow 'volume_create_manager' (29975179-6048-4334-bc82-938abe6635af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:02:50 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5fe52537-805a-45db-bd6f-0f4f84042baf tempest-VolumesGetTest-1408686534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30ee0e80-2e16-4d54-8441-90e8b0d151cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:02:50 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5fe52537-805a-45db-bd6f-0f4f84042baf tempest-VolumesGetTest-1408686534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30ee0e80-2e16-4d54-8441-90e8b0d151cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:02:51Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1898729680',display_name='tempest-VolumesGetTest-Volume-358853869',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9c22061-a3bd-4b1b-b22b-52afaa964b66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b89be12fba7e480f872e67eec6dca5e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:02:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:02:51Z,use_quota=True,user_id='6fadaeabe0e54ddfaeda00f848c0c309',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:02:50 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5fe52537-805a-45db-bd6f-0f4f84042baf tempest-VolumesGetTest-1408686534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83c5d538-b690-4a5a-9972-01ac7d0dd1bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:02:50 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5fe52537-805a-45db-bd6f-0f4f84042baf tempest-VolumesGetTest-1408686534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83c5d538-b690-4a5a-9972-01ac7d0dd1bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:02:50 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5fe52537-805a-45db-bd6f-0f4f84042baf tempest-VolumesGetTest-1408686534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c346ca1f-5161-4f77-9285-23eb54d99fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:02:50 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5fe52537-805a-45db-bd6f-0f4f84042baf tempest-VolumesGetTest-1408686534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c346ca1f-5161-4f77-9285-23eb54d99fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9c22061-a3bd-4b1b-b22b-52afaa964b66', 'volume_name': 'volume-d9c22061-a3bd-4b1b-b22b-52afaa964b66', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:02:50 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5fe52537-805a-45db-bd6f-0f4f84042baf tempest-VolumesGetTest-1408686534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9219f8d5-fee9-4a6b-9eba-800851429e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:02:50 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5fe52537-805a-45db-bd6f-0f4f84042baf tempest-VolumesGetTest-1408686534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9219f8d5-fee9-4a6b-9eba-800851429e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:02:51 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5fe52537-805a-45db-bd6f-0f4f84042baf tempest-VolumesGetTest-1408686534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6427a34-46f5-4221-8bd1-c8180e4d6edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:02:51 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-5fe52537-805a-45db-bd6f-0f4f84042baf tempest-VolumesGetTest-1408686534 None] Volume d9c22061-a3bd-4b1b-b22b-52afaa964b66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9c22061-a3bd-4b1b-b22b-52afaa964b66', 'volume_size': 1}
Jun 15 16:02:51 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-5fe52537-805a-45db-bd6f-0f4f84042baf tempest-VolumesGetTest-1408686534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:02:51 devstack sudo[105758]: pam_unix(sudo:session): session closed for user root
Jun 15 16:02:51 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-82a81654-d0c1-4d3a-a8fe-06131894c8c8 tempest-VolumesActionsTest-1879812582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/15763aef-e495-466a-b919-a0bb6171f0cf.temp_image.78a85ea5-a48e-4da7-b006-84d16f5da0562z203k9m.img /opt/stack/data/cinder/conversion/vol_upload_d_bex9n9" returned: 0 in 0.738s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:02:51 devstack cinder-volume[91863]: DEBUG cinder.image.image_utils [None req-82a81654-d0c1-4d3a-a8fe-06131894c8c8 tempest-VolumesActionsTest-1879812582 None] Image conversion details: src /opt/stack/data/cinder/conversion/15763aef-e495-466a-b919-a0bb6171f0cf.temp_image.78a85ea5-a48e-4da7-b006-84d16f5da0562z203k9m.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_d_bex9n9 {{(pid=91863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 15 16:02:51 devstack cinder-volume[91863]: INFO cinder.image.image_utils [None req-82a81654-d0c1-4d3a-a8fe-06131894c8c8 tempest-VolumesActionsTest-1879812582 None] Converted 1024.00 MB image at 1024.00 MB/s
Jun 15 16:02:51 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[39de9b30-9f60-4c9b-b9eb-d43f2278ab18]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:02:51 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-82a81654-d0c1-4d3a-a8fe-06131894c8c8 tempest-VolumesActionsTest-1879812582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_d_bex9n9 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:02:51 devstack sudo[105761]: pam_unix(sudo:session): session closed for user root
Jun 15 16:02:51 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-9cc435df-8991-4bbb-b0ef-bc2bd602dc89 tempest-VolumeImageDependencyTests-407178336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-01a59af1-ac60-436a-ba20-3de0dc1584a3" returned: 0 in 0.643s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:02:51 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-9cc435df-8991-4bbb-b0ef-bc2bd602dc89 tempest-VolumeImageDependencyTests-407178336 None] Lock "cinder-quobyte-01a59af1-ac60-436a-ba20-3de0dc1584a3" released by "delete_volume" :: held 2.257s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:02:51 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-9cc435df-8991-4bbb-b0ef-bc2bd602dc89 tempest-VolumeImageDependencyTests-407178336 None] Created reservations ['c694fb4f-670d-4a3d-90c7-dd31c7fe7b0b', 'db167c76-eb50-4912-8554-2d2640424525', '4ead5f6d-ca68-460d-8651-cd33272b5592', 'c6efe540-28e7-41ae-87db-9c0c7123f125'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 16:02:51 devstack sudo[105769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_d_bex9n9
Jun 15 16:02:51 devstack sudo[105769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:02:51 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-9cc435df-8991-4bbb-b0ef-bc2bd602dc89 tempest-VolumeImageDependencyTests-407178336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:02:51 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-9cc435df-8991-4bbb-b0ef-bc2bd602dc89 tempest-VolumeImageDependencyTests-407178336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:02:51 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-9cc435df-8991-4bbb-b0ef-bc2bd602dc89 tempest-VolumeImageDependencyTests-407178336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:02:51 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-9cc435df-8991-4bbb-b0ef-bc2bd602dc89 tempest-VolumeImageDependencyTests-407178336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:02:51 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-9cc435df-8991-4bbb-b0ef-bc2bd602dc89 tempest-VolumeImageDependencyTests-407178336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:02:51 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-9cc435df-8991-4bbb-b0ef-bc2bd602dc89 tempest-VolumeImageDependencyTests-407178336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:02:51 devstack sudo[105771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 16:02:51 devstack sudo[105771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:02:52 devstack sudo[105769]: pam_unix(sudo:session): session closed for user root
Jun 15 16:02:52 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-82a81654-d0c1-4d3a-a8fe-06131894c8c8 tempest-VolumesActionsTest-1879812582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_d_bex9n9" returned: 0 in 0.755s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:02:52 devstack sudo[105771]: pam_unix(sudo:session): session closed for user root
Jun 15 16:02:52 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-9cc435df-8991-4bbb-b0ef-bc2bd602dc89 tempest-VolumeImageDependencyTests-407178336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.620s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:02:52 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-9cc435df-8991-4bbb-b0ef-bc2bd602dc89 tempest-VolumeImageDependencyTests-407178336 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 16:02:52 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-9cc435df-8991-4bbb-b0ef-bc2bd602dc89 tempest-VolumeImageDependencyTests-407178336 None] Deleted volume successfully.
Jun 15 16:02:52 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-9cc435df-8991-4bbb-b0ef-bc2bd602dc89 tempest-VolumeImageDependencyTests-407178336 None] Lock "cinder-01a59af1-ac60-436a-ba20-3de0dc1584a3-delete_volume" released by "delete_volume" :: held 3.546s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:02:53 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-82a81654-d0c1-4d3a-a8fe-06131894c8c8 tempest-VolumesActionsTest-1879812582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.438s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:02:53 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-82a81654-d0c1-4d3a-a8fe-06131894c8c8 tempest-VolumesActionsTest-1879812582 None] Uploaded volume to glance image-id: 78a85ea5-a48e-4da7-b006-84d16f5da056. {{(pid=91863) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Jun 15 16:02:53 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-5fe52537-805a-45db-bd6f-0f4f84042baf tempest-VolumesGetTest-1408686534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.884s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:02:53 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-5fe52537-805a-45db-bd6f-0f4f84042baf tempest-VolumesGetTest-1408686534 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:02:51Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1898729680',display_name='tempest-VolumesGetTest-Volume-358853869',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9c22061-a3bd-4b1b-b22b-52afaa964b66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b89be12fba7e480f872e67eec6dca5e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:02:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:02:51Z,use_quota=True,user_id='6fadaeabe0e54ddfaeda00f848c0c309',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 16:02:53 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-5fe52537-805a-45db-bd6f-0f4f84042baf tempest-VolumesGetTest-1408686534 None] Creating volume d9c22061-a3bd-4b1b-b22b-52afaa964b66 {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 16:02:53 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-5fe52537-805a-45db-bd6f-0f4f84042baf tempest-VolumesGetTest-1408686534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:02:53 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-5fe52537-805a-45db-bd6f-0f4f84042baf tempest-VolumesGetTest-1408686534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:02:53 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-5fe52537-805a-45db-bd6f-0f4f84042baf tempest-VolumesGetTest-1408686534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:02:53 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-5fe52537-805a-45db-bd6f-0f4f84042baf tempest-VolumesGetTest-1408686534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:02:53 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-5fe52537-805a-45db-bd6f-0f4f84042baf tempest-VolumesGetTest-1408686534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:02:53 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-5fe52537-805a-45db-bd6f-0f4f84042baf tempest-VolumesGetTest-1408686534 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 16:02:53 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-5fe52537-805a-45db-bd6f-0f4f84042baf tempest-VolumesGetTest-1408686534 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 16:02:53 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5fe52537-805a-45db-bd6f-0f4f84042baf tempest-VolumesGetTest-1408686534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-d9c22061-a3bd-4b1b-b22b-52afaa964b66 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:02:53 devstack sudo[105777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-d9c22061-a3bd-4b1b-b22b-52afaa964b66 1073741824
Jun 15 16:02:53 devstack sudo[105777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:02:53 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-82a81654-d0c1-4d3a-a8fe-06131894c8c8 tempest-VolumesActionsTest-1879812582 None] Copy volume to image completed successfully.
Jun 15 16:02:54 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-d72efb95-c86c-4d77-9371-a1e04b4b8cb9 tempest-VolumesActionsTest-1879812582 None] Acquiring lock "cinder-15763aef-e495-466a-b919-a0bb6171f0cf-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:02:54 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-d72efb95-c86c-4d77-9371-a1e04b4b8cb9 tempest-VolumesActionsTest-1879812582 None] Lock "cinder-15763aef-e495-466a-b919-a0bb6171f0cf-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:02:54 devstack sudo[105777]: pam_unix(sudo:session): session closed for user root
Jun 15 16:02:54 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5fe52537-805a-45db-bd6f-0f4f84042baf tempest-VolumesGetTest-1408686534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-d9c22061-a3bd-4b1b-b22b-52afaa964b66 1073741824" returned: 0 in 1.040s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:02:54 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-d72efb95-c86c-4d77-9371-a1e04b4b8cb9 tempest-VolumesActionsTest-1879812582 None] Acquiring lock "cinder-quobyte-15763aef-e495-466a-b919-a0bb6171f0cf" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:02:54 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-d72efb95-c86c-4d77-9371-a1e04b4b8cb9 tempest-VolumesActionsTest-1879812582 None] Lock "cinder-quobyte-15763aef-e495-466a-b919-a0bb6171f0cf" acquired by "delete_volume" :: waited 0.036s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:02:55 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e31ce518-2a0d-4ef3-b951-6ab5d7d9d745]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:02:55 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-d72efb95-c86c-4d77-9371-a1e04b4b8cb9 tempest-VolumesActionsTest-1879812582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-15763aef-e495-466a-b919-a0bb6171f0cf {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:02:55 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5fe52537-805a-45db-bd6f-0f4f84042baf tempest-VolumesGetTest-1408686534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-d9c22061-a3bd-4b1b-b22b-52afaa964b66 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:02:55 devstack sudo[105786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-d9c22061-a3bd-4b1b-b22b-52afaa964b66
Jun 15 16:02:55 devstack sudo[105786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:02:55 devstack sudo[105785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-15763aef-e495-466a-b919-a0bb6171f0cf
Jun 15 16:02:55 devstack sudo[105785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:02:55 devstack sudo[105786]: pam_unix(sudo:session): session closed for user root
Jun 15 16:02:55 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5fe52537-805a-45db-bd6f-0f4f84042baf tempest-VolumesGetTest-1408686534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-d9c22061-a3bd-4b1b-b22b-52afaa964b66" returned: 0 in 0.626s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:02:55 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-5fe52537-805a-45db-bd6f-0f4f84042baf tempest-VolumesGetTest-1408686534 None] <== create_volume: return (1767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 16:02:55 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-5fe52537-805a-45db-bd6f-0f4f84042baf tempest-VolumesGetTest-1408686534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.771s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:02:55 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5fe52537-805a-45db-bd6f-0f4f84042baf tempest-VolumesGetTest-1408686534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6427a34-46f5-4221-8bd1-c8180e4d6edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9c22061-a3bd-4b1b-b22b-52afaa964b66', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:02:55 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5fe52537-805a-45db-bd6f-0f4f84042baf tempest-VolumesGetTest-1408686534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (605b15fe-2e4d-4842-8915-d52860b7c02d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:02:55 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-5fe52537-805a-45db-bd6f-0f4f84042baf tempest-VolumesGetTest-1408686534 None] Volume volume-d9c22061-a3bd-4b1b-b22b-52afaa964b66 (d9c22061-a3bd-4b1b-b22b-52afaa964b66): created successfully
Jun 15 16:02:55 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5fe52537-805a-45db-bd6f-0f4f84042baf tempest-VolumesGetTest-1408686534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (605b15fe-2e4d-4842-8915-d52860b7c02d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:02:55 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5fe52537-805a-45db-bd6f-0f4f84042baf tempest-VolumesGetTest-1408686534 None] Flow 'volume_create_manager' (29975179-6048-4334-bc82-938abe6635af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:02:55 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-5fe52537-805a-45db-bd6f-0f4f84042baf tempest-VolumesGetTest-1408686534 None] Created volume successfully.
Jun 15 16:02:55 devstack sudo[105785]: pam_unix(sudo:session): session closed for user root
Jun 15 16:02:55 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-d72efb95-c86c-4d77-9371-a1e04b4b8cb9 tempest-VolumesActionsTest-1879812582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-15763aef-e495-466a-b919-a0bb6171f0cf" returned: 0 in 0.843s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:02:55 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-d72efb95-c86c-4d77-9371-a1e04b4b8cb9 tempest-VolumesActionsTest-1879812582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-15763aef-e495-466a-b919-a0bb6171f0cf {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:02:55 devstack sudo[105793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-15763aef-e495-466a-b919-a0bb6171f0cf
Jun 15 16:02:55 devstack sudo[105793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:02:56 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-10543260-0a67-44a2-b063-60a8e964f91c tempest-CinderUnicodeTest-2077516412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 16:02:56 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-10543260-0a67-44a2-b063-60a8e964f91c tempest-CinderUnicodeTest-2077516412 None] Flow 'volume_create_manager' (fb23b0e5-c9a8-48fc-b759-ccf367dc7064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:02:56 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-10543260-0a67-44a2-b063-60a8e964f91c tempest-CinderUnicodeTest-2077516412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (144abb7c-88e6-4716-bb29-4cd82613e1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:02:56 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-10543260-0a67-44a2-b063-60a8e964f91c tempest-CinderUnicodeTest-2077516412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (144abb7c-88e6-4716-bb29-4cd82613e1c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:02:56Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb0c75ea-d314-482d-8694-79d333459ebc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4320ab3c21a4634ae2037a4c1ac405a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:02:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:02:56Z,use_quota=True,user_id='2100b2f25e8d48c1a2a2309bcdeaee1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:02:56 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-10543260-0a67-44a2-b063-60a8e964f91c tempest-CinderUnicodeTest-2077516412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (087ace2c-44f4-4133-b624-1aba379e6cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:02:56 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-10543260-0a67-44a2-b063-60a8e964f91c tempest-CinderUnicodeTest-2077516412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (087ace2c-44f4-4133-b624-1aba379e6cae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:02:56 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-10543260-0a67-44a2-b063-60a8e964f91c tempest-CinderUnicodeTest-2077516412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc3899de-bbb7-4ec9-976f-12b63630267b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:02:56 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-10543260-0a67-44a2-b063-60a8e964f91c tempest-CinderUnicodeTest-2077516412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc3899de-bbb7-4ec9-976f-12b63630267b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb0c75ea-d314-482d-8694-79d333459ebc', 'volume_name': 'volume-bb0c75ea-d314-482d-8694-79d333459ebc', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:02:56 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-10543260-0a67-44a2-b063-60a8e964f91c tempest-CinderUnicodeTest-2077516412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f82d69d-db85-4209-a845-1e879b560663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:02:56 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-10543260-0a67-44a2-b063-60a8e964f91c tempest-CinderUnicodeTest-2077516412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f82d69d-db85-4209-a845-1e879b560663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:02:56 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-10543260-0a67-44a2-b063-60a8e964f91c tempest-CinderUnicodeTest-2077516412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ed774fc-a28d-40a8-90f3-bb4b882659a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:02:56 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-10543260-0a67-44a2-b063-60a8e964f91c tempest-CinderUnicodeTest-2077516412 None] Volume bb0c75ea-d314-482d-8694-79d333459ebc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb0c75ea-d314-482d-8694-79d333459ebc', 'volume_size': 1}
Jun 15 16:02:56 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-10543260-0a67-44a2-b063-60a8e964f91c tempest-CinderUnicodeTest-2077516412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:02:56 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-10543260-0a67-44a2-b063-60a8e964f91c tempest-CinderUnicodeTest-2077516412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:02:56 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-10543260-0a67-44a2-b063-60a8e964f91c tempest-CinderUnicodeTest-2077516412 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:02:56Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb0c75ea-d314-482d-8694-79d333459ebc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4320ab3c21a4634ae2037a4c1ac405a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:02:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:02:56Z,use_quota=True,user_id='2100b2f25e8d48c1a2a2309bcdeaee1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 16:02:56 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-10543260-0a67-44a2-b063-60a8e964f91c tempest-CinderUnicodeTest-2077516412 None] Creating volume bb0c75ea-d314-482d-8694-79d333459ebc {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 16:02:56 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-10543260-0a67-44a2-b063-60a8e964f91c tempest-CinderUnicodeTest-2077516412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:02:56 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-10543260-0a67-44a2-b063-60a8e964f91c tempest-CinderUnicodeTest-2077516412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:02:56 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-10543260-0a67-44a2-b063-60a8e964f91c tempest-CinderUnicodeTest-2077516412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:02:56 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-10543260-0a67-44a2-b063-60a8e964f91c tempest-CinderUnicodeTest-2077516412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:02:56 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-10543260-0a67-44a2-b063-60a8e964f91c tempest-CinderUnicodeTest-2077516412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:02:56 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-10543260-0a67-44a2-b063-60a8e964f91c tempest-CinderUnicodeTest-2077516412 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 16:02:56 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-10543260-0a67-44a2-b063-60a8e964f91c tempest-CinderUnicodeTest-2077516412 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 16:02:56 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-10543260-0a67-44a2-b063-60a8e964f91c tempest-CinderUnicodeTest-2077516412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-bb0c75ea-d314-482d-8694-79d333459ebc 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:02:56 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-8de93008-26fa-4738-aa21-0d1cf7c1991d tempest-VolumesGetTest-1408686534 None] Acquiring lock "cinder-d9c22061-a3bd-4b1b-b22b-52afaa964b66-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:02:56 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-8de93008-26fa-4738-aa21-0d1cf7c1991d tempest-VolumesGetTest-1408686534 None] Lock "cinder-d9c22061-a3bd-4b1b-b22b-52afaa964b66-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:02:56 devstack sudo[105795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-bb0c75ea-d314-482d-8694-79d333459ebc 1073741824
Jun 15 16:02:56 devstack sudo[105795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:02:56 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-8de93008-26fa-4738-aa21-0d1cf7c1991d tempest-VolumesGetTest-1408686534 None] Acquiring lock "cinder-quobyte-d9c22061-a3bd-4b1b-b22b-52afaa964b66" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:02:56 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-8de93008-26fa-4738-aa21-0d1cf7c1991d tempest-VolumesGetTest-1408686534 None] Lock "cinder-quobyte-d9c22061-a3bd-4b1b-b22b-52afaa964b66" acquired by "delete_volume" :: waited 0.018s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:02:56 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c092f48d-4a86-48a4-abe8-6d1a908f64af]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:02:56 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-8de93008-26fa-4738-aa21-0d1cf7c1991d tempest-VolumesGetTest-1408686534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-d9c22061-a3bd-4b1b-b22b-52afaa964b66 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:02:56 devstack sudo[105793]: pam_unix(sudo:session): session closed for user root
Jun 15 16:02:56 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-d72efb95-c86c-4d77-9371-a1e04b4b8cb9 tempest-VolumesActionsTest-1879812582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-15763aef-e495-466a-b919-a0bb6171f0cf" returned: 0 in 0.771s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:02:56 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-d72efb95-c86c-4d77-9371-a1e04b4b8cb9 tempest-VolumesActionsTest-1879812582 None] Lock "cinder-quobyte-15763aef-e495-466a-b919-a0bb6171f0cf" released by "delete_volume" :: held 1.667s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:02:56 devstack sudo[105798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-d9c22061-a3bd-4b1b-b22b-52afaa964b66
Jun 15 16:02:56 devstack sudo[105798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:02:56 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-d72efb95-c86c-4d77-9371-a1e04b4b8cb9 tempest-VolumesActionsTest-1879812582 None] Created reservations ['594a4b20-2402-45ae-9306-f21c184a0e9d', 'f876e309-3db6-4223-b657-63469a153ba1', '5d2513e6-ba77-4a4e-b975-9ab15ce3f418', '3f96b819-4477-4d4b-8d99-a72deab6c987'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 16:02:56 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-d72efb95-c86c-4d77-9371-a1e04b4b8cb9 tempest-VolumesActionsTest-1879812582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:02:56 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-d72efb95-c86c-4d77-9371-a1e04b4b8cb9 tempest-VolumesActionsTest-1879812582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:02:56 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-d72efb95-c86c-4d77-9371-a1e04b4b8cb9 tempest-VolumesActionsTest-1879812582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:02:56 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-d72efb95-c86c-4d77-9371-a1e04b4b8cb9 tempest-VolumesActionsTest-1879812582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:02:56 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-d72efb95-c86c-4d77-9371-a1e04b4b8cb9 tempest-VolumesActionsTest-1879812582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:02:56 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-d72efb95-c86c-4d77-9371-a1e04b4b8cb9 tempest-VolumesActionsTest-1879812582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:02:56 devstack sudo[105801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 16:02:56 devstack sudo[105801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:02:57 devstack sudo[105798]: pam_unix(sudo:session): session closed for user root
Jun 15 16:02:57 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-8de93008-26fa-4738-aa21-0d1cf7c1991d tempest-VolumesGetTest-1408686534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-d9c22061-a3bd-4b1b-b22b-52afaa964b66" returned: 0 in 0.860s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:02:57 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-8de93008-26fa-4738-aa21-0d1cf7c1991d tempest-VolumesGetTest-1408686534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-d9c22061-a3bd-4b1b-b22b-52afaa964b66 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:02:57 devstack sudo[105810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-d9c22061-a3bd-4b1b-b22b-52afaa964b66
Jun 15 16:02:57 devstack sudo[105810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:02:57 devstack sudo[105795]: pam_unix(sudo:session): session closed for user root
Jun 15 16:02:57 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-10543260-0a67-44a2-b063-60a8e964f91c tempest-CinderUnicodeTest-2077516412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-bb0c75ea-d314-482d-8694-79d333459ebc 1073741824" returned: 0 in 1.054s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:02:57 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-10543260-0a67-44a2-b063-60a8e964f91c tempest-CinderUnicodeTest-2077516412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-bb0c75ea-d314-482d-8694-79d333459ebc {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:02:57 devstack sudo[105812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-bb0c75ea-d314-482d-8694-79d333459ebc
Jun 15 16:02:57 devstack sudo[105812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:02:57 devstack sudo[105801]: pam_unix(sudo:session): session closed for user root
Jun 15 16:02:57 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-d72efb95-c86c-4d77-9371-a1e04b4b8cb9 tempest-VolumesActionsTest-1879812582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.864s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:02:57 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-d72efb95-c86c-4d77-9371-a1e04b4b8cb9 tempest-VolumesActionsTest-1879812582 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 16:02:57 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-d72efb95-c86c-4d77-9371-a1e04b4b8cb9 tempest-VolumesActionsTest-1879812582 None] Deleted volume successfully.
Jun 15 16:02:57 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-d72efb95-c86c-4d77-9371-a1e04b4b8cb9 tempest-VolumesActionsTest-1879812582 None] Lock "cinder-15763aef-e495-466a-b919-a0bb6171f0cf-delete_volume" released by "delete_volume" :: held 2.811s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:02:58 devstack sudo[105810]: pam_unix(sudo:session): session closed for user root
Jun 15 16:02:58 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-8de93008-26fa-4738-aa21-0d1cf7c1991d tempest-VolumesGetTest-1408686534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-d9c22061-a3bd-4b1b-b22b-52afaa964b66" returned: 0 in 0.757s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:02:58 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-8de93008-26fa-4738-aa21-0d1cf7c1991d tempest-VolumesGetTest-1408686534 None] Lock "cinder-quobyte-d9c22061-a3bd-4b1b-b22b-52afaa964b66" released by "delete_volume" :: held 1.677s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:02:58 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-8de93008-26fa-4738-aa21-0d1cf7c1991d tempest-VolumesGetTest-1408686534 None] Created reservations ['87f6add4-3658-4c0b-a0bf-e353b7168848', '373e909a-9206-4221-b1e5-30982d8b01b0', '69395549-7c8c-4ea7-bfad-1fb73af021af', 'b36d7309-df4f-42ee-87e7-ecff6eab5c30'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 16:02:58 devstack sudo[105812]: pam_unix(sudo:session): session closed for user root
Jun 15 16:02:58 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-10543260-0a67-44a2-b063-60a8e964f91c tempest-CinderUnicodeTest-2077516412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-bb0c75ea-d314-482d-8694-79d333459ebc" returned: 0 in 0.735s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:02:58 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-10543260-0a67-44a2-b063-60a8e964f91c tempest-CinderUnicodeTest-2077516412 None] <== create_volume: return (1859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 16:02:58 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-10543260-0a67-44a2-b063-60a8e964f91c tempest-CinderUnicodeTest-2077516412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.863s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:02:58 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-10543260-0a67-44a2-b063-60a8e964f91c tempest-CinderUnicodeTest-2077516412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ed774fc-a28d-40a8-90f3-bb4b882659a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb0c75ea-d314-482d-8694-79d333459ebc', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:02:58 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-10543260-0a67-44a2-b063-60a8e964f91c tempest-CinderUnicodeTest-2077516412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b9be748-02e7-4fc5-94fb-70bc6ce7aa12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:02:58 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-10543260-0a67-44a2-b063-60a8e964f91c tempest-CinderUnicodeTest-2077516412 None] Volume volume-bb0c75ea-d314-482d-8694-79d333459ebc (bb0c75ea-d314-482d-8694-79d333459ebc): created successfully
Jun 15 16:02:58 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-10543260-0a67-44a2-b063-60a8e964f91c tempest-CinderUnicodeTest-2077516412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b9be748-02e7-4fc5-94fb-70bc6ce7aa12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:02:58 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-10543260-0a67-44a2-b063-60a8e964f91c tempest-CinderUnicodeTest-2077516412 None] Flow 'volume_create_manager' (fb23b0e5-c9a8-48fc-b759-ccf367dc7064) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:02:58 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-10543260-0a67-44a2-b063-60a8e964f91c tempest-CinderUnicodeTest-2077516412 None] Created volume successfully.
Jun 15 16:02:58 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-8de93008-26fa-4738-aa21-0d1cf7c1991d tempest-VolumesGetTest-1408686534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:02:58 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-8de93008-26fa-4738-aa21-0d1cf7c1991d tempest-VolumesGetTest-1408686534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:02:58 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-8de93008-26fa-4738-aa21-0d1cf7c1991d tempest-VolumesGetTest-1408686534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:02:58 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-8de93008-26fa-4738-aa21-0d1cf7c1991d tempest-VolumesGetTest-1408686534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:02:58 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-8de93008-26fa-4738-aa21-0d1cf7c1991d tempest-VolumesGetTest-1408686534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:02:58 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-8de93008-26fa-4738-aa21-0d1cf7c1991d tempest-VolumesGetTest-1408686534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:02:58 devstack sudo[105816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 16:02:58 devstack sudo[105816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:02:58 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-12150702-0006-4d20-a398-87a74aa6db11 tempest-VolumesGetTest-1408686534 None] Acquiring lock "cinder-5b6792ae-7ea5-47b1-bddb-0b0b89ff3d40-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:02:58 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-12150702-0006-4d20-a398-87a74aa6db11 tempest-VolumesGetTest-1408686534 None] Lock "cinder-5b6792ae-7ea5-47b1-bddb-0b0b89ff3d40-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:02:58 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-12150702-0006-4d20-a398-87a74aa6db11 tempest-VolumesGetTest-1408686534 None] Acquiring lock "cinder-quobyte-5b6792ae-7ea5-47b1-bddb-0b0b89ff3d40" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:02:58 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-12150702-0006-4d20-a398-87a74aa6db11 tempest-VolumesGetTest-1408686534 None] Lock "cinder-quobyte-5b6792ae-7ea5-47b1-bddb-0b0b89ff3d40" acquired by "delete_volume" :: waited 0.032s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:02:59 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[30dfaa90-d758-45c1-86fa-19d44afa3270]: (4, 'raw') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:02:59 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-12150702-0006-4d20-a398-87a74aa6db11 tempest-VolumesGetTest-1408686534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5b6792ae-7ea5-47b1-bddb-0b0b89ff3d40 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:02:59 devstack sudo[105819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5b6792ae-7ea5-47b1-bddb-0b0b89ff3d40
Jun 15 16:02:59 devstack sudo[105819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:02:59 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f002d2c-afbb-4555-baf2-4dbd90fd0252 tempest-CinderUnicodeTest-2077516412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 16:02:59 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-2f002d2c-afbb-4555-baf2-4dbd90fd0252 tempest-CinderUnicodeTest-2077516412 None] Flow 'volume_create_manager' (0590d3df-7312-4a4d-8ddd-fb5e05ad8e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:02:59 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-2f002d2c-afbb-4555-baf2-4dbd90fd0252 tempest-CinderUnicodeTest-2077516412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba0f8a5b-cb01-403c-8ce4-bb813f0934ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:02:59 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-2f002d2c-afbb-4555-baf2-4dbd90fd0252 tempest-CinderUnicodeTest-2077516412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba0f8a5b-cb01-403c-8ce4-bb813f0934ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:02:59Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1782349811',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbe9ba95-0b56-45dd-966c-2a4b33f0b4a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4320ab3c21a4634ae2037a4c1ac405a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:02:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:02:59Z,use_quota=True,user_id='2100b2f25e8d48c1a2a2309bcdeaee1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:02:59 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-2f002d2c-afbb-4555-baf2-4dbd90fd0252 tempest-CinderUnicodeTest-2077516412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66477e2d-0a9d-4204-a3ca-163dd5fb5dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:02:59 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-2f002d2c-afbb-4555-baf2-4dbd90fd0252 tempest-CinderUnicodeTest-2077516412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66477e2d-0a9d-4204-a3ca-163dd5fb5dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:02:59 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-2f002d2c-afbb-4555-baf2-4dbd90fd0252 tempest-CinderUnicodeTest-2077516412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7db9f75-f214-427f-a188-e279051f0fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:02:59 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-2f002d2c-afbb-4555-baf2-4dbd90fd0252 tempest-CinderUnicodeTest-2077516412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7db9f75-f214-427f-a188-e279051f0fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbe9ba95-0b56-45dd-966c-2a4b33f0b4a9', 'volume_name': 'volume-cbe9ba95-0b56-45dd-966c-2a4b33f0b4a9', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:02:59 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-2f002d2c-afbb-4555-baf2-4dbd90fd0252 tempest-CinderUnicodeTest-2077516412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (492a92c8-068b-4a53-b7aa-26603d748b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:02:59 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-2f002d2c-afbb-4555-baf2-4dbd90fd0252 tempest-CinderUnicodeTest-2077516412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (492a92c8-068b-4a53-b7aa-26603d748b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:02:59 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-2f002d2c-afbb-4555-baf2-4dbd90fd0252 tempest-CinderUnicodeTest-2077516412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d413a25-bf6a-4dd0-9a65-7907ccdb0b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:02:59 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-2f002d2c-afbb-4555-baf2-4dbd90fd0252 tempest-CinderUnicodeTest-2077516412 None] Volume cbe9ba95-0b56-45dd-966c-2a4b33f0b4a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbe9ba95-0b56-45dd-966c-2a4b33f0b4a9', 'volume_size': 1}
Jun 15 16:02:59 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-2f002d2c-afbb-4555-baf2-4dbd90fd0252 tempest-CinderUnicodeTest-2077516412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:02:59 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-2f002d2c-afbb-4555-baf2-4dbd90fd0252 tempest-CinderUnicodeTest-2077516412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:02:59 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-2f002d2c-afbb-4555-baf2-4dbd90fd0252 tempest-CinderUnicodeTest-2077516412 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:02:59Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1782349811',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbe9ba95-0b56-45dd-966c-2a4b33f0b4a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4320ab3c21a4634ae2037a4c1ac405a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:02:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:02:59Z,use_quota=True,user_id='2100b2f25e8d48c1a2a2309bcdeaee1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 16:02:59 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-2f002d2c-afbb-4555-baf2-4dbd90fd0252 tempest-CinderUnicodeTest-2077516412 None] Creating volume cbe9ba95-0b56-45dd-966c-2a4b33f0b4a9 {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 16:02:59 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-2f002d2c-afbb-4555-baf2-4dbd90fd0252 tempest-CinderUnicodeTest-2077516412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:02:59 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-2f002d2c-afbb-4555-baf2-4dbd90fd0252 tempest-CinderUnicodeTest-2077516412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:02:59 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-2f002d2c-afbb-4555-baf2-4dbd90fd0252 tempest-CinderUnicodeTest-2077516412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:02:59 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-2f002d2c-afbb-4555-baf2-4dbd90fd0252 tempest-CinderUnicodeTest-2077516412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:02:59 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-2f002d2c-afbb-4555-baf2-4dbd90fd0252 tempest-CinderUnicodeTest-2077516412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:02:59 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-2f002d2c-afbb-4555-baf2-4dbd90fd0252 tempest-CinderUnicodeTest-2077516412 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 16:02:59 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-2f002d2c-afbb-4555-baf2-4dbd90fd0252 tempest-CinderUnicodeTest-2077516412 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 16:02:59 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-2f002d2c-afbb-4555-baf2-4dbd90fd0252 tempest-CinderUnicodeTest-2077516412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-cbe9ba95-0b56-45dd-966c-2a4b33f0b4a9 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:02:59 devstack sudo[105822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-cbe9ba95-0b56-45dd-966c-2a4b33f0b4a9 1073741824
Jun 15 16:02:59 devstack sudo[105822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:02:59 devstack sudo[105816]: pam_unix(sudo:session): session closed for user root
Jun 15 16:02:59 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-8de93008-26fa-4738-aa21-0d1cf7c1991d tempest-VolumesGetTest-1408686534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.975s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:02:59 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-8de93008-26fa-4738-aa21-0d1cf7c1991d tempest-VolumesGetTest-1408686534 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 16:02:59 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-8de93008-26fa-4738-aa21-0d1cf7c1991d tempest-VolumesGetTest-1408686534 None] Deleted volume successfully.
Jun 15 16:02:59 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-8de93008-26fa-4738-aa21-0d1cf7c1991d tempest-VolumesGetTest-1408686534 None] Lock "cinder-d9c22061-a3bd-4b1b-b22b-52afaa964b66-delete_volume" released by "delete_volume" :: held 2.958s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:02:59 devstack sudo[105819]: pam_unix(sudo:session): session closed for user root
Jun 15 16:02:59 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-12150702-0006-4d20-a398-87a74aa6db11 tempest-VolumesGetTest-1408686534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5b6792ae-7ea5-47b1-bddb-0b0b89ff3d40" returned: 0 in 0.792s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:02:59 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-12150702-0006-4d20-a398-87a74aa6db11 tempest-VolumesGetTest-1408686534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5b6792ae-7ea5-47b1-bddb-0b0b89ff3d40 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:02:59 devstack sudo[105826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5b6792ae-7ea5-47b1-bddb-0b0b89ff3d40
Jun 15 16:02:59 devstack sudo[105826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:03:00 devstack sudo[105822]: pam_unix(sudo:session): session closed for user root
Jun 15 16:03:00 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-2f002d2c-afbb-4555-baf2-4dbd90fd0252 tempest-CinderUnicodeTest-2077516412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-cbe9ba95-0b56-45dd-966c-2a4b33f0b4a9 1073741824" returned: 0 in 0.976s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:03:00 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-2f002d2c-afbb-4555-baf2-4dbd90fd0252 tempest-CinderUnicodeTest-2077516412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-cbe9ba95-0b56-45dd-966c-2a4b33f0b4a9 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:03:00 devstack sudo[105832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-cbe9ba95-0b56-45dd-966c-2a4b33f0b4a9
Jun 15 16:03:00 devstack sudo[105832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:03:00 devstack sudo[105826]: pam_unix(sudo:session): session closed for user root
Jun 15 16:03:00 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-12150702-0006-4d20-a398-87a74aa6db11 tempest-VolumesGetTest-1408686534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5b6792ae-7ea5-47b1-bddb-0b0b89ff3d40" returned: 1 in 0.853s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:03:00 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-12150702-0006-4d20-a398-87a74aa6db11 tempest-VolumesGetTest-1408686534 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5b6792ae-7ea5-47b1-bddb-0b0b89ff3d40' failed. Not Retrying. {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 15 16:03:00 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-12150702-0006-4d20-a398-87a74aa6db11 tempest-VolumesGetTest-1408686534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5b6792ae-7ea5-47b1-bddb-0b0b89ff3d40 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:03:00 devstack sudo[105837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5b6792ae-7ea5-47b1-bddb-0b0b89ff3d40
Jun 15 16:03:00 devstack sudo[105837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:03:01 devstack sudo[105832]: pam_unix(sudo:session): session closed for user root
Jun 15 16:03:01 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-2f002d2c-afbb-4555-baf2-4dbd90fd0252 tempest-CinderUnicodeTest-2077516412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-cbe9ba95-0b56-45dd-966c-2a4b33f0b4a9" returned: 0 in 0.721s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:03:01 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-2f002d2c-afbb-4555-baf2-4dbd90fd0252 tempest-CinderUnicodeTest-2077516412 None] <== create_volume: return (1753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 16:03:01 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-2f002d2c-afbb-4555-baf2-4dbd90fd0252 tempest-CinderUnicodeTest-2077516412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.759s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:03:01 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-2f002d2c-afbb-4555-baf2-4dbd90fd0252 tempest-CinderUnicodeTest-2077516412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d413a25-bf6a-4dd0-9a65-7907ccdb0b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbe9ba95-0b56-45dd-966c-2a4b33f0b4a9', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:03:01 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-2f002d2c-afbb-4555-baf2-4dbd90fd0252 tempest-CinderUnicodeTest-2077516412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9938b8fb-44bf-4c83-829a-72572da67733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:03:01 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-2f002d2c-afbb-4555-baf2-4dbd90fd0252 tempest-CinderUnicodeTest-2077516412 None] Volume volume-cbe9ba95-0b56-45dd-966c-2a4b33f0b4a9 (cbe9ba95-0b56-45dd-966c-2a4b33f0b4a9): created successfully
Jun 15 16:03:01 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-2f002d2c-afbb-4555-baf2-4dbd90fd0252 tempest-CinderUnicodeTest-2077516412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9938b8fb-44bf-4c83-829a-72572da67733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:03:01 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-2f002d2c-afbb-4555-baf2-4dbd90fd0252 tempest-CinderUnicodeTest-2077516412 None] Flow 'volume_create_manager' (0590d3df-7312-4a4d-8ddd-fb5e05ad8e4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:03:01 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-2f002d2c-afbb-4555-baf2-4dbd90fd0252 tempest-CinderUnicodeTest-2077516412 None] Created volume successfully.
Jun 15 16:03:01 devstack sudo[105837]: pam_unix(sudo:session): session closed for user root
Jun 15 16:03:01 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-12150702-0006-4d20-a398-87a74aa6db11 tempest-VolumesGetTest-1408686534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5b6792ae-7ea5-47b1-bddb-0b0b89ff3d40" returned: 0 in 0.761s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:03:01 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-12150702-0006-4d20-a398-87a74aa6db11 tempest-VolumesGetTest-1408686534 None] Lock "cinder-quobyte-5b6792ae-7ea5-47b1-bddb-0b0b89ff3d40" released by "delete_volume" :: held 2.495s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:03:01 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-12150702-0006-4d20-a398-87a74aa6db11 tempest-VolumesGetTest-1408686534 None] Created reservations ['f037d9bc-9c77-4fdc-a2c6-77b73d77cc72', '911dd766-93ff-4d35-a7c6-ea2ff14fe024', 'f287d5e7-092e-4962-8ee8-70fd10cde0ca', '4265acf2-248e-4d27-b1b9-e89d60b3e299'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 16:03:01 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-0f009aa7-f979-4551-8e65-68760b5100f7 tempest-CinderUnicodeTest-2077516412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:03:01 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-0f009aa7-f979-4551-8e65-68760b5100f7 tempest-CinderUnicodeTest-2077516412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:03:01 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-0f009aa7-f979-4551-8e65-68760b5100f7 tempest-CinderUnicodeTest-2077516412 None] Creating offline snapshot 010ed45f-8236-4b6b-8c06-573765d22c63 of volume cbe9ba95-0b56-45dd-966c-2a4b33f0b4a9 {{(pid=91863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 15 16:03:01 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d7ddb4-2cfa-4ae5-9d39-6d3cfd67da81]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:03:01 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-0f009aa7-f979-4551-8e65-68760b5100f7 tempest-CinderUnicodeTest-2077516412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-cbe9ba95-0b56-45dd-966c-2a4b33f0b4a9 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:03:01 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-12150702-0006-4d20-a398-87a74aa6db11 tempest-VolumesGetTest-1408686534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:03:01 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-12150702-0006-4d20-a398-87a74aa6db11 tempest-VolumesGetTest-1408686534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:03:01 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-12150702-0006-4d20-a398-87a74aa6db11 tempest-VolumesGetTest-1408686534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:03:01 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-12150702-0006-4d20-a398-87a74aa6db11 tempest-VolumesGetTest-1408686534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:03:01 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-12150702-0006-4d20-a398-87a74aa6db11 tempest-VolumesGetTest-1408686534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:03:01 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-12150702-0006-4d20-a398-87a74aa6db11 tempest-VolumesGetTest-1408686534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:03:01 devstack sudo[105843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 16:03:01 devstack sudo[105843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:03:01 devstack sudo[105842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-cbe9ba95-0b56-45dd-966c-2a4b33f0b4a9
Jun 15 16:03:01 devstack sudo[105842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:03:02 devstack sudo[105843]: pam_unix(sudo:session): session closed for user root
Jun 15 16:03:02 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-12150702-0006-4d20-a398-87a74aa6db11 tempest-VolumesGetTest-1408686534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.791s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:03:02 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-12150702-0006-4d20-a398-87a74aa6db11 tempest-VolumesGetTest-1408686534 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 16:03:02 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-12150702-0006-4d20-a398-87a74aa6db11 tempest-VolumesGetTest-1408686534 None] Deleted volume successfully.
Jun 15 16:03:02 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-12150702-0006-4d20-a398-87a74aa6db11 tempest-VolumesGetTest-1408686534 None] Lock "cinder-5b6792ae-7ea5-47b1-bddb-0b0b89ff3d40-delete_volume" released by "delete_volume" :: held 3.665s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:03:02 devstack sudo[105842]: pam_unix(sudo:session): session closed for user root
Jun 15 16:03:02 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-0f009aa7-f979-4551-8e65-68760b5100f7 tempest-CinderUnicodeTest-2077516412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-cbe9ba95-0b56-45dd-966c-2a4b33f0b4a9" returned: 0 in 0.918s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:03:02 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-0f009aa7-f979-4551-8e65-68760b5100f7 tempest-CinderUnicodeTest-2077516412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-cbe9ba95-0b56-45dd-966c-2a4b33f0b4a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-cbe9ba95-0b56-45dd-966c-2a4b33f0b4a9.010ed45f-8236-4b6b-8c06-573765d22c63 1G {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:03:02 devstack sudo[105850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-cbe9ba95-0b56-45dd-966c-2a4b33f0b4a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-cbe9ba95-0b56-45dd-966c-2a4b33f0b4a9.010ed45f-8236-4b6b-8c06-573765d22c63 1G
Jun 15 16:03:02 devstack sudo[105850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:03:03 devstack sudo[105850]: pam_unix(sudo:session): session closed for user root
Jun 15 16:03:03 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-0f009aa7-f979-4551-8e65-68760b5100f7 tempest-CinderUnicodeTest-2077516412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-cbe9ba95-0b56-45dd-966c-2a4b33f0b4a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-cbe9ba95-0b56-45dd-966c-2a4b33f0b4a9.010ed45f-8236-4b6b-8c06-573765d22c63 1G" returned: 0 in 0.875s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:03:03 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-0f009aa7-f979-4551-8e65-68760b5100f7 tempest-CinderUnicodeTest-2077516412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cbe9ba95-0b56-45dd-966c-2a4b33f0b4a9 -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-cbe9ba95-0b56-45dd-966c-2a4b33f0b4a9.010ed45f-8236-4b6b-8c06-573765d22c63 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:03:03 devstack sudo[105856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cbe9ba95-0b56-45dd-966c-2a4b33f0b4a9 -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-cbe9ba95-0b56-45dd-966c-2a4b33f0b4a9.010ed45f-8236-4b6b-8c06-573765d22c63
Jun 15 16:03:03 devstack sudo[105856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:03:04 devstack sudo[105856]: pam_unix(sudo:session): session closed for user root
Jun 15 16:03:04 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-0f009aa7-f979-4551-8e65-68760b5100f7 tempest-CinderUnicodeTest-2077516412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cbe9ba95-0b56-45dd-966c-2a4b33f0b4a9 -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-cbe9ba95-0b56-45dd-966c-2a4b33f0b4a9.010ed45f-8236-4b6b-8c06-573765d22c63" returned: 0 in 0.838s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:03:04 devstack cinder-volume[91863]: WARNING cinder.volume.drivers.remotefs [None req-0f009aa7-f979-4551-8e65-68760b5100f7 tempest-CinderUnicodeTest-2077516412 None] /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-cbe9ba95-0b56-45dd-966c-2a4b33f0b4a9.010ed45f-8236-4b6b-8c06-573765d22c63 is being set with open permissions: ugo+rw
Jun 15 16:03:04 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-0f009aa7-f979-4551-8e65-68760b5100f7 tempest-CinderUnicodeTest-2077516412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-cbe9ba95-0b56-45dd-966c-2a4b33f0b4a9.010ed45f-8236-4b6b-8c06-573765d22c63 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:03:04 devstack sudo[105861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-cbe9ba95-0b56-45dd-966c-2a4b33f0b4a9.010ed45f-8236-4b6b-8c06-573765d22c63
Jun 15 16:03:04 devstack sudo[105861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:03:04 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-260ef5cf-2c4c-4ede-bbe2-2ea8d8da1104 tempest-VolumesListTestJSON-1218479558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 16:03:04 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-260ef5cf-2c4c-4ede-bbe2-2ea8d8da1104 tempest-VolumesListTestJSON-1218479558 None] Flow 'volume_create_manager' (7a89d522-ff2f-4a33-b44e-3445c531b3ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:03:04 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-260ef5cf-2c4c-4ede-bbe2-2ea8d8da1104 tempest-VolumesListTestJSON-1218479558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (191571f7-6bd5-41aa-a783-7effee8523be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:03:04 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-260ef5cf-2c4c-4ede-bbe2-2ea8d8da1104 tempest-VolumesListTestJSON-1218479558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (191571f7-6bd5-41aa-a783-7effee8523be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:03:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-16892812',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1b2ca17-284f-41e1-8da9-779dfd74d40d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2db5d87fd2c743d4ad42f4e8c21f575d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:03:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:03:04Z,use_quota=True,user_id='f6db25c050cb4f7ebba233bf0f56e3d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:03:04 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-260ef5cf-2c4c-4ede-bbe2-2ea8d8da1104 tempest-VolumesListTestJSON-1218479558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6367ac30-fae2-46a6-9427-ac9d8258691a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:03:04 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-260ef5cf-2c4c-4ede-bbe2-2ea8d8da1104 tempest-VolumesListTestJSON-1218479558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6367ac30-fae2-46a6-9427-ac9d8258691a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:03:04 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-260ef5cf-2c4c-4ede-bbe2-2ea8d8da1104 tempest-VolumesListTestJSON-1218479558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45c83d53-f5f0-4647-b11f-f3fb43052f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:03:04 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-260ef5cf-2c4c-4ede-bbe2-2ea8d8da1104 tempest-VolumesListTestJSON-1218479558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45c83d53-f5f0-4647-b11f-f3fb43052f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1b2ca17-284f-41e1-8da9-779dfd74d40d', 'volume_name': 'volume-c1b2ca17-284f-41e1-8da9-779dfd74d40d', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:03:04 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-260ef5cf-2c4c-4ede-bbe2-2ea8d8da1104 tempest-VolumesListTestJSON-1218479558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81183e3f-2ca7-4003-9c07-abc718f20259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:03:04 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-260ef5cf-2c4c-4ede-bbe2-2ea8d8da1104 tempest-VolumesListTestJSON-1218479558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81183e3f-2ca7-4003-9c07-abc718f20259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:03:04 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-260ef5cf-2c4c-4ede-bbe2-2ea8d8da1104 tempest-VolumesListTestJSON-1218479558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (782403e5-d1e3-4f79-b737-a0d6ab21b9cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:03:04 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-260ef5cf-2c4c-4ede-bbe2-2ea8d8da1104 tempest-VolumesListTestJSON-1218479558 None] Volume c1b2ca17-284f-41e1-8da9-779dfd74d40d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1b2ca17-284f-41e1-8da9-779dfd74d40d', 'volume_size': 1}
Jun 15 16:03:04 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-260ef5cf-2c4c-4ede-bbe2-2ea8d8da1104 tempest-VolumesListTestJSON-1218479558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:03:05 devstack sudo[105861]: pam_unix(sudo:session): session closed for user root
Jun 15 16:03:05 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-0f009aa7-f979-4551-8e65-68760b5100f7 tempest-CinderUnicodeTest-2077516412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-cbe9ba95-0b56-45dd-966c-2a4b33f0b4a9.010ed45f-8236-4b6b-8c06-573765d22c63" returned: 0 in 0.732s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:03:05 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-0f009aa7-f979-4551-8e65-68760b5100f7 tempest-CinderUnicodeTest-2077516412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-cbe9ba95-0b56-45dd-966c-2a4b33f0b4a9.info {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:03:05 devstack sudo[105865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-cbe9ba95-0b56-45dd-966c-2a4b33f0b4a9.info
Jun 15 16:03:05 devstack sudo[105865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:03:05 devstack sudo[105865]: pam_unix(sudo:session): session closed for user root
Jun 15 16:03:05 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-0f009aa7-f979-4551-8e65-68760b5100f7 tempest-CinderUnicodeTest-2077516412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-cbe9ba95-0b56-45dd-966c-2a4b33f0b4a9.info" returned: 0 in 0.715s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:03:05 devstack cinder-volume[91863]: WARNING cinder.volume.drivers.remotefs [None req-0f009aa7-f979-4551-8e65-68760b5100f7 tempest-CinderUnicodeTest-2077516412 None] /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-cbe9ba95-0b56-45dd-966c-2a4b33f0b4a9.info is being set with open permissions: ugo+rw
Jun 15 16:03:05 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-0f009aa7-f979-4551-8e65-68760b5100f7 tempest-CinderUnicodeTest-2077516412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-cbe9ba95-0b56-45dd-966c-2a4b33f0b4a9.info {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:03:05 devstack sudo[105868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-cbe9ba95-0b56-45dd-966c-2a4b33f0b4a9.info
Jun 15 16:03:05 devstack sudo[105868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:03:06 devstack sudo[105868]: pam_unix(sudo:session): session closed for user root
Jun 15 16:03:06 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-0f009aa7-f979-4551-8e65-68760b5100f7 tempest-CinderUnicodeTest-2077516412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-cbe9ba95-0b56-45dd-966c-2a4b33f0b4a9.info" returned: 0 in 0.693s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:03:06 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-0f009aa7-f979-4551-8e65-68760b5100f7 tempest-CinderUnicodeTest-2077516412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.894s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:03:06 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-260ef5cf-2c4c-4ede-bbe2-2ea8d8da1104 tempest-VolumesListTestJSON-1218479558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.929s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:03:06 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-260ef5cf-2c4c-4ede-bbe2-2ea8d8da1104 tempest-VolumesListTestJSON-1218479558 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:03:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-16892812',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1b2ca17-284f-41e1-8da9-779dfd74d40d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2db5d87fd2c743d4ad42f4e8c21f575d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:03:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:03:04Z,use_quota=True,user_id='f6db25c050cb4f7ebba233bf0f56e3d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 16:03:06 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-260ef5cf-2c4c-4ede-bbe2-2ea8d8da1104 tempest-VolumesListTestJSON-1218479558 None] Creating volume c1b2ca17-284f-41e1-8da9-779dfd74d40d {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 16:03:06 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-260ef5cf-2c4c-4ede-bbe2-2ea8d8da1104 tempest-VolumesListTestJSON-1218479558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:03:06 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-260ef5cf-2c4c-4ede-bbe2-2ea8d8da1104 tempest-VolumesListTestJSON-1218479558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:03:06 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-260ef5cf-2c4c-4ede-bbe2-2ea8d8da1104 tempest-VolumesListTestJSON-1218479558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:03:06 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-260ef5cf-2c4c-4ede-bbe2-2ea8d8da1104 tempest-VolumesListTestJSON-1218479558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:03:06 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-260ef5cf-2c4c-4ede-bbe2-2ea8d8da1104 tempest-VolumesListTestJSON-1218479558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:03:06 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-260ef5cf-2c4c-4ede-bbe2-2ea8d8da1104 tempest-VolumesListTestJSON-1218479558 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 16:03:06 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-260ef5cf-2c4c-4ede-bbe2-2ea8d8da1104 tempest-VolumesListTestJSON-1218479558 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 16:03:06 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-260ef5cf-2c4c-4ede-bbe2-2ea8d8da1104 tempest-VolumesListTestJSON-1218479558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-c1b2ca17-284f-41e1-8da9-779dfd74d40d 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:03:06 devstack sudo[105871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-c1b2ca17-284f-41e1-8da9-779dfd74d40d 1073741824
Jun 15 16:03:06 devstack sudo[105871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:03:06 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-0f009aa7-f979-4551-8e65-68760b5100f7 tempest-CinderUnicodeTest-2077516412 None] Create snapshot completed successfully
Jun 15 16:03:06 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-598f051e-99fc-4ec7-b7f1-7c5654866626 tempest-CinderUnicodeTest-2077516412 None] Acquiring lock "cinder-010ed45f-8236-4b6b-8c06-573765d22c63-delete_snapshot" by "delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:03:06 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-598f051e-99fc-4ec7-b7f1-7c5654866626 tempest-CinderUnicodeTest-2077516412 None] Lock "cinder-010ed45f-8236-4b6b-8c06-573765d22c63-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:03:06 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-598f051e-99fc-4ec7-b7f1-7c5654866626 tempest-CinderUnicodeTest-2077516412 None] Acquiring lock "cinder-quobyte-cbe9ba95-0b56-45dd-966c-2a4b33f0b4a9" by "delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:03:06 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-598f051e-99fc-4ec7-b7f1-7c5654866626 tempest-CinderUnicodeTest-2077516412 None] Lock "cinder-quobyte-cbe9ba95-0b56-45dd-966c-2a4b33f0b4a9" acquired by "delete_snapshot" :: waited 0.045s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:03:06 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-598f051e-99fc-4ec7-b7f1-7c5654866626 tempest-CinderUnicodeTest-2077516412 None] Acquiring lock "cinder-quobyte-010ed45f-8236-4b6b-8c06-573765d22c63" by "_delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:03:07 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-598f051e-99fc-4ec7-b7f1-7c5654866626 tempest-CinderUnicodeTest-2077516412 None] Lock "cinder-quobyte-010ed45f-8236-4b6b-8c06-573765d22c63" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:03:07 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-598f051e-99fc-4ec7-b7f1-7c5654866626 tempest-CinderUnicodeTest-2077516412 None] Deleting offline snapshot 010ed45f-8236-4b6b-8c06-573765d22c63 of volume cbe9ba95-0b56-45dd-966c-2a4b33f0b4a9 {{(pid=91863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 15 16:03:07 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-598f051e-99fc-4ec7-b7f1-7c5654866626 tempest-CinderUnicodeTest-2077516412 None] snapshot_file for this snap is: volume-cbe9ba95-0b56-45dd-966c-2a4b33f0b4a9.010ed45f-8236-4b6b-8c06-573765d22c63 {{(pid=91863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 15 16:03:07 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa521a0-4fa5-41e9-8fca-95ed0a23b61e]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:03:07 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-598f051e-99fc-4ec7-b7f1-7c5654866626 tempest-CinderUnicodeTest-2077516412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-cbe9ba95-0b56-45dd-966c-2a4b33f0b4a9.010ed45f-8236-4b6b-8c06-573765d22c63 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:03:07 devstack sudo[105873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-cbe9ba95-0b56-45dd-966c-2a4b33f0b4a9.010ed45f-8236-4b6b-8c06-573765d22c63
Jun 15 16:03:07 devstack sudo[105873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:03:07 devstack sudo[105871]: pam_unix(sudo:session): session closed for user root
Jun 15 16:03:07 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-260ef5cf-2c4c-4ede-bbe2-2ea8d8da1104 tempest-VolumesListTestJSON-1218479558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-c1b2ca17-284f-41e1-8da9-779dfd74d40d 1073741824" returned: 0 in 0.915s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:03:07 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-260ef5cf-2c4c-4ede-bbe2-2ea8d8da1104 tempest-VolumesListTestJSON-1218479558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-c1b2ca17-284f-41e1-8da9-779dfd74d40d {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:03:07 devstack sudo[105879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-c1b2ca17-284f-41e1-8da9-779dfd74d40d
Jun 15 16:03:07 devstack sudo[105879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:03:07 devstack sudo[105873]: pam_unix(sudo:session): session closed for user root
Jun 15 16:03:07 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-598f051e-99fc-4ec7-b7f1-7c5654866626 tempest-CinderUnicodeTest-2077516412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-cbe9ba95-0b56-45dd-966c-2a4b33f0b4a9.010ed45f-8236-4b6b-8c06-573765d22c63" returned: 0 in 0.851s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:03:07 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-598f051e-99fc-4ec7-b7f1-7c5654866626 tempest-CinderUnicodeTest-2077516412 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cbe9ba95-0b56-45dd-966c-2a4b33f0b4a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 16:03:07 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e97ca70f-ec45-47dc-a59b-e73604bf4c1f]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:03:07 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-598f051e-99fc-4ec7-b7f1-7c5654866626 tempest-CinderUnicodeTest-2077516412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-cbe9ba95-0b56-45dd-966c-2a4b33f0b4a9 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:03:08 devstack sudo[105886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-cbe9ba95-0b56-45dd-966c-2a4b33f0b4a9
Jun 15 16:03:08 devstack sudo[105886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:03:08 devstack sudo[105879]: pam_unix(sudo:session): session closed for user root
Jun 15 16:03:08 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-260ef5cf-2c4c-4ede-bbe2-2ea8d8da1104 tempest-VolumesListTestJSON-1218479558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-c1b2ca17-284f-41e1-8da9-779dfd74d40d" returned: 0 in 0.664s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:03:08 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-260ef5cf-2c4c-4ede-bbe2-2ea8d8da1104 tempest-VolumesListTestJSON-1218479558 None] <== create_volume: return (1635ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 16:03:08 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-260ef5cf-2c4c-4ede-bbe2-2ea8d8da1104 tempest-VolumesListTestJSON-1218479558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.638s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:03:08 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-260ef5cf-2c4c-4ede-bbe2-2ea8d8da1104 tempest-VolumesListTestJSON-1218479558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (782403e5-d1e3-4f79-b737-a0d6ab21b9cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1b2ca17-284f-41e1-8da9-779dfd74d40d', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:03:08 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-260ef5cf-2c4c-4ede-bbe2-2ea8d8da1104 tempest-VolumesListTestJSON-1218479558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dd6d54b-0eb3-4202-a36b-3fa85bc7333c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:03:08 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-260ef5cf-2c4c-4ede-bbe2-2ea8d8da1104 tempest-VolumesListTestJSON-1218479558 None] Volume volume-c1b2ca17-284f-41e1-8da9-779dfd74d40d (c1b2ca17-284f-41e1-8da9-779dfd74d40d): created successfully
Jun 15 16:03:08 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-260ef5cf-2c4c-4ede-bbe2-2ea8d8da1104 tempest-VolumesListTestJSON-1218479558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dd6d54b-0eb3-4202-a36b-3fa85bc7333c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:03:08 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-260ef5cf-2c4c-4ede-bbe2-2ea8d8da1104 tempest-VolumesListTestJSON-1218479558 None] Flow 'volume_create_manager' (7a89d522-ff2f-4a33-b44e-3445c531b3ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:03:08 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-260ef5cf-2c4c-4ede-bbe2-2ea8d8da1104 tempest-VolumesListTestJSON-1218479558 None] Created volume successfully.
Jun 15 16:03:08 devstack sudo[105886]: pam_unix(sudo:session): session closed for user root
Jun 15 16:03:08 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-598f051e-99fc-4ec7-b7f1-7c5654866626 tempest-CinderUnicodeTest-2077516412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-cbe9ba95-0b56-45dd-966c-2a4b33f0b4a9" returned: 0 in 0.902s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:03:08 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-598f051e-99fc-4ec7-b7f1-7c5654866626 tempest-CinderUnicodeTest-2077516412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-cbe9ba95-0b56-45dd-966c-2a4b33f0b4a9.010ed45f-8236-4b6b-8c06-573765d22c63 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:03:08 devstack sudo[105892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-cbe9ba95-0b56-45dd-966c-2a4b33f0b4a9.010ed45f-8236-4b6b-8c06-573765d22c63
Jun 15 16:03:08 devstack sudo[105892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:03:09 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-102df24f-f676-495a-9c4a-a758abb695c4 tempest-VolumesListTestJSON-1218479558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 16:03:09 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-102df24f-f676-495a-9c4a-a758abb695c4 tempest-VolumesListTestJSON-1218479558 None] Flow 'volume_create_manager' (a23721dd-b16f-4819-8099-6ab22a78d76c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:03:09 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-102df24f-f676-495a-9c4a-a758abb695c4 tempest-VolumesListTestJSON-1218479558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (241a9fe9-0fcf-4420-a783-ef835e57ecc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:03:09 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-102df24f-f676-495a-9c4a-a758abb695c4 tempest-VolumesListTestJSON-1218479558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (241a9fe9-0fcf-4420-a783-ef835e57ecc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:03:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-556717774',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70d01439-7b58-4148-af7d-11c7d1cc420b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2db5d87fd2c743d4ad42f4e8c21f575d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:03:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:03:09Z,use_quota=True,user_id='f6db25c050cb4f7ebba233bf0f56e3d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:03:09 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-102df24f-f676-495a-9c4a-a758abb695c4 tempest-VolumesListTestJSON-1218479558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d577ab3-d688-4c70-9073-444e133807a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:03:09 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-102df24f-f676-495a-9c4a-a758abb695c4 tempest-VolumesListTestJSON-1218479558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d577ab3-d688-4c70-9073-444e133807a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:03:09 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-102df24f-f676-495a-9c4a-a758abb695c4 tempest-VolumesListTestJSON-1218479558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c4fcbf8-8804-48b4-ade4-16521d6b0502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:03:09 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-102df24f-f676-495a-9c4a-a758abb695c4 tempest-VolumesListTestJSON-1218479558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c4fcbf8-8804-48b4-ade4-16521d6b0502) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70d01439-7b58-4148-af7d-11c7d1cc420b', 'volume_name': 'volume-70d01439-7b58-4148-af7d-11c7d1cc420b', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:03:09 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-102df24f-f676-495a-9c4a-a758abb695c4 tempest-VolumesListTestJSON-1218479558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa1eef56-319f-410b-a271-b03d978d7ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:03:09 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-102df24f-f676-495a-9c4a-a758abb695c4 tempest-VolumesListTestJSON-1218479558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa1eef56-319f-410b-a271-b03d978d7ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:03:09 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-102df24f-f676-495a-9c4a-a758abb695c4 tempest-VolumesListTestJSON-1218479558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ee9ed29-b6fc-4a6c-b720-695817d21fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:03:09 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-102df24f-f676-495a-9c4a-a758abb695c4 tempest-VolumesListTestJSON-1218479558 None] Volume 70d01439-7b58-4148-af7d-11c7d1cc420b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70d01439-7b58-4148-af7d-11c7d1cc420b', 'volume_size': 1}
Jun 15 16:03:09 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-102df24f-f676-495a-9c4a-a758abb695c4 tempest-VolumesListTestJSON-1218479558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:03:09 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-102df24f-f676-495a-9c4a-a758abb695c4 tempest-VolumesListTestJSON-1218479558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:03:09 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-102df24f-f676-495a-9c4a-a758abb695c4 tempest-VolumesListTestJSON-1218479558 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:03:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-556717774',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70d01439-7b58-4148-af7d-11c7d1cc420b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2db5d87fd2c743d4ad42f4e8c21f575d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:03:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:03:09Z,use_quota=True,user_id='f6db25c050cb4f7ebba233bf0f56e3d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 16:03:09 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-102df24f-f676-495a-9c4a-a758abb695c4 tempest-VolumesListTestJSON-1218479558 None] Creating volume 70d01439-7b58-4148-af7d-11c7d1cc420b {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 16:03:09 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-102df24f-f676-495a-9c4a-a758abb695c4 tempest-VolumesListTestJSON-1218479558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:03:09 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-102df24f-f676-495a-9c4a-a758abb695c4 tempest-VolumesListTestJSON-1218479558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:03:09 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-102df24f-f676-495a-9c4a-a758abb695c4 tempest-VolumesListTestJSON-1218479558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:03:09 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-102df24f-f676-495a-9c4a-a758abb695c4 tempest-VolumesListTestJSON-1218479558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:03:09 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-102df24f-f676-495a-9c4a-a758abb695c4 tempest-VolumesListTestJSON-1218479558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:03:09 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-102df24f-f676-495a-9c4a-a758abb695c4 tempest-VolumesListTestJSON-1218479558 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 16:03:09 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-102df24f-f676-495a-9c4a-a758abb695c4 tempest-VolumesListTestJSON-1218479558 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 16:03:09 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-102df24f-f676-495a-9c4a-a758abb695c4 tempest-VolumesListTestJSON-1218479558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-70d01439-7b58-4148-af7d-11c7d1cc420b 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:03:09 devstack sudo[105897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-70d01439-7b58-4148-af7d-11c7d1cc420b 1073741824
Jun 15 16:03:09 devstack sudo[105897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:03:09 devstack sudo[105892]: pam_unix(sudo:session): session closed for user root
Jun 15 16:03:09 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-598f051e-99fc-4ec7-b7f1-7c5654866626 tempest-CinderUnicodeTest-2077516412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-cbe9ba95-0b56-45dd-966c-2a4b33f0b4a9.010ed45f-8236-4b6b-8c06-573765d22c63" returned: 0 in 0.951s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:03:09 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-598f051e-99fc-4ec7-b7f1-7c5654866626 tempest-CinderUnicodeTest-2077516412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-cbe9ba95-0b56-45dd-966c-2a4b33f0b4a9.010ed45f-8236-4b6b-8c06-573765d22c63 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:03:09 devstack sudo[105899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-cbe9ba95-0b56-45dd-966c-2a4b33f0b4a9.010ed45f-8236-4b6b-8c06-573765d22c63
Jun 15 16:03:09 devstack sudo[105899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:03:10 devstack sudo[105897]: pam_unix(sudo:session): session closed for user root
Jun 15 16:03:10 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-102df24f-f676-495a-9c4a-a758abb695c4 tempest-VolumesListTestJSON-1218479558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-70d01439-7b58-4148-af7d-11c7d1cc420b 1073741824" returned: 0 in 0.962s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:03:10 devstack sudo[105899]: pam_unix(sudo:session): session closed for user root
Jun 15 16:03:10 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-598f051e-99fc-4ec7-b7f1-7c5654866626 tempest-CinderUnicodeTest-2077516412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-cbe9ba95-0b56-45dd-966c-2a4b33f0b4a9.010ed45f-8236-4b6b-8c06-573765d22c63" returned: 0 in 0.784s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:03:10 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-598f051e-99fc-4ec7-b7f1-7c5654866626 tempest-CinderUnicodeTest-2077516412 None] Lock "cinder-quobyte-010ed45f-8236-4b6b-8c06-573765d22c63" released by "_delete_snapshot" :: held 3.638s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:03:10 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-598f051e-99fc-4ec7-b7f1-7c5654866626 tempest-CinderUnicodeTest-2077516412 None] Lock "cinder-quobyte-cbe9ba95-0b56-45dd-966c-2a4b33f0b4a9" released by "delete_snapshot" :: held 3.678s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:03:10 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-102df24f-f676-495a-9c4a-a758abb695c4 tempest-VolumesListTestJSON-1218479558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-70d01439-7b58-4148-af7d-11c7d1cc420b {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:03:10 devstack sudo[105905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-70d01439-7b58-4148-af7d-11c7d1cc420b
Jun 15 16:03:10 devstack sudo[105905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:03:10 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-598f051e-99fc-4ec7-b7f1-7c5654866626 tempest-CinderUnicodeTest-2077516412 None] Created reservations ['46d4fffd-4fbe-48cd-a014-5dcfd2d95968', '114f561a-2c9e-43dc-8014-221779294e66', '6b5fc72f-32cd-447c-a6ec-76283fd62342', 'c859da26-dda8-4675-8142-4b5168deba06'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 16:03:10 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-598f051e-99fc-4ec7-b7f1-7c5654866626 tempest-CinderUnicodeTest-2077516412 None] Delete snapshot completed successfully.
Jun 15 16:03:10 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-598f051e-99fc-4ec7-b7f1-7c5654866626 tempest-CinderUnicodeTest-2077516412 None] Lock "cinder-010ed45f-8236-4b6b-8c06-573765d22c63-delete_snapshot" released by "delete_snapshot" :: held 3.867s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:03:11 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-341668b7-6233-4ec9-9c2b-e78a0977a3c3 tempest-CinderUnicodeTest-2077516412 None] Acquiring lock "cinder-cbe9ba95-0b56-45dd-966c-2a4b33f0b4a9-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:03:11 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-341668b7-6233-4ec9-9c2b-e78a0977a3c3 tempest-CinderUnicodeTest-2077516412 None] Lock "cinder-cbe9ba95-0b56-45dd-966c-2a4b33f0b4a9-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:03:11 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-341668b7-6233-4ec9-9c2b-e78a0977a3c3 tempest-CinderUnicodeTest-2077516412 None] Acquiring lock "cinder-quobyte-cbe9ba95-0b56-45dd-966c-2a4b33f0b4a9" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:03:11 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-341668b7-6233-4ec9-9c2b-e78a0977a3c3 tempest-CinderUnicodeTest-2077516412 None] Lock "cinder-quobyte-cbe9ba95-0b56-45dd-966c-2a4b33f0b4a9" acquired by "delete_volume" :: waited 0.031s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:03:11 devstack sudo[105905]: pam_unix(sudo:session): session closed for user root
Jun 15 16:03:11 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-102df24f-f676-495a-9c4a-a758abb695c4 tempest-VolumesListTestJSON-1218479558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-70d01439-7b58-4148-af7d-11c7d1cc420b" returned: 0 in 0.758s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:03:11 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-102df24f-f676-495a-9c4a-a758abb695c4 tempest-VolumesListTestJSON-1218479558 None] <== create_volume: return (1804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 16:03:11 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-102df24f-f676-495a-9c4a-a758abb695c4 tempest-VolumesListTestJSON-1218479558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.807s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:03:11 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa59a85f-2745-4a39-8364-ad96b77183e1]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:03:11 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-341668b7-6233-4ec9-9c2b-e78a0977a3c3 tempest-CinderUnicodeTest-2077516412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-cbe9ba95-0b56-45dd-966c-2a4b33f0b4a9 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:03:11 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-102df24f-f676-495a-9c4a-a758abb695c4 tempest-VolumesListTestJSON-1218479558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ee9ed29-b6fc-4a6c-b720-695817d21fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70d01439-7b58-4148-af7d-11c7d1cc420b', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:03:11 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-102df24f-f676-495a-9c4a-a758abb695c4 tempest-VolumesListTestJSON-1218479558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3538635-3378-40cd-9642-e07f83c496d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:03:11 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-102df24f-f676-495a-9c4a-a758abb695c4 tempest-VolumesListTestJSON-1218479558 None] Volume volume-70d01439-7b58-4148-af7d-11c7d1cc420b (70d01439-7b58-4148-af7d-11c7d1cc420b): created successfully
Jun 15 16:03:11 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-102df24f-f676-495a-9c4a-a758abb695c4 tempest-VolumesListTestJSON-1218479558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3538635-3378-40cd-9642-e07f83c496d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:03:11 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-102df24f-f676-495a-9c4a-a758abb695c4 tempest-VolumesListTestJSON-1218479558 None] Flow 'volume_create_manager' (a23721dd-b16f-4819-8099-6ab22a78d76c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:03:11 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-102df24f-f676-495a-9c4a-a758abb695c4 tempest-VolumesListTestJSON-1218479558 None] Created volume successfully.
Jun 15 16:03:11 devstack sudo[105908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-cbe9ba95-0b56-45dd-966c-2a4b33f0b4a9
Jun 15 16:03:11 devstack sudo[105908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:03:12 devstack sudo[105908]: pam_unix(sudo:session): session closed for user root
Jun 15 16:03:12 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-341668b7-6233-4ec9-9c2b-e78a0977a3c3 tempest-CinderUnicodeTest-2077516412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-cbe9ba95-0b56-45dd-966c-2a4b33f0b4a9" returned: 0 in 0.860s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:03:12 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-341668b7-6233-4ec9-9c2b-e78a0977a3c3 tempest-CinderUnicodeTest-2077516412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-cbe9ba95-0b56-45dd-966c-2a4b33f0b4a9 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:03:12 devstack sudo[105915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-cbe9ba95-0b56-45dd-966c-2a4b33f0b4a9
Jun 15 16:03:12 devstack sudo[105915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:03:12 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a38ac7b-135f-48fe-b10b-bef507b11702 tempest-VolumesListTestJSON-1218479558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 16:03:12 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5a38ac7b-135f-48fe-b10b-bef507b11702 tempest-VolumesListTestJSON-1218479558 None] Flow 'volume_create_manager' (bfb74d51-e2f4-4407-a4b8-f1bac0ec9077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:03:12 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5a38ac7b-135f-48fe-b10b-bef507b11702 tempest-VolumesListTestJSON-1218479558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cff149b2-e5d9-4d9d-8720-765f1b807474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:03:12 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5a38ac7b-135f-48fe-b10b-bef507b11702 tempest-VolumesListTestJSON-1218479558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cff149b2-e5d9-4d9d-8720-765f1b807474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:03:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-14967709',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8462de2-f08d-4450-a93e-a0c43ead8002,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2db5d87fd2c743d4ad42f4e8c21f575d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:03:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:03:12Z,use_quota=True,user_id='f6db25c050cb4f7ebba233bf0f56e3d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:03:12 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5a38ac7b-135f-48fe-b10b-bef507b11702 tempest-VolumesListTestJSON-1218479558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fc8bf75-96a7-4a5a-9d9b-95806f8ab39e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:03:12 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5a38ac7b-135f-48fe-b10b-bef507b11702 tempest-VolumesListTestJSON-1218479558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fc8bf75-96a7-4a5a-9d9b-95806f8ab39e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:03:12 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5a38ac7b-135f-48fe-b10b-bef507b11702 tempest-VolumesListTestJSON-1218479558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b2564bc-fe5b-41cc-ae87-f5b84c5afdc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:03:12 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5a38ac7b-135f-48fe-b10b-bef507b11702 tempest-VolumesListTestJSON-1218479558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b2564bc-fe5b-41cc-ae87-f5b84c5afdc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8462de2-f08d-4450-a93e-a0c43ead8002', 'volume_name': 'volume-c8462de2-f08d-4450-a93e-a0c43ead8002', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:03:12 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5a38ac7b-135f-48fe-b10b-bef507b11702 tempest-VolumesListTestJSON-1218479558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8257f443-2066-4d35-ab3a-aed29a7974f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:03:12 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5a38ac7b-135f-48fe-b10b-bef507b11702 tempest-VolumesListTestJSON-1218479558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8257f443-2066-4d35-ab3a-aed29a7974f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:03:12 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5a38ac7b-135f-48fe-b10b-bef507b11702 tempest-VolumesListTestJSON-1218479558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edcf8f03-5d2e-442a-a5a7-a1c11726817c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:03:12 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-5a38ac7b-135f-48fe-b10b-bef507b11702 tempest-VolumesListTestJSON-1218479558 None] Volume c8462de2-f08d-4450-a93e-a0c43ead8002: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8462de2-f08d-4450-a93e-a0c43ead8002', 'volume_size': 1}
Jun 15 16:03:12 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-5a38ac7b-135f-48fe-b10b-bef507b11702 tempest-VolumesListTestJSON-1218479558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:03:12 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-5a38ac7b-135f-48fe-b10b-bef507b11702 tempest-VolumesListTestJSON-1218479558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:03:12 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-5a38ac7b-135f-48fe-b10b-bef507b11702 tempest-VolumesListTestJSON-1218479558 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:03:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-14967709',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8462de2-f08d-4450-a93e-a0c43ead8002,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2db5d87fd2c743d4ad42f4e8c21f575d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:03:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:03:12Z,use_quota=True,user_id='f6db25c050cb4f7ebba233bf0f56e3d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 16:03:12 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-5a38ac7b-135f-48fe-b10b-bef507b11702 tempest-VolumesListTestJSON-1218479558 None] Creating volume c8462de2-f08d-4450-a93e-a0c43ead8002 {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 16:03:12 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-5a38ac7b-135f-48fe-b10b-bef507b11702 tempest-VolumesListTestJSON-1218479558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:03:12 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-5a38ac7b-135f-48fe-b10b-bef507b11702 tempest-VolumesListTestJSON-1218479558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:03:12 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-5a38ac7b-135f-48fe-b10b-bef507b11702 tempest-VolumesListTestJSON-1218479558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:03:12 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-5a38ac7b-135f-48fe-b10b-bef507b11702 tempest-VolumesListTestJSON-1218479558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:03:12 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-5a38ac7b-135f-48fe-b10b-bef507b11702 tempest-VolumesListTestJSON-1218479558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:03:12 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-5a38ac7b-135f-48fe-b10b-bef507b11702 tempest-VolumesListTestJSON-1218479558 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 16:03:12 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-5a38ac7b-135f-48fe-b10b-bef507b11702 tempest-VolumesListTestJSON-1218479558 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 16:03:12 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5a38ac7b-135f-48fe-b10b-bef507b11702 tempest-VolumesListTestJSON-1218479558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-c8462de2-f08d-4450-a93e-a0c43ead8002 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:03:12 devstack sudo[105917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-c8462de2-f08d-4450-a93e-a0c43ead8002 1073741824
Jun 15 16:03:12 devstack sudo[105917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:03:12 devstack sudo[105915]: pam_unix(sudo:session): session closed for user root
Jun 15 16:03:12 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-341668b7-6233-4ec9-9c2b-e78a0977a3c3 tempest-CinderUnicodeTest-2077516412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-cbe9ba95-0b56-45dd-966c-2a4b33f0b4a9" returned: 0 in 0.664s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:03:13 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-341668b7-6233-4ec9-9c2b-e78a0977a3c3 tempest-CinderUnicodeTest-2077516412 None] Lock "cinder-quobyte-cbe9ba95-0b56-45dd-966c-2a4b33f0b4a9" released by "delete_volume" :: held 1.632s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:03:13 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-341668b7-6233-4ec9-9c2b-e78a0977a3c3 tempest-CinderUnicodeTest-2077516412 None] Created reservations ['c217125e-0134-44e3-a9ab-8c07e3b364db', '276f268e-6f48-47d5-b60b-129d702343ed', '12454169-d478-4183-8323-38c27abdc5e6', '1cad01e5-d7af-42f9-a50b-c9ad848ada26'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 16:03:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-341668b7-6233-4ec9-9c2b-e78a0977a3c3 tempest-CinderUnicodeTest-2077516412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:03:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-341668b7-6233-4ec9-9c2b-e78a0977a3c3 tempest-CinderUnicodeTest-2077516412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:03:13 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-341668b7-6233-4ec9-9c2b-e78a0977a3c3 tempest-CinderUnicodeTest-2077516412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:03:13 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-341668b7-6233-4ec9-9c2b-e78a0977a3c3 tempest-CinderUnicodeTest-2077516412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:03:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-341668b7-6233-4ec9-9c2b-e78a0977a3c3 tempest-CinderUnicodeTest-2077516412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:03:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-341668b7-6233-4ec9-9c2b-e78a0977a3c3 tempest-CinderUnicodeTest-2077516412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:03:13 devstack sudo[105924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 16:03:13 devstack sudo[105924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:03:13 devstack sudo[105917]: pam_unix(sudo:session): session closed for user root
Jun 15 16:03:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5a38ac7b-135f-48fe-b10b-bef507b11702 tempest-VolumesListTestJSON-1218479558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-c8462de2-f08d-4450-a93e-a0c43ead8002 1073741824" returned: 0 in 1.015s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:03:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5a38ac7b-135f-48fe-b10b-bef507b11702 tempest-VolumesListTestJSON-1218479558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-c8462de2-f08d-4450-a93e-a0c43ead8002 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:03:13 devstack sudo[105926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-c8462de2-f08d-4450-a93e-a0c43ead8002
Jun 15 16:03:13 devstack sudo[105926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:03:13 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-ea3df333-ad42-41e2-b467-64aaf37d8385 tempest-CinderUnicodeTest-2077516412 None] Acquiring lock "cinder-bb0c75ea-d314-482d-8694-79d333459ebc-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:03:13 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-ea3df333-ad42-41e2-b467-64aaf37d8385 tempest-CinderUnicodeTest-2077516412 None] Lock "cinder-bb0c75ea-d314-482d-8694-79d333459ebc-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:03:13 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-ea3df333-ad42-41e2-b467-64aaf37d8385 tempest-CinderUnicodeTest-2077516412 None] Acquiring lock "cinder-quobyte-bb0c75ea-d314-482d-8694-79d333459ebc" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:03:13 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-ea3df333-ad42-41e2-b467-64aaf37d8385 tempest-CinderUnicodeTest-2077516412 None] Lock "cinder-quobyte-bb0c75ea-d314-482d-8694-79d333459ebc" acquired by "delete_volume" :: waited 0.025s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:03:13 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[840aca65-0fbe-474f-bfaa-0137c02f2c31]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:03:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ea3df333-ad42-41e2-b467-64aaf37d8385 tempest-CinderUnicodeTest-2077516412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-bb0c75ea-d314-482d-8694-79d333459ebc {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:03:13 devstack sudo[105928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-bb0c75ea-d314-482d-8694-79d333459ebc
Jun 15 16:03:13 devstack sudo[105928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:03:14 devstack sudo[105924]: pam_unix(sudo:session): session closed for user root
Jun 15 16:03:14 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-341668b7-6233-4ec9-9c2b-e78a0977a3c3 tempest-CinderUnicodeTest-2077516412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.922s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:03:14 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-341668b7-6233-4ec9-9c2b-e78a0977a3c3 tempest-CinderUnicodeTest-2077516412 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 16:03:14 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-341668b7-6233-4ec9-9c2b-e78a0977a3c3 tempest-CinderUnicodeTest-2077516412 None] Deleted volume successfully.
Jun 15 16:03:14 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-341668b7-6233-4ec9-9c2b-e78a0977a3c3 tempest-CinderUnicodeTest-2077516412 None] Lock "cinder-cbe9ba95-0b56-45dd-966c-2a4b33f0b4a9-delete_volume" released by "delete_volume" :: held 2.940s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:03:14 devstack sudo[105926]: pam_unix(sudo:session): session closed for user root
Jun 15 16:03:14 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5a38ac7b-135f-48fe-b10b-bef507b11702 tempest-VolumesListTestJSON-1218479558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-c8462de2-f08d-4450-a93e-a0c43ead8002" returned: 0 in 0.923s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:03:14 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-5a38ac7b-135f-48fe-b10b-bef507b11702 tempest-VolumesListTestJSON-1218479558 None] <== create_volume: return (2016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 16:03:14 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-5a38ac7b-135f-48fe-b10b-bef507b11702 tempest-VolumesListTestJSON-1218479558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.019s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:03:14 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5a38ac7b-135f-48fe-b10b-bef507b11702 tempest-VolumesListTestJSON-1218479558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edcf8f03-5d2e-442a-a5a7-a1c11726817c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8462de2-f08d-4450-a93e-a0c43ead8002', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:03:14 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5a38ac7b-135f-48fe-b10b-bef507b11702 tempest-VolumesListTestJSON-1218479558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1b6c650-f86f-45dd-a15e-210ed4220464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:03:14 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-5a38ac7b-135f-48fe-b10b-bef507b11702 tempest-VolumesListTestJSON-1218479558 None] Volume volume-c8462de2-f08d-4450-a93e-a0c43ead8002 (c8462de2-f08d-4450-a93e-a0c43ead8002): created successfully
Jun 15 16:03:14 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5a38ac7b-135f-48fe-b10b-bef507b11702 tempest-VolumesListTestJSON-1218479558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1b6c650-f86f-45dd-a15e-210ed4220464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:03:14 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5a38ac7b-135f-48fe-b10b-bef507b11702 tempest-VolumesListTestJSON-1218479558 None] Flow 'volume_create_manager' (bfb74d51-e2f4-4407-a4b8-f1bac0ec9077) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:03:14 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-5a38ac7b-135f-48fe-b10b-bef507b11702 tempest-VolumesListTestJSON-1218479558 None] Created volume successfully.
Jun 15 16:03:14 devstack sudo[105928]: pam_unix(sudo:session): session closed for user root
Jun 15 16:03:14 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ea3df333-ad42-41e2-b467-64aaf37d8385 tempest-CinderUnicodeTest-2077516412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-bb0c75ea-d314-482d-8694-79d333459ebc" returned: 0 in 0.936s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:03:14 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ea3df333-ad42-41e2-b467-64aaf37d8385 tempest-CinderUnicodeTest-2077516412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-bb0c75ea-d314-482d-8694-79d333459ebc {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:03:14 devstack sudo[105936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-bb0c75ea-d314-482d-8694-79d333459ebc
Jun 15 16:03:14 devstack sudo[105936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:03:15 devstack sudo[105936]: pam_unix(sudo:session): session closed for user root
Jun 15 16:03:15 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ea3df333-ad42-41e2-b467-64aaf37d8385 tempest-CinderUnicodeTest-2077516412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-bb0c75ea-d314-482d-8694-79d333459ebc" returned: 0 in 0.652s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:03:15 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-ea3df333-ad42-41e2-b467-64aaf37d8385 tempest-CinderUnicodeTest-2077516412 None] Lock "cinder-quobyte-bb0c75ea-d314-482d-8694-79d333459ebc" released by "delete_volume" :: held 1.654s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:03:15 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-ea3df333-ad42-41e2-b467-64aaf37d8385 tempest-CinderUnicodeTest-2077516412 None] Created reservations ['63b6c7b3-4e6e-4c6f-ada7-6fc9bc07635d', '2055dc76-4f9e-4d1b-90cf-d04aa44bf59b', 'b694e64d-3afc-4c39-9b62-f4a1127c4ee1', '2bd5c05d-b088-4aed-bb3c-252062d4c90b'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 16:03:15 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-ea3df333-ad42-41e2-b467-64aaf37d8385 tempest-CinderUnicodeTest-2077516412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:03:15 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-ea3df333-ad42-41e2-b467-64aaf37d8385 tempest-CinderUnicodeTest-2077516412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:03:15 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-ea3df333-ad42-41e2-b467-64aaf37d8385 tempest-CinderUnicodeTest-2077516412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:03:15 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-ea3df333-ad42-41e2-b467-64aaf37d8385 tempest-CinderUnicodeTest-2077516412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:03:15 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-ea3df333-ad42-41e2-b467-64aaf37d8385 tempest-CinderUnicodeTest-2077516412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:03:15 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ea3df333-ad42-41e2-b467-64aaf37d8385 tempest-CinderUnicodeTest-2077516412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:03:15 devstack sudo[105939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 16:03:15 devstack sudo[105939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:03:16 devstack sudo[105939]: pam_unix(sudo:session): session closed for user root
Jun 15 16:03:16 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ea3df333-ad42-41e2-b467-64aaf37d8385 tempest-CinderUnicodeTest-2077516412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.844s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:03:16 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-ea3df333-ad42-41e2-b467-64aaf37d8385 tempest-CinderUnicodeTest-2077516412 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 16:03:16 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-ea3df333-ad42-41e2-b467-64aaf37d8385 tempest-CinderUnicodeTest-2077516412 None] Deleted volume successfully.
Jun 15 16:03:16 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-ea3df333-ad42-41e2-b467-64aaf37d8385 tempest-CinderUnicodeTest-2077516412 None] Lock "cinder-bb0c75ea-d314-482d-8694-79d333459ebc-delete_volume" released by "delete_volume" :: held 2.780s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:03:18 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-72cae794-7218-40dc-99a6-f0ef08f30d1b tempest-VolumesListTestJSON-1218479558 None] Acquiring lock "cinder-c8462de2-f08d-4450-a93e-a0c43ead8002-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:03:18 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-72cae794-7218-40dc-99a6-f0ef08f30d1b tempest-VolumesListTestJSON-1218479558 None] Lock "cinder-c8462de2-f08d-4450-a93e-a0c43ead8002-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:03:18 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-72cae794-7218-40dc-99a6-f0ef08f30d1b tempest-VolumesListTestJSON-1218479558 None] Acquiring lock "cinder-quobyte-c8462de2-f08d-4450-a93e-a0c43ead8002" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:03:18 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-72cae794-7218-40dc-99a6-f0ef08f30d1b tempest-VolumesListTestJSON-1218479558 None] Lock "cinder-quobyte-c8462de2-f08d-4450-a93e-a0c43ead8002" acquired by "delete_volume" :: waited 0.017s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:03:18 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf4082e-2bc7-4e9a-b35d-d44447e7d3d4]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:03:18 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-72cae794-7218-40dc-99a6-f0ef08f30d1b tempest-VolumesListTestJSON-1218479558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-c8462de2-f08d-4450-a93e-a0c43ead8002 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:03:18 devstack sudo[105942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-c8462de2-f08d-4450-a93e-a0c43ead8002
Jun 15 16:03:18 devstack sudo[105942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:03:19 devstack sudo[105942]: pam_unix(sudo:session): session closed for user root
Jun 15 16:03:19 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-72cae794-7218-40dc-99a6-f0ef08f30d1b tempest-VolumesListTestJSON-1218479558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-c8462de2-f08d-4450-a93e-a0c43ead8002" returned: 0 in 0.802s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:03:19 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-72cae794-7218-40dc-99a6-f0ef08f30d1b tempest-VolumesListTestJSON-1218479558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-c8462de2-f08d-4450-a93e-a0c43ead8002 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:03:19 devstack sudo[105948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-c8462de2-f08d-4450-a93e-a0c43ead8002
Jun 15 16:03:19 devstack sudo[105948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:03:19 devstack sudo[105948]: pam_unix(sudo:session): session closed for user root
Jun 15 16:03:19 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-72cae794-7218-40dc-99a6-f0ef08f30d1b tempest-VolumesListTestJSON-1218479558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-c8462de2-f08d-4450-a93e-a0c43ead8002" returned: 0 in 0.775s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:03:19 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-72cae794-7218-40dc-99a6-f0ef08f30d1b tempest-VolumesListTestJSON-1218479558 None] Lock "cinder-quobyte-c8462de2-f08d-4450-a93e-a0c43ead8002" released by "delete_volume" :: held 1.637s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:03:20 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-72cae794-7218-40dc-99a6-f0ef08f30d1b tempest-VolumesListTestJSON-1218479558 None] Created reservations ['8a261d17-143a-4ed1-a41e-b97aa2efaaf3', 'c9ac531e-93ec-4299-9ac8-a822c217016b', '29c384ce-4b8d-4e67-81e5-7ef17e99f342', '42423c56-cdb5-40d1-b79b-372ccf5d5a48'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 16:03:20 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-72cae794-7218-40dc-99a6-f0ef08f30d1b tempest-VolumesListTestJSON-1218479558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:03:20 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-72cae794-7218-40dc-99a6-f0ef08f30d1b tempest-VolumesListTestJSON-1218479558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:03:20 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-72cae794-7218-40dc-99a6-f0ef08f30d1b tempest-VolumesListTestJSON-1218479558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:03:20 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-72cae794-7218-40dc-99a6-f0ef08f30d1b tempest-VolumesListTestJSON-1218479558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:03:20 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-72cae794-7218-40dc-99a6-f0ef08f30d1b tempest-VolumesListTestJSON-1218479558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:03:20 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-72cae794-7218-40dc-99a6-f0ef08f30d1b tempest-VolumesListTestJSON-1218479558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:03:20 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-f787445a-0714-4c57-9760-6f7ad5df3a46 tempest-VolumesSnapshotTestJSON-35733676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 16:03:20 devstack sudo[105951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 16:03:20 devstack sudo[105951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:03:20 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-f787445a-0714-4c57-9760-6f7ad5df3a46 tempest-VolumesSnapshotTestJSON-35733676 None] Flow 'volume_create_manager' (412ae2c9-d788-4508-a468-16c3c0d5780d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:03:20 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-f787445a-0714-4c57-9760-6f7ad5df3a46 tempest-VolumesSnapshotTestJSON-35733676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c2247ed-5315-4c76-8313-191c3e87b68c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:03:20 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-f787445a-0714-4c57-9760-6f7ad5df3a46 tempest-VolumesSnapshotTestJSON-35733676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c2247ed-5315-4c76-8313-191c3e87b68c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:03:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1953988721',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76c913c9-6030-4a0e-80c8-66c72477133e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f573920ba84746b3a4b936f5c5af18d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:03:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:03:20Z,use_quota=True,user_id='a5748e74c6b14c5095a8e36fe2ab7316',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:03:20 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-f787445a-0714-4c57-9760-6f7ad5df3a46 tempest-VolumesSnapshotTestJSON-35733676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f42e0f0-af8e-41e7-ae4f-f88a17292af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:03:20 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-f787445a-0714-4c57-9760-6f7ad5df3a46 tempest-VolumesSnapshotTestJSON-35733676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f42e0f0-af8e-41e7-ae4f-f88a17292af7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:03:20 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-f787445a-0714-4c57-9760-6f7ad5df3a46 tempest-VolumesSnapshotTestJSON-35733676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f783320-1134-4ca2-a3fa-73dccc5f1dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:03:20 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-f787445a-0714-4c57-9760-6f7ad5df3a46 tempest-VolumesSnapshotTestJSON-35733676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f783320-1134-4ca2-a3fa-73dccc5f1dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76c913c9-6030-4a0e-80c8-66c72477133e', 'volume_name': 'volume-76c913c9-6030-4a0e-80c8-66c72477133e', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:03:20 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-f787445a-0714-4c57-9760-6f7ad5df3a46 tempest-VolumesSnapshotTestJSON-35733676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fab4cfa4-47cc-4be9-984d-d45a146ebc93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:03:20 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-f787445a-0714-4c57-9760-6f7ad5df3a46 tempest-VolumesSnapshotTestJSON-35733676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fab4cfa4-47cc-4be9-984d-d45a146ebc93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:03:20 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-f787445a-0714-4c57-9760-6f7ad5df3a46 tempest-VolumesSnapshotTestJSON-35733676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82e10432-7a4d-46fd-9e65-5680490c5aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:03:20 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-f787445a-0714-4c57-9760-6f7ad5df3a46 tempest-VolumesSnapshotTestJSON-35733676 None] Volume 76c913c9-6030-4a0e-80c8-66c72477133e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76c913c9-6030-4a0e-80c8-66c72477133e', 'volume_size': 1}
Jun 15 16:03:20 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-f787445a-0714-4c57-9760-6f7ad5df3a46 tempest-VolumesSnapshotTestJSON-35733676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:03:20 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-f787445a-0714-4c57-9760-6f7ad5df3a46 tempest-VolumesSnapshotTestJSON-35733676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:03:20 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-f787445a-0714-4c57-9760-6f7ad5df3a46 tempest-VolumesSnapshotTestJSON-35733676 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:03:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1953988721',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76c913c9-6030-4a0e-80c8-66c72477133e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f573920ba84746b3a4b936f5c5af18d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:03:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:03:20Z,use_quota=True,user_id='a5748e74c6b14c5095a8e36fe2ab7316',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 16:03:20 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-f787445a-0714-4c57-9760-6f7ad5df3a46 tempest-VolumesSnapshotTestJSON-35733676 None] Creating volume 76c913c9-6030-4a0e-80c8-66c72477133e {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 16:03:20 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-f787445a-0714-4c57-9760-6f7ad5df3a46 tempest-VolumesSnapshotTestJSON-35733676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:03:20 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-f787445a-0714-4c57-9760-6f7ad5df3a46 tempest-VolumesSnapshotTestJSON-35733676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:03:20 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-f787445a-0714-4c57-9760-6f7ad5df3a46 tempest-VolumesSnapshotTestJSON-35733676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:03:20 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-f787445a-0714-4c57-9760-6f7ad5df3a46 tempest-VolumesSnapshotTestJSON-35733676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:03:20 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-f787445a-0714-4c57-9760-6f7ad5df3a46 tempest-VolumesSnapshotTestJSON-35733676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:03:20 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-f787445a-0714-4c57-9760-6f7ad5df3a46 tempest-VolumesSnapshotTestJSON-35733676 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 16:03:20 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-f787445a-0714-4c57-9760-6f7ad5df3a46 tempest-VolumesSnapshotTestJSON-35733676 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 16:03:20 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-f787445a-0714-4c57-9760-6f7ad5df3a46 tempest-VolumesSnapshotTestJSON-35733676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-76c913c9-6030-4a0e-80c8-66c72477133e 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:03:20 devstack sudo[105953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-76c913c9-6030-4a0e-80c8-66c72477133e 1073741824
Jun 15 16:03:20 devstack sudo[105953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:03:20 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-74e7b945-06f4-48db-92ec-0fc1d1f68898 tempest-VolumesListTestJSON-1218479558 None] Acquiring lock "cinder-70d01439-7b58-4148-af7d-11c7d1cc420b-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:03:20 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-74e7b945-06f4-48db-92ec-0fc1d1f68898 tempest-VolumesListTestJSON-1218479558 None] Lock "cinder-70d01439-7b58-4148-af7d-11c7d1cc420b-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:03:20 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-74e7b945-06f4-48db-92ec-0fc1d1f68898 tempest-VolumesListTestJSON-1218479558 None] Acquiring lock "cinder-quobyte-70d01439-7b58-4148-af7d-11c7d1cc420b" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:03:20 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-74e7b945-06f4-48db-92ec-0fc1d1f68898 tempest-VolumesListTestJSON-1218479558 None] Lock "cinder-quobyte-70d01439-7b58-4148-af7d-11c7d1cc420b" acquired by "delete_volume" :: waited 0.025s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:03:20 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc92881-400e-464c-8846-77c53cc28129]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:03:20 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-74e7b945-06f4-48db-92ec-0fc1d1f68898 tempest-VolumesListTestJSON-1218479558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-70d01439-7b58-4148-af7d-11c7d1cc420b {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:03:20 devstack sudo[105956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-70d01439-7b58-4148-af7d-11c7d1cc420b
Jun 15 16:03:20 devstack sudo[105956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:03:21 devstack sudo[105951]: pam_unix(sudo:session): session closed for user root
Jun 15 16:03:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-72cae794-7218-40dc-99a6-f0ef08f30d1b tempest-VolumesListTestJSON-1218479558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 1.042s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:03:21 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-72cae794-7218-40dc-99a6-f0ef08f30d1b tempest-VolumesListTestJSON-1218479558 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 16:03:21 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-72cae794-7218-40dc-99a6-f0ef08f30d1b tempest-VolumesListTestJSON-1218479558 None] Deleted volume successfully.
Jun 15 16:03:21 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-72cae794-7218-40dc-99a6-f0ef08f30d1b tempest-VolumesListTestJSON-1218479558 None] Lock "cinder-c8462de2-f08d-4450-a93e-a0c43ead8002-delete_volume" released by "delete_volume" :: held 3.047s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:03:21 devstack sudo[105953]: pam_unix(sudo:session): session closed for user root
Jun 15 16:03:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-f787445a-0714-4c57-9760-6f7ad5df3a46 tempest-VolumesSnapshotTestJSON-35733676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-76c913c9-6030-4a0e-80c8-66c72477133e 1073741824" returned: 0 in 1.086s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:03:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-f787445a-0714-4c57-9760-6f7ad5df3a46 tempest-VolumesSnapshotTestJSON-35733676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-76c913c9-6030-4a0e-80c8-66c72477133e {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:03:21 devstack sudo[105963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-76c913c9-6030-4a0e-80c8-66c72477133e
Jun 15 16:03:21 devstack sudo[105963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:03:21 devstack sudo[105956]: pam_unix(sudo:session): session closed for user root
Jun 15 16:03:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-74e7b945-06f4-48db-92ec-0fc1d1f68898 tempest-VolumesListTestJSON-1218479558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-70d01439-7b58-4148-af7d-11c7d1cc420b" returned: 0 in 0.917s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:03:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-74e7b945-06f4-48db-92ec-0fc1d1f68898 tempest-VolumesListTestJSON-1218479558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-70d01439-7b58-4148-af7d-11c7d1cc420b {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:03:21 devstack sudo[105968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-70d01439-7b58-4148-af7d-11c7d1cc420b
Jun 15 16:03:21 devstack sudo[105968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:03:22 devstack sudo[105963]: pam_unix(sudo:session): session closed for user root
Jun 15 16:03:22 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-f787445a-0714-4c57-9760-6f7ad5df3a46 tempest-VolumesSnapshotTestJSON-35733676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-76c913c9-6030-4a0e-80c8-66c72477133e" returned: 0 in 0.743s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:03:22 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-f787445a-0714-4c57-9760-6f7ad5df3a46 tempest-VolumesSnapshotTestJSON-35733676 None] <== create_volume: return (1883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 16:03:22 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-f787445a-0714-4c57-9760-6f7ad5df3a46 tempest-VolumesSnapshotTestJSON-35733676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.886s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:03:22 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-f787445a-0714-4c57-9760-6f7ad5df3a46 tempest-VolumesSnapshotTestJSON-35733676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82e10432-7a4d-46fd-9e65-5680490c5aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76c913c9-6030-4a0e-80c8-66c72477133e', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:03:22 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-f787445a-0714-4c57-9760-6f7ad5df3a46 tempest-VolumesSnapshotTestJSON-35733676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fd4700d-5566-4b06-b622-87a83a0e295c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:03:22 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-f787445a-0714-4c57-9760-6f7ad5df3a46 tempest-VolumesSnapshotTestJSON-35733676 None] Volume volume-76c913c9-6030-4a0e-80c8-66c72477133e (76c913c9-6030-4a0e-80c8-66c72477133e): created successfully
Jun 15 16:03:22 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-f787445a-0714-4c57-9760-6f7ad5df3a46 tempest-VolumesSnapshotTestJSON-35733676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fd4700d-5566-4b06-b622-87a83a0e295c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:03:22 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-f787445a-0714-4c57-9760-6f7ad5df3a46 tempest-VolumesSnapshotTestJSON-35733676 None] Flow 'volume_create_manager' (412ae2c9-d788-4508-a468-16c3c0d5780d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:03:22 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-f787445a-0714-4c57-9760-6f7ad5df3a46 tempest-VolumesSnapshotTestJSON-35733676 None] Created volume successfully.
Jun 15 16:03:22 devstack sudo[105968]: pam_unix(sudo:session): session closed for user root
Jun 15 16:03:22 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-74e7b945-06f4-48db-92ec-0fc1d1f68898 tempest-VolumesListTestJSON-1218479558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-70d01439-7b58-4148-af7d-11c7d1cc420b" returned: 0 in 0.742s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:03:22 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-74e7b945-06f4-48db-92ec-0fc1d1f68898 tempest-VolumesListTestJSON-1218479558 None] Lock "cinder-quobyte-70d01439-7b58-4148-af7d-11c7d1cc420b" released by "delete_volume" :: held 1.726s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:03:22 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-74e7b945-06f4-48db-92ec-0fc1d1f68898 tempest-VolumesListTestJSON-1218479558 None] Created reservations ['872b9425-a253-4c2b-a7f7-b55d555793d2', 'e48c0425-8ae3-463e-b3d8-fbb6eea25b40', '48d2d6ec-4a84-49af-a78c-97f8075c301c', 'e2c050be-f75d-4158-9453-5b48b1d7832d'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 16:03:22 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-74e7b945-06f4-48db-92ec-0fc1d1f68898 tempest-VolumesListTestJSON-1218479558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:03:22 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-74e7b945-06f4-48db-92ec-0fc1d1f68898 tempest-VolumesListTestJSON-1218479558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:03:22 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-74e7b945-06f4-48db-92ec-0fc1d1f68898 tempest-VolumesListTestJSON-1218479558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:03:22 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-74e7b945-06f4-48db-92ec-0fc1d1f68898 tempest-VolumesListTestJSON-1218479558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:03:22 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-74e7b945-06f4-48db-92ec-0fc1d1f68898 tempest-VolumesListTestJSON-1218479558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:03:22 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-74e7b945-06f4-48db-92ec-0fc1d1f68898 tempest-VolumesListTestJSON-1218479558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:03:22 devstack sudo[105972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 16:03:22 devstack sudo[105972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:03:23 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-40cd8528-704b-4736-87df-0b8970e4bee2 tempest-VolumesListTestJSON-1218479558 None] Acquiring lock "cinder-c1b2ca17-284f-41e1-8da9-779dfd74d40d-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:03:23 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-40cd8528-704b-4736-87df-0b8970e4bee2 tempest-VolumesListTestJSON-1218479558 None] Lock "cinder-c1b2ca17-284f-41e1-8da9-779dfd74d40d-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:03:23 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-40cd8528-704b-4736-87df-0b8970e4bee2 tempest-VolumesListTestJSON-1218479558 None] Acquiring lock "cinder-quobyte-c1b2ca17-284f-41e1-8da9-779dfd74d40d" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:03:23 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-40cd8528-704b-4736-87df-0b8970e4bee2 tempest-VolumesListTestJSON-1218479558 None] Lock "cinder-quobyte-c1b2ca17-284f-41e1-8da9-779dfd74d40d" acquired by "delete_volume" :: waited 0.017s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:03:23 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[694d83bc-edc5-4dfc-917f-a2354ddf8198]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:03:23 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-40cd8528-704b-4736-87df-0b8970e4bee2 tempest-VolumesListTestJSON-1218479558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-c1b2ca17-284f-41e1-8da9-779dfd74d40d {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:03:23 devstack sudo[105972]: pam_unix(sudo:session): session closed for user root
Jun 15 16:03:23 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-74e7b945-06f4-48db-92ec-0fc1d1f68898 tempest-VolumesListTestJSON-1218479558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.718s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:03:23 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-74e7b945-06f4-48db-92ec-0fc1d1f68898 tempest-VolumesListTestJSON-1218479558 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 16:03:23 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-74e7b945-06f4-48db-92ec-0fc1d1f68898 tempest-VolumesListTestJSON-1218479558 None] Deleted volume successfully.
Jun 15 16:03:23 devstack sudo[105974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-c1b2ca17-284f-41e1-8da9-779dfd74d40d
Jun 15 16:03:23 devstack sudo[105974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:03:23 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-74e7b945-06f4-48db-92ec-0fc1d1f68898 tempest-VolumesListTestJSON-1218479558 None] Lock "cinder-70d01439-7b58-4148-af7d-11c7d1cc420b-delete_volume" released by "delete_volume" :: held 2.746s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:03:23 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-5907d407-860e-4c13-9f6b-cd58b490039e tempest-VolumesSnapshotTestJSON-35733676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:03:23 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-5907d407-860e-4c13-9f6b-cd58b490039e tempest-VolumesSnapshotTestJSON-35733676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:03:23 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-5907d407-860e-4c13-9f6b-cd58b490039e tempest-VolumesSnapshotTestJSON-35733676 None] Creating offline snapshot d3a9c53a-7754-4b48-a1a5-e17cabad5993 of volume 76c913c9-6030-4a0e-80c8-66c72477133e {{(pid=91863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 15 16:03:23 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e8fa64a-2d25-4aeb-b28e-ff7a8527f4df]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:03:23 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5907d407-860e-4c13-9f6b-cd58b490039e tempest-VolumesSnapshotTestJSON-35733676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-76c913c9-6030-4a0e-80c8-66c72477133e {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:03:23 devstack sudo[105983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-76c913c9-6030-4a0e-80c8-66c72477133e
Jun 15 16:03:23 devstack sudo[105983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:03:24 devstack sudo[105974]: pam_unix(sudo:session): session closed for user root
Jun 15 16:03:24 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-40cd8528-704b-4736-87df-0b8970e4bee2 tempest-VolumesListTestJSON-1218479558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-c1b2ca17-284f-41e1-8da9-779dfd74d40d" returned: 0 in 0.984s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:03:24 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-40cd8528-704b-4736-87df-0b8970e4bee2 tempest-VolumesListTestJSON-1218479558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-c1b2ca17-284f-41e1-8da9-779dfd74d40d {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:03:24 devstack sudo[105988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-c1b2ca17-284f-41e1-8da9-779dfd74d40d
Jun 15 16:03:24 devstack sudo[105988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:03:24 devstack sudo[105983]: pam_unix(sudo:session): session closed for user root
Jun 15 16:03:24 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5907d407-860e-4c13-9f6b-cd58b490039e tempest-VolumesSnapshotTestJSON-35733676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-76c913c9-6030-4a0e-80c8-66c72477133e" returned: 0 in 0.975s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:03:24 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5907d407-860e-4c13-9f6b-cd58b490039e tempest-VolumesSnapshotTestJSON-35733676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-76c913c9-6030-4a0e-80c8-66c72477133e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-76c913c9-6030-4a0e-80c8-66c72477133e.d3a9c53a-7754-4b48-a1a5-e17cabad5993 1G {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:03:24 devstack sudo[105995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-76c913c9-6030-4a0e-80c8-66c72477133e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-76c913c9-6030-4a0e-80c8-66c72477133e.d3a9c53a-7754-4b48-a1a5-e17cabad5993 1G
Jun 15 16:03:24 devstack sudo[105995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:03:24 devstack sudo[105988]: pam_unix(sudo:session): session closed for user root
Jun 15 16:03:24 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-40cd8528-704b-4736-87df-0b8970e4bee2 tempest-VolumesListTestJSON-1218479558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-c1b2ca17-284f-41e1-8da9-779dfd74d40d" returned: 0 in 0.731s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:03:25 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-40cd8528-704b-4736-87df-0b8970e4bee2 tempest-VolumesListTestJSON-1218479558 None] Lock "cinder-quobyte-c1b2ca17-284f-41e1-8da9-779dfd74d40d" released by "delete_volume" :: held 1.820s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:03:25 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-40cd8528-704b-4736-87df-0b8970e4bee2 tempest-VolumesListTestJSON-1218479558 None] Created reservations ['b94d98fe-add4-4014-86b6-2d7dbe1322e6', '215f73b3-eb81-4047-9d95-ee3ce499f8b1', '2f60cdac-6ba5-435a-a2d3-c683d8366d0d', '0bd20cbf-bd88-4623-b37b-489489db7565'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 16:03:25 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-40cd8528-704b-4736-87df-0b8970e4bee2 tempest-VolumesListTestJSON-1218479558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:03:25 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-40cd8528-704b-4736-87df-0b8970e4bee2 tempest-VolumesListTestJSON-1218479558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:03:25 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-40cd8528-704b-4736-87df-0b8970e4bee2 tempest-VolumesListTestJSON-1218479558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:03:25 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-40cd8528-704b-4736-87df-0b8970e4bee2 tempest-VolumesListTestJSON-1218479558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:03:25 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-40cd8528-704b-4736-87df-0b8970e4bee2 tempest-VolumesListTestJSON-1218479558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:03:25 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-40cd8528-704b-4736-87df-0b8970e4bee2 tempest-VolumesListTestJSON-1218479558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:03:25 devstack sudo[105997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 16:03:25 devstack sudo[105997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:03:26 devstack sudo[105995]: pam_unix(sudo:session): session closed for user root
Jun 15 16:03:26 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5907d407-860e-4c13-9f6b-cd58b490039e tempest-VolumesSnapshotTestJSON-35733676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-76c913c9-6030-4a0e-80c8-66c72477133e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-76c913c9-6030-4a0e-80c8-66c72477133e.d3a9c53a-7754-4b48-a1a5-e17cabad5993 1G" returned: 0 in 1.216s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:03:26 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5907d407-860e-4c13-9f6b-cd58b490039e tempest-VolumesSnapshotTestJSON-35733676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76c913c9-6030-4a0e-80c8-66c72477133e -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-76c913c9-6030-4a0e-80c8-66c72477133e.d3a9c53a-7754-4b48-a1a5-e17cabad5993 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:03:26 devstack sudo[105997]: pam_unix(sudo:session): session closed for user root
Jun 15 16:03:26 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-40cd8528-704b-4736-87df-0b8970e4bee2 tempest-VolumesListTestJSON-1218479558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.822s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:03:26 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-40cd8528-704b-4736-87df-0b8970e4bee2 tempest-VolumesListTestJSON-1218479558 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 16:03:26 devstack sudo[106004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76c913c9-6030-4a0e-80c8-66c72477133e -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-76c913c9-6030-4a0e-80c8-66c72477133e.d3a9c53a-7754-4b48-a1a5-e17cabad5993
Jun 15 16:03:26 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-40cd8528-704b-4736-87df-0b8970e4bee2 tempest-VolumesListTestJSON-1218479558 None] Deleted volume successfully.
Jun 15 16:03:26 devstack sudo[106004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:03:26 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-40cd8528-704b-4736-87df-0b8970e4bee2 tempest-VolumesListTestJSON-1218479558 None] Lock "cinder-c1b2ca17-284f-41e1-8da9-779dfd74d40d-delete_volume" released by "delete_volume" :: held 3.010s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:03:26 devstack sudo[106004]: pam_unix(sudo:session): session closed for user root
Jun 15 16:03:26 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5907d407-860e-4c13-9f6b-cd58b490039e tempest-VolumesSnapshotTestJSON-35733676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76c913c9-6030-4a0e-80c8-66c72477133e -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-76c913c9-6030-4a0e-80c8-66c72477133e.d3a9c53a-7754-4b48-a1a5-e17cabad5993" returned: 0 in 0.809s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:03:26 devstack cinder-volume[91863]: WARNING cinder.volume.drivers.remotefs [None req-5907d407-860e-4c13-9f6b-cd58b490039e tempest-VolumesSnapshotTestJSON-35733676 None] /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-76c913c9-6030-4a0e-80c8-66c72477133e.d3a9c53a-7754-4b48-a1a5-e17cabad5993 is being set with open permissions: ugo+rw
Jun 15 16:03:26 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5907d407-860e-4c13-9f6b-cd58b490039e tempest-VolumesSnapshotTestJSON-35733676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-76c913c9-6030-4a0e-80c8-66c72477133e.d3a9c53a-7754-4b48-a1a5-e17cabad5993 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:03:26 devstack sudo[106010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-76c913c9-6030-4a0e-80c8-66c72477133e.d3a9c53a-7754-4b48-a1a5-e17cabad5993
Jun 15 16:03:26 devstack sudo[106010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:03:27 devstack sudo[106010]: pam_unix(sudo:session): session closed for user root
Jun 15 16:03:27 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5907d407-860e-4c13-9f6b-cd58b490039e tempest-VolumesSnapshotTestJSON-35733676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-76c913c9-6030-4a0e-80c8-66c72477133e.d3a9c53a-7754-4b48-a1a5-e17cabad5993" returned: 0 in 0.657s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:03:27 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5907d407-860e-4c13-9f6b-cd58b490039e tempest-VolumesSnapshotTestJSON-35733676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-76c913c9-6030-4a0e-80c8-66c72477133e.info {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:03:27 devstack sudo[106013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-76c913c9-6030-4a0e-80c8-66c72477133e.info
Jun 15 16:03:27 devstack sudo[106013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:03:28 devstack sudo[106013]: pam_unix(sudo:session): session closed for user root
Jun 15 16:03:28 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5907d407-860e-4c13-9f6b-cd58b490039e tempest-VolumesSnapshotTestJSON-35733676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-76c913c9-6030-4a0e-80c8-66c72477133e.info" returned: 0 in 0.641s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:03:28 devstack cinder-volume[91863]: WARNING cinder.volume.drivers.remotefs [None req-5907d407-860e-4c13-9f6b-cd58b490039e tempest-VolumesSnapshotTestJSON-35733676 None] /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-76c913c9-6030-4a0e-80c8-66c72477133e.info is being set with open permissions: ugo+rw
Jun 15 16:03:28 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5907d407-860e-4c13-9f6b-cd58b490039e tempest-VolumesSnapshotTestJSON-35733676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-76c913c9-6030-4a0e-80c8-66c72477133e.info {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:03:28 devstack sudo[106016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-76c913c9-6030-4a0e-80c8-66c72477133e.info
Jun 15 16:03:28 devstack sudo[106016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:03:28 devstack sudo[106016]: pam_unix(sudo:session): session closed for user root
Jun 15 16:03:28 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5907d407-860e-4c13-9f6b-cd58b490039e tempest-VolumesSnapshotTestJSON-35733676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-76c913c9-6030-4a0e-80c8-66c72477133e.info" returned: 0 in 0.791s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:03:29 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-5907d407-860e-4c13-9f6b-cd58b490039e tempest-VolumesSnapshotTestJSON-35733676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.229s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:03:29 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-74abf813-38df-4044-8a9a-053f7242f750 tempest-VolumesNegativeTest-523729614 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 16:03:29 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-74abf813-38df-4044-8a9a-053f7242f750 tempest-VolumesNegativeTest-523729614 None] Flow 'volume_create_manager' (63bad421-8dec-428c-b77c-faa844aa5fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:03:29 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-74abf813-38df-4044-8a9a-053f7242f750 tempest-VolumesNegativeTest-523729614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19cac970-475d-481c-810b-3a925bc6a6f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:03:29 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-74abf813-38df-4044-8a9a-053f7242f750 tempest-VolumesNegativeTest-523729614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19cac970-475d-481c-810b-3a925bc6a6f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:03:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-436358644',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d09dae1-fa0a-4a7c-a26d-df6e57d5bdbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d3c1ae156214be98d2dd9cb46f7684d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:03:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:03:29Z,use_quota=True,user_id='426110e7305c435fbe59f5af0038b5fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:03:29 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-74abf813-38df-4044-8a9a-053f7242f750 tempest-VolumesNegativeTest-523729614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7009bcd3-a10c-44e1-bce0-a73b3bae2513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:03:29 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-74abf813-38df-4044-8a9a-053f7242f750 tempest-VolumesNegativeTest-523729614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7009bcd3-a10c-44e1-bce0-a73b3bae2513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:03:29 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-74abf813-38df-4044-8a9a-053f7242f750 tempest-VolumesNegativeTest-523729614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5121fe75-a90f-4c1c-a4d5-c47e5417f13d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:03:29 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-74abf813-38df-4044-8a9a-053f7242f750 tempest-VolumesNegativeTest-523729614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5121fe75-a90f-4c1c-a4d5-c47e5417f13d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d09dae1-fa0a-4a7c-a26d-df6e57d5bdbd', 'volume_name': 'volume-1d09dae1-fa0a-4a7c-a26d-df6e57d5bdbd', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:03:29 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-74abf813-38df-4044-8a9a-053f7242f750 tempest-VolumesNegativeTest-523729614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53d07b3e-a109-475b-93a2-4629573fbc78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:03:29 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-74abf813-38df-4044-8a9a-053f7242f750 tempest-VolumesNegativeTest-523729614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53d07b3e-a109-475b-93a2-4629573fbc78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:03:29 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-74abf813-38df-4044-8a9a-053f7242f750 tempest-VolumesNegativeTest-523729614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64502b98-51f4-48f6-adb0-ba39402933b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:03:29 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-74abf813-38df-4044-8a9a-053f7242f750 tempest-VolumesNegativeTest-523729614 None] Volume 1d09dae1-fa0a-4a7c-a26d-df6e57d5bdbd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d09dae1-fa0a-4a7c-a26d-df6e57d5bdbd', 'volume_size': 1}
Jun 15 16:03:29 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-74abf813-38df-4044-8a9a-053f7242f750 tempest-VolumesNegativeTest-523729614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:03:29 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-74abf813-38df-4044-8a9a-053f7242f750 tempest-VolumesNegativeTest-523729614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:03:29 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-74abf813-38df-4044-8a9a-053f7242f750 tempest-VolumesNegativeTest-523729614 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:03:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-436358644',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d09dae1-fa0a-4a7c-a26d-df6e57d5bdbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d3c1ae156214be98d2dd9cb46f7684d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:03:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:03:29Z,use_quota=True,user_id='426110e7305c435fbe59f5af0038b5fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 16:03:29 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-74abf813-38df-4044-8a9a-053f7242f750 tempest-VolumesNegativeTest-523729614 None] Creating volume 1d09dae1-fa0a-4a7c-a26d-df6e57d5bdbd {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 16:03:29 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-74abf813-38df-4044-8a9a-053f7242f750 tempest-VolumesNegativeTest-523729614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:03:29 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-74abf813-38df-4044-8a9a-053f7242f750 tempest-VolumesNegativeTest-523729614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:03:29 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-74abf813-38df-4044-8a9a-053f7242f750 tempest-VolumesNegativeTest-523729614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:03:29 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-74abf813-38df-4044-8a9a-053f7242f750 tempest-VolumesNegativeTest-523729614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:03:29 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-74abf813-38df-4044-8a9a-053f7242f750 tempest-VolumesNegativeTest-523729614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:03:29 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-74abf813-38df-4044-8a9a-053f7242f750 tempest-VolumesNegativeTest-523729614 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 16:03:29 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-74abf813-38df-4044-8a9a-053f7242f750 tempest-VolumesNegativeTest-523729614 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 16:03:29 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-74abf813-38df-4044-8a9a-053f7242f750 tempest-VolumesNegativeTest-523729614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1d09dae1-fa0a-4a7c-a26d-df6e57d5bdbd 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:03:29 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-5907d407-860e-4c13-9f6b-cd58b490039e tempest-VolumesSnapshotTestJSON-35733676 None] Create snapshot completed successfully
Jun 15 16:03:29 devstack sudo[106019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1d09dae1-fa0a-4a7c-a26d-df6e57d5bdbd 1073741824
Jun 15 16:03:29 devstack sudo[106019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:03:30 devstack sudo[106019]: pam_unix(sudo:session): session closed for user root
Jun 15 16:03:30 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-74abf813-38df-4044-8a9a-053f7242f750 tempest-VolumesNegativeTest-523729614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1d09dae1-fa0a-4a7c-a26d-df6e57d5bdbd 1073741824" returned: 0 in 0.906s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:03:30 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-74abf813-38df-4044-8a9a-053f7242f750 tempest-VolumesNegativeTest-523729614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1d09dae1-fa0a-4a7c-a26d-df6e57d5bdbd {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:03:30 devstack sudo[106025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1d09dae1-fa0a-4a7c-a26d-df6e57d5bdbd
Jun 15 16:03:30 devstack sudo[106025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:03:30 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-90324674-724c-4f9d-8ea6-7297dbee0a40 tempest-VolumesSnapshotTestJSON-35733676 None] Acquiring lock "cinder-d3a9c53a-7754-4b48-a1a5-e17cabad5993-delete_snapshot" by "delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:03:30 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-90324674-724c-4f9d-8ea6-7297dbee0a40 tempest-VolumesSnapshotTestJSON-35733676 None] Lock "cinder-d3a9c53a-7754-4b48-a1a5-e17cabad5993-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:03:30 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-90324674-724c-4f9d-8ea6-7297dbee0a40 tempest-VolumesSnapshotTestJSON-35733676 None] Acquiring lock "cinder-quobyte-76c913c9-6030-4a0e-80c8-66c72477133e" by "delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:03:30 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-90324674-724c-4f9d-8ea6-7297dbee0a40 tempest-VolumesSnapshotTestJSON-35733676 None] Lock "cinder-quobyte-76c913c9-6030-4a0e-80c8-66c72477133e" acquired by "delete_snapshot" :: waited 0.022s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:03:30 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-90324674-724c-4f9d-8ea6-7297dbee0a40 tempest-VolumesSnapshotTestJSON-35733676 None] Acquiring lock "cinder-quobyte-d3a9c53a-7754-4b48-a1a5-e17cabad5993" by "_delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:03:30 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-90324674-724c-4f9d-8ea6-7297dbee0a40 tempest-VolumesSnapshotTestJSON-35733676 None] Lock "cinder-quobyte-d3a9c53a-7754-4b48-a1a5-e17cabad5993" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:03:30 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-90324674-724c-4f9d-8ea6-7297dbee0a40 tempest-VolumesSnapshotTestJSON-35733676 None] Deleting offline snapshot d3a9c53a-7754-4b48-a1a5-e17cabad5993 of volume 76c913c9-6030-4a0e-80c8-66c72477133e {{(pid=91863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 15 16:03:30 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-90324674-724c-4f9d-8ea6-7297dbee0a40 tempest-VolumesSnapshotTestJSON-35733676 None] snapshot_file for this snap is: volume-76c913c9-6030-4a0e-80c8-66c72477133e.d3a9c53a-7754-4b48-a1a5-e17cabad5993 {{(pid=91863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 15 16:03:30 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea1015b-9bdb-4c06-901e-e8268d40e936]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:03:30 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-90324674-724c-4f9d-8ea6-7297dbee0a40 tempest-VolumesSnapshotTestJSON-35733676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-76c913c9-6030-4a0e-80c8-66c72477133e.d3a9c53a-7754-4b48-a1a5-e17cabad5993 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:03:30 devstack sudo[106027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-76c913c9-6030-4a0e-80c8-66c72477133e.d3a9c53a-7754-4b48-a1a5-e17cabad5993
Jun 15 16:03:30 devstack sudo[106027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:03:30 devstack sudo[106025]: pam_unix(sudo:session): session closed for user root
Jun 15 16:03:30 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-74abf813-38df-4044-8a9a-053f7242f750 tempest-VolumesNegativeTest-523729614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1d09dae1-fa0a-4a7c-a26d-df6e57d5bdbd" returned: 0 in 0.705s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:03:30 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-74abf813-38df-4044-8a9a-053f7242f750 tempest-VolumesNegativeTest-523729614 None] <== create_volume: return (1667ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 16:03:30 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-74abf813-38df-4044-8a9a-053f7242f750 tempest-VolumesNegativeTest-523729614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.670s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:03:30 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-74abf813-38df-4044-8a9a-053f7242f750 tempest-VolumesNegativeTest-523729614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64502b98-51f4-48f6-adb0-ba39402933b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d09dae1-fa0a-4a7c-a26d-df6e57d5bdbd', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:03:30 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-74abf813-38df-4044-8a9a-053f7242f750 tempest-VolumesNegativeTest-523729614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fa94447-241a-457e-8ece-b0284092cc27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:03:30 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-74abf813-38df-4044-8a9a-053f7242f750 tempest-VolumesNegativeTest-523729614 None] Volume volume-1d09dae1-fa0a-4a7c-a26d-df6e57d5bdbd (1d09dae1-fa0a-4a7c-a26d-df6e57d5bdbd): created successfully
Jun 15 16:03:30 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-74abf813-38df-4044-8a9a-053f7242f750 tempest-VolumesNegativeTest-523729614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fa94447-241a-457e-8ece-b0284092cc27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:03:30 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-74abf813-38df-4044-8a9a-053f7242f750 tempest-VolumesNegativeTest-523729614 None] Flow 'volume_create_manager' (63bad421-8dec-428c-b77c-faa844aa5fc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:03:30 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-74abf813-38df-4044-8a9a-053f7242f750 tempest-VolumesNegativeTest-523729614 None] Created volume successfully.
Jun 15 16:03:31 devstack cinder-volume[91863]: DEBUG oslo_service.periodic_task [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 16:03:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:03:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:03:31 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:03:31 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:03:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:03:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:03:31 devstack sudo[106030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 16:03:31 devstack sudo[106030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:03:31 devstack sudo[106027]: pam_unix(sudo:session): session closed for user root
Jun 15 16:03:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-90324674-724c-4f9d-8ea6-7297dbee0a40 tempest-VolumesSnapshotTestJSON-35733676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-76c913c9-6030-4a0e-80c8-66c72477133e.d3a9c53a-7754-4b48-a1a5-e17cabad5993" returned: 0 in 0.951s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:03:31 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-90324674-724c-4f9d-8ea6-7297dbee0a40 tempest-VolumesSnapshotTestJSON-35733676 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-76c913c9-6030-4a0e-80c8-66c72477133e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 16:03:31 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[87505250-7fa0-4bf7-906e-6843fb99542e]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:03:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-90324674-724c-4f9d-8ea6-7297dbee0a40 tempest-VolumesSnapshotTestJSON-35733676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-76c913c9-6030-4a0e-80c8-66c72477133e {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:03:31 devstack sudo[106035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-76c913c9-6030-4a0e-80c8-66c72477133e
Jun 15 16:03:31 devstack sudo[106035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:03:31 devstack sudo[106030]: pam_unix(sudo:session): session closed for user root
Jun 15 16:03:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.765s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:03:31 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 16:03:31 devstack cinder-volume[91863]: DEBUG oslo_service.periodic_task [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Running periodic task VolumeManager._thread_info {{(pid=91863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 16:03:31 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] thread count: 28 {{(pid=91863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 15 16:03:31 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] thread info: [<_MainThread(MainThread, started 131088232640640)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131088122704576)>, <Thread(Thread-3 (stat_writer), started daemon 131088123058112)>, <Thread(Rabbit-heartbeat, started daemon 131088121268864)>, <Thread(Thread-5 (_runner), started daemon 131088121904192)>, <Thread(Thread-7 (_runner), started daemon 131088122037248)>, <Thread(fd_logger, started daemon 131088119630784)>, <Thread(privsep_reader, started daemon 131088119781440)>, <Thread(tpool_thread_0, started daemon 131088111617728)>, <Thread(tpool_thread_1, started daemon 131088103225024)>, <Thread(tpool_thread_2, started daemon 131088094832320)>, <Thread(tpool_thread_3, started daemon 131088086439616)>, <Thread(tpool_thread_4, started daemon 131088078046912)>, <Thread(tpool_thread_5, started daemon 131088069654208)>, <Thread(tpool_thread_6, started daemon 131088061261504)>, <Thread(tpool_thread_7, started daemon 131088052868800)>, <Thread(tpool_thread_8, started daemon 131088044476096)>, <Thread(tpool_thread_9, started daemon 131088036083392)>, <Thread(tpool_thread_10, started daemon 131088027690688)>, <Thread(tpool_thread_11, started daemon 131088019297984)>, <Thread(tpool_thread_12, started daemon 131088010905280)>, <Thread(tpool_thread_13, started daemon 131088002512576)>, <Thread(tpool_thread_14, started daemon 131087994119872)>, <Thread(tpool_thread_15, started daemon 131087985727168)>, <Thread(tpool_thread_16, started daemon 131087977334464)>, <Thread(tpool_thread_17, started daemon 131087968941760)>, <Thread(tpool_thread_18, started daemon 131087960549056)>, <Thread(tpool_thread_19, started daemon 131087952156352)>] {{(pid=91863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 15 16:03:32 devstack sudo[106035]: pam_unix(sudo:session): session closed for user root
Jun 15 16:03:32 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-90324674-724c-4f9d-8ea6-7297dbee0a40 tempest-VolumesSnapshotTestJSON-35733676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-76c913c9-6030-4a0e-80c8-66c72477133e" returned: 0 in 0.913s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:03:32 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-90324674-724c-4f9d-8ea6-7297dbee0a40 tempest-VolumesSnapshotTestJSON-35733676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-76c913c9-6030-4a0e-80c8-66c72477133e.d3a9c53a-7754-4b48-a1a5-e17cabad5993 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:03:32 devstack sudo[106043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-76c913c9-6030-4a0e-80c8-66c72477133e.d3a9c53a-7754-4b48-a1a5-e17cabad5993
Jun 15 16:03:32 devstack sudo[106043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:03:33 devstack sudo[106043]: pam_unix(sudo:session): session closed for user root
Jun 15 16:03:33 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-90324674-724c-4f9d-8ea6-7297dbee0a40 tempest-VolumesSnapshotTestJSON-35733676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-76c913c9-6030-4a0e-80c8-66c72477133e.d3a9c53a-7754-4b48-a1a5-e17cabad5993" returned: 0 in 0.959s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:03:33 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-90324674-724c-4f9d-8ea6-7297dbee0a40 tempest-VolumesSnapshotTestJSON-35733676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-76c913c9-6030-4a0e-80c8-66c72477133e.d3a9c53a-7754-4b48-a1a5-e17cabad5993 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:03:33 devstack sudo[106049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-76c913c9-6030-4a0e-80c8-66c72477133e.d3a9c53a-7754-4b48-a1a5-e17cabad5993
Jun 15 16:03:33 devstack sudo[106049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:03:34 devstack sudo[106049]: pam_unix(sudo:session): session closed for user root
Jun 15 16:03:34 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-90324674-724c-4f9d-8ea6-7297dbee0a40 tempest-VolumesSnapshotTestJSON-35733676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-76c913c9-6030-4a0e-80c8-66c72477133e.d3a9c53a-7754-4b48-a1a5-e17cabad5993" returned: 0 in 0.632s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:03:34 devstack cinder-volume[91863]: DEBUG dbcounter [-] [91863] Writing DB stats cinder:UPDATE=114,cinder:INSERT=41,cinder:SELECT=92,cinder:DELETE=11 {{(pid=91863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 16:03:34 devstack cinder-volume[91863]: DEBUG dbcounter [-] [91863] Writing DB stats cinder:SELECT=101,cinder:UPDATE=115,cinder:INSERT=31,cinder:DELETE=10 {{(pid=91863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 16:03:34 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-90324674-724c-4f9d-8ea6-7297dbee0a40 tempest-VolumesSnapshotTestJSON-35733676 None] Lock "cinder-quobyte-d3a9c53a-7754-4b48-a1a5-e17cabad5993" released by "_delete_snapshot" :: held 3.640s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:03:34 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-90324674-724c-4f9d-8ea6-7297dbee0a40 tempest-VolumesSnapshotTestJSON-35733676 None] Lock "cinder-quobyte-76c913c9-6030-4a0e-80c8-66c72477133e" released by "delete_snapshot" :: held 3.682s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:03:34 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-90324674-724c-4f9d-8ea6-7297dbee0a40 tempest-VolumesSnapshotTestJSON-35733676 None] Created reservations ['7c1169b0-112b-458e-93f5-4e28634f6ca9', 'a6c544f0-3a90-4cd7-926a-b515fa092d44', '491deb9f-4e87-4a2c-8802-fc2e93198138', '8e7ed790-4a8a-4a37-a558-226b017973c6'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 16:03:34 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-90324674-724c-4f9d-8ea6-7297dbee0a40 tempest-VolumesSnapshotTestJSON-35733676 None] Delete snapshot completed successfully.
Jun 15 16:03:34 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-90324674-724c-4f9d-8ea6-7297dbee0a40 tempest-VolumesSnapshotTestJSON-35733676 None] Lock "cinder-d3a9c53a-7754-4b48-a1a5-e17cabad5993-delete_snapshot" released by "delete_snapshot" :: held 3.917s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:03:35 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-32790422-4780-48f6-991e-e3aa8a79c371 tempest-VolumesSnapshotTestJSON-35733676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 16:03:35 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-32790422-4780-48f6-991e-e3aa8a79c371 tempest-VolumesSnapshotTestJSON-35733676 None] Flow 'volume_create_manager' (b4650e0a-1d77-43a1-9f0c-9b58f9a4519c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:03:35 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-32790422-4780-48f6-991e-e3aa8a79c371 tempest-VolumesSnapshotTestJSON-35733676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e131a3a-bb05-4595-aa07-0d8be926d838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:03:35 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-32790422-4780-48f6-991e-e3aa8a79c371 tempest-VolumesSnapshotTestJSON-35733676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e131a3a-bb05-4595-aa07-0d8be926d838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:03:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1167929744',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0851290-2854-4346-b71d-7a936dec4fa0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f573920ba84746b3a4b936f5c5af18d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:03:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:03:35Z,use_quota=True,user_id='a5748e74c6b14c5095a8e36fe2ab7316',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:03:35 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-32790422-4780-48f6-991e-e3aa8a79c371 tempest-VolumesSnapshotTestJSON-35733676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e73ffac9-bff6-4956-b4ab-b1aa6d9e380d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:03:35 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-32790422-4780-48f6-991e-e3aa8a79c371 tempest-VolumesSnapshotTestJSON-35733676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e73ffac9-bff6-4956-b4ab-b1aa6d9e380d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:03:35 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-32790422-4780-48f6-991e-e3aa8a79c371 tempest-VolumesSnapshotTestJSON-35733676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b4c0d85-e6b2-40e3-87e5-538060cf6dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:03:35 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-32790422-4780-48f6-991e-e3aa8a79c371 tempest-VolumesSnapshotTestJSON-35733676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b4c0d85-e6b2-40e3-87e5-538060cf6dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0851290-2854-4346-b71d-7a936dec4fa0', 'volume_name': 'volume-e0851290-2854-4346-b71d-7a936dec4fa0', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:03:35 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-32790422-4780-48f6-991e-e3aa8a79c371 tempest-VolumesSnapshotTestJSON-35733676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bc784e4-28ae-4e74-9d60-aff790ebd984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:03:35 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-32790422-4780-48f6-991e-e3aa8a79c371 tempest-VolumesSnapshotTestJSON-35733676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bc784e4-28ae-4e74-9d60-aff790ebd984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:03:35 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-32790422-4780-48f6-991e-e3aa8a79c371 tempest-VolumesSnapshotTestJSON-35733676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (080637ce-8cd6-464b-8f8c-9180f1b43244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:03:35 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-32790422-4780-48f6-991e-e3aa8a79c371 tempest-VolumesSnapshotTestJSON-35733676 None] Volume e0851290-2854-4346-b71d-7a936dec4fa0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0851290-2854-4346-b71d-7a936dec4fa0', 'volume_size': 1}
Jun 15 16:03:35 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-32790422-4780-48f6-991e-e3aa8a79c371 tempest-VolumesSnapshotTestJSON-35733676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:03:35 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-32790422-4780-48f6-991e-e3aa8a79c371 tempest-VolumesSnapshotTestJSON-35733676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:03:35 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-32790422-4780-48f6-991e-e3aa8a79c371 tempest-VolumesSnapshotTestJSON-35733676 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:03:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1167929744',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0851290-2854-4346-b71d-7a936dec4fa0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f573920ba84746b3a4b936f5c5af18d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:03:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:03:35Z,use_quota=True,user_id='a5748e74c6b14c5095a8e36fe2ab7316',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 16:03:35 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-32790422-4780-48f6-991e-e3aa8a79c371 tempest-VolumesSnapshotTestJSON-35733676 None] Creating volume e0851290-2854-4346-b71d-7a936dec4fa0 {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 16:03:35 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-32790422-4780-48f6-991e-e3aa8a79c371 tempest-VolumesSnapshotTestJSON-35733676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:03:35 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-32790422-4780-48f6-991e-e3aa8a79c371 tempest-VolumesSnapshotTestJSON-35733676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:03:35 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-32790422-4780-48f6-991e-e3aa8a79c371 tempest-VolumesSnapshotTestJSON-35733676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:03:35 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-32790422-4780-48f6-991e-e3aa8a79c371 tempest-VolumesSnapshotTestJSON-35733676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:03:35 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-32790422-4780-48f6-991e-e3aa8a79c371 tempest-VolumesSnapshotTestJSON-35733676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:03:35 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-32790422-4780-48f6-991e-e3aa8a79c371 tempest-VolumesSnapshotTestJSON-35733676 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 16:03:35 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-32790422-4780-48f6-991e-e3aa8a79c371 tempest-VolumesSnapshotTestJSON-35733676 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 16:03:35 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-32790422-4780-48f6-991e-e3aa8a79c371 tempest-VolumesSnapshotTestJSON-35733676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e0851290-2854-4346-b71d-7a936dec4fa0 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:03:35 devstack sudo[106053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e0851290-2854-4346-b71d-7a936dec4fa0 1073741824
Jun 15 16:03:35 devstack sudo[106053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:03:36 devstack sudo[106053]: pam_unix(sudo:session): session closed for user root
Jun 15 16:03:36 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-32790422-4780-48f6-991e-e3aa8a79c371 tempest-VolumesSnapshotTestJSON-35733676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e0851290-2854-4346-b71d-7a936dec4fa0 1073741824" returned: 0 in 0.983s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:03:36 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-32790422-4780-48f6-991e-e3aa8a79c371 tempest-VolumesSnapshotTestJSON-35733676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e0851290-2854-4346-b71d-7a936dec4fa0 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:03:36 devstack sudo[106059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e0851290-2854-4346-b71d-7a936dec4fa0
Jun 15 16:03:36 devstack sudo[106059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:03:37 devstack sudo[106059]: pam_unix(sudo:session): session closed for user root
Jun 15 16:03:37 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-32790422-4780-48f6-991e-e3aa8a79c371 tempest-VolumesSnapshotTestJSON-35733676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e0851290-2854-4346-b71d-7a936dec4fa0" returned: 0 in 0.726s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:03:37 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-32790422-4780-48f6-991e-e3aa8a79c371 tempest-VolumesSnapshotTestJSON-35733676 None] <== create_volume: return (1759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 16:03:37 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-32790422-4780-48f6-991e-e3aa8a79c371 tempest-VolumesSnapshotTestJSON-35733676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.763s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:03:37 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-32790422-4780-48f6-991e-e3aa8a79c371 tempest-VolumesSnapshotTestJSON-35733676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (080637ce-8cd6-464b-8f8c-9180f1b43244) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0851290-2854-4346-b71d-7a936dec4fa0', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:03:37 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-32790422-4780-48f6-991e-e3aa8a79c371 tempest-VolumesSnapshotTestJSON-35733676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (657ecf5f-fb53-4e29-bf3c-d8bb235a453b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:03:37 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-32790422-4780-48f6-991e-e3aa8a79c371 tempest-VolumesSnapshotTestJSON-35733676 None] Volume volume-e0851290-2854-4346-b71d-7a936dec4fa0 (e0851290-2854-4346-b71d-7a936dec4fa0): created successfully
Jun 15 16:03:37 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-32790422-4780-48f6-991e-e3aa8a79c371 tempest-VolumesSnapshotTestJSON-35733676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (657ecf5f-fb53-4e29-bf3c-d8bb235a453b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:03:37 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-32790422-4780-48f6-991e-e3aa8a79c371 tempest-VolumesSnapshotTestJSON-35733676 None] Flow 'volume_create_manager' (b4650e0a-1d77-43a1-9f0c-9b58f9a4519c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:03:37 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-32790422-4780-48f6-991e-e3aa8a79c371 tempest-VolumesSnapshotTestJSON-35733676 None] Created volume successfully.
Jun 15 16:03:37 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-dea9e9e0-0b29-483d-97a6-8ba9d838c5c4 tempest-VolumesSnapshotTestJSON-35733676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:03:37 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-dea9e9e0-0b29-483d-97a6-8ba9d838c5c4 tempest-VolumesSnapshotTestJSON-35733676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:03:37 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-dea9e9e0-0b29-483d-97a6-8ba9d838c5c4 tempest-VolumesSnapshotTestJSON-35733676 None] Creating offline snapshot 7c5d0382-5534-48e5-9ecf-39328edacb67 of volume e0851290-2854-4346-b71d-7a936dec4fa0 {{(pid=91863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 15 16:03:37 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab1c151-1ccc-456b-98a0-18fcb4296d11]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:03:37 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-dea9e9e0-0b29-483d-97a6-8ba9d838c5c4 tempest-VolumesSnapshotTestJSON-35733676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e0851290-2854-4346-b71d-7a936dec4fa0 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:03:37 devstack sudo[106098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e0851290-2854-4346-b71d-7a936dec4fa0
Jun 15 16:03:37 devstack sudo[106098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:03:38 devstack sudo[106098]: pam_unix(sudo:session): session closed for user root
Jun 15 16:03:38 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-dea9e9e0-0b29-483d-97a6-8ba9d838c5c4 tempest-VolumesSnapshotTestJSON-35733676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e0851290-2854-4346-b71d-7a936dec4fa0" returned: 0 in 0.950s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:03:38 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-dea9e9e0-0b29-483d-97a6-8ba9d838c5c4 tempest-VolumesSnapshotTestJSON-35733676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e0851290-2854-4346-b71d-7a936dec4fa0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e0851290-2854-4346-b71d-7a936dec4fa0.7c5d0382-5534-48e5-9ecf-39328edacb67 1G {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:03:38 devstack sudo[106103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e0851290-2854-4346-b71d-7a936dec4fa0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e0851290-2854-4346-b71d-7a936dec4fa0.7c5d0382-5534-48e5-9ecf-39328edacb67 1G
Jun 15 16:03:38 devstack sudo[106103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:03:39 devstack sudo[106103]: pam_unix(sudo:session): session closed for user root
Jun 15 16:03:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-dea9e9e0-0b29-483d-97a6-8ba9d838c5c4 tempest-VolumesSnapshotTestJSON-35733676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e0851290-2854-4346-b71d-7a936dec4fa0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e0851290-2854-4346-b71d-7a936dec4fa0.7c5d0382-5534-48e5-9ecf-39328edacb67 1G" returned: 0 in 1.021s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:03:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-dea9e9e0-0b29-483d-97a6-8ba9d838c5c4 tempest-VolumesSnapshotTestJSON-35733676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0851290-2854-4346-b71d-7a936dec4fa0 -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e0851290-2854-4346-b71d-7a936dec4fa0.7c5d0382-5534-48e5-9ecf-39328edacb67 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:03:39 devstack sudo[106123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0851290-2854-4346-b71d-7a936dec4fa0 -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e0851290-2854-4346-b71d-7a936dec4fa0.7c5d0382-5534-48e5-9ecf-39328edacb67
Jun 15 16:03:39 devstack sudo[106123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:03:40 devstack sudo[106123]: pam_unix(sudo:session): session closed for user root
Jun 15 16:03:40 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-dea9e9e0-0b29-483d-97a6-8ba9d838c5c4 tempest-VolumesSnapshotTestJSON-35733676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0851290-2854-4346-b71d-7a936dec4fa0 -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e0851290-2854-4346-b71d-7a936dec4fa0.7c5d0382-5534-48e5-9ecf-39328edacb67" returned: 0 in 0.853s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:03:40 devstack cinder-volume[91863]: WARNING cinder.volume.drivers.remotefs [None req-dea9e9e0-0b29-483d-97a6-8ba9d838c5c4 tempest-VolumesSnapshotTestJSON-35733676 None] /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e0851290-2854-4346-b71d-7a936dec4fa0.7c5d0382-5534-48e5-9ecf-39328edacb67 is being set with open permissions: ugo+rw
Jun 15 16:03:40 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-dea9e9e0-0b29-483d-97a6-8ba9d838c5c4 tempest-VolumesSnapshotTestJSON-35733676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e0851290-2854-4346-b71d-7a936dec4fa0.7c5d0382-5534-48e5-9ecf-39328edacb67 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:03:40 devstack sudo[106133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e0851290-2854-4346-b71d-7a936dec4fa0.7c5d0382-5534-48e5-9ecf-39328edacb67
Jun 15 16:03:40 devstack sudo[106133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:03:41 devstack sudo[106133]: pam_unix(sudo:session): session closed for user root
Jun 15 16:03:41 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-dea9e9e0-0b29-483d-97a6-8ba9d838c5c4 tempest-VolumesSnapshotTestJSON-35733676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e0851290-2854-4346-b71d-7a936dec4fa0.7c5d0382-5534-48e5-9ecf-39328edacb67" returned: 0 in 0.665s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:03:41 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-dea9e9e0-0b29-483d-97a6-8ba9d838c5c4 tempest-VolumesSnapshotTestJSON-35733676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e0851290-2854-4346-b71d-7a936dec4fa0.info {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:03:41 devstack sudo[106137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e0851290-2854-4346-b71d-7a936dec4fa0.info
Jun 15 16:03:41 devstack sudo[106137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:03:41 devstack sudo[106137]: pam_unix(sudo:session): session closed for user root
Jun 15 16:03:41 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-dea9e9e0-0b29-483d-97a6-8ba9d838c5c4 tempest-VolumesSnapshotTestJSON-35733676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e0851290-2854-4346-b71d-7a936dec4fa0.info" returned: 0 in 0.658s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:03:41 devstack cinder-volume[91863]: WARNING cinder.volume.drivers.remotefs [None req-dea9e9e0-0b29-483d-97a6-8ba9d838c5c4 tempest-VolumesSnapshotTestJSON-35733676 None] /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e0851290-2854-4346-b71d-7a936dec4fa0.info is being set with open permissions: ugo+rw
Jun 15 16:03:41 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-dea9e9e0-0b29-483d-97a6-8ba9d838c5c4 tempest-VolumesSnapshotTestJSON-35733676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e0851290-2854-4346-b71d-7a936dec4fa0.info {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:03:41 devstack sudo[106140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e0851290-2854-4346-b71d-7a936dec4fa0.info
Jun 15 16:03:41 devstack sudo[106140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:03:42 devstack sudo[106140]: pam_unix(sudo:session): session closed for user root
Jun 15 16:03:42 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-dea9e9e0-0b29-483d-97a6-8ba9d838c5c4 tempest-VolumesSnapshotTestJSON-35733676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e0851290-2854-4346-b71d-7a936dec4fa0.info" returned: 0 in 0.702s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:03:42 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-dea9e9e0-0b29-483d-97a6-8ba9d838c5c4 tempest-VolumesSnapshotTestJSON-35733676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.019s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:03:42 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-dea9e9e0-0b29-483d-97a6-8ba9d838c5c4 tempest-VolumesSnapshotTestJSON-35733676 None] Create snapshot completed successfully
Jun 15 16:03:43 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-baeeadbe-42b5-401c-a488-b300243ae006 tempest-VolumesSnapshotTestJSON-35733676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 16:03:43 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-baeeadbe-42b5-401c-a488-b300243ae006 tempest-VolumesSnapshotTestJSON-35733676 None] Flow 'volume_create_manager' (2be5745d-7c3b-4d56-99f9-0594ac5f714d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:03:43 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-baeeadbe-42b5-401c-a488-b300243ae006 tempest-VolumesSnapshotTestJSON-35733676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85c72743-14e6-4fe7-9959-49dd05a12ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:03:43 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-baeeadbe-42b5-401c-a488-b300243ae006 tempest-VolumesSnapshotTestJSON-35733676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85c72743-14e6-4fe7-9959-49dd05a12ff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:03:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-517366004',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e962a4e9-3d4c-4be4-b1d4-3f3f0543bbc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f573920ba84746b3a4b936f5c5af18d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:03:43Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=7c5d0382-5534-48e5-9ecf-39328edacb67,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:03:43Z,use_quota=True,user_id='a5748e74c6b14c5095a8e36fe2ab7316',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:03:43 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-baeeadbe-42b5-401c-a488-b300243ae006 tempest-VolumesSnapshotTestJSON-35733676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8f589a7-ccfb-40e5-8924-3880f5301f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:03:43 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-baeeadbe-42b5-401c-a488-b300243ae006 tempest-VolumesSnapshotTestJSON-35733676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8f589a7-ccfb-40e5-8924-3880f5301f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:03:43 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-baeeadbe-42b5-401c-a488-b300243ae006 tempest-VolumesSnapshotTestJSON-35733676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f761b9f8-ce33-4a89-99f5-ed1f3f630153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:03:43 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-baeeadbe-42b5-401c-a488-b300243ae006 tempest-VolumesSnapshotTestJSON-35733676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f761b9f8-ce33-4a89-99f5-ed1f3f630153) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e962a4e9-3d4c-4be4-b1d4-3f3f0543bbc7', 'volume_name': 'volume-e962a4e9-3d4c-4be4-b1d4-3f3f0543bbc7', 'volume_size': 2, 'snapshot_id': '7c5d0382-5534-48e5-9ecf-39328edacb67'}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:03:43 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-baeeadbe-42b5-401c-a488-b300243ae006 tempest-VolumesSnapshotTestJSON-35733676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6ec0295-6dc3-4e1a-ab60-514fa887cd49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:03:43 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-baeeadbe-42b5-401c-a488-b300243ae006 tempest-VolumesSnapshotTestJSON-35733676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6ec0295-6dc3-4e1a-ab60-514fa887cd49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:03:43 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-baeeadbe-42b5-401c-a488-b300243ae006 tempest-VolumesSnapshotTestJSON-35733676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccec7291-9309-48c5-a1ca-0c4f62ced087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:03:43 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-baeeadbe-42b5-401c-a488-b300243ae006 tempest-VolumesSnapshotTestJSON-35733676 None] Volume e962a4e9-3d4c-4be4-b1d4-3f3f0543bbc7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e962a4e9-3d4c-4be4-b1d4-3f3f0543bbc7', 'volume_size': 2, 'snapshot_id': '7c5d0382-5534-48e5-9ecf-39328edacb67'}
Jun 15 16:03:43 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-baeeadbe-42b5-401c-a488-b300243ae006 tempest-VolumesSnapshotTestJSON-35733676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:03:43 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-baeeadbe-42b5-401c-a488-b300243ae006 tempest-VolumesSnapshotTestJSON-35733676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:03:43 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-baeeadbe-42b5-401c-a488-b300243ae006 tempest-VolumesSnapshotTestJSON-35733676 None] Acquiring lock "cinder-quobyte-7c5d0382-5534-48e5-9ecf-39328edacb67-e962a4e9-3d4c-4be4-b1d4-3f3f0543bbc7" by "_create_volume_from_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:03:43 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-baeeadbe-42b5-401c-a488-b300243ae006 tempest-VolumesSnapshotTestJSON-35733676 None] Lock "cinder-quobyte-7c5d0382-5534-48e5-9ecf-39328edacb67-e962a4e9-3d4c-4be4-b1d4-3f3f0543bbc7" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:03:43 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-baeeadbe-42b5-401c-a488-b300243ae006 tempest-VolumesSnapshotTestJSON-35733676 None] Creating volume e962a4e9-3d4c-4be4-b1d4-3f3f0543bbc7 from snapshot 7c5d0382-5534-48e5-9ecf-39328edacb67 {{(pid=91863) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 15 16:03:43 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-baeeadbe-42b5-401c-a488-b300243ae006 tempest-VolumesSnapshotTestJSON-35733676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:03:43 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-baeeadbe-42b5-401c-a488-b300243ae006 tempest-VolumesSnapshotTestJSON-35733676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:03:43 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-baeeadbe-42b5-401c-a488-b300243ae006 tempest-VolumesSnapshotTestJSON-35733676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:03:43 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-baeeadbe-42b5-401c-a488-b300243ae006 tempest-VolumesSnapshotTestJSON-35733676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:03:43 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-baeeadbe-42b5-401c-a488-b300243ae006 tempest-VolumesSnapshotTestJSON-35733676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:03:43 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-baeeadbe-42b5-401c-a488-b300243ae006 tempest-VolumesSnapshotTestJSON-35733676 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 16:03:43 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-baeeadbe-42b5-401c-a488-b300243ae006 tempest-VolumesSnapshotTestJSON-35733676 None] Acquiring lock "cinder-quobyte-e962a4e9-3d4c-4be4-b1d4-3f3f0543bbc7" by "_copy_volume_from_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:03:43 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-baeeadbe-42b5-401c-a488-b300243ae006 tempest-VolumesSnapshotTestJSON-35733676 None] Lock "cinder-quobyte-e962a4e9-3d4c-4be4-b1d4-3f3f0543bbc7" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:03:43 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-baeeadbe-42b5-401c-a488-b300243ae006 tempest-VolumesSnapshotTestJSON-35733676 None] snapshot: 7c5d0382-5534-48e5-9ecf-39328edacb67, volume: e962a4e9-3d4c-4be4-b1d4-3f3f0543bbc7,  {{(pid=91863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 15 16:03:43 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-baeeadbe-42b5-401c-a488-b300243ae006 tempest-VolumesSnapshotTestJSON-35733676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:03:43 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-baeeadbe-42b5-401c-a488-b300243ae006 tempest-VolumesSnapshotTestJSON-35733676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:03:43 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-baeeadbe-42b5-401c-a488-b300243ae006 tempest-VolumesSnapshotTestJSON-35733676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:03:43 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-baeeadbe-42b5-401c-a488-b300243ae006 tempest-VolumesSnapshotTestJSON-35733676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:03:43 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-baeeadbe-42b5-401c-a488-b300243ae006 tempest-VolumesSnapshotTestJSON-35733676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:03:43 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d72960-3266-4f4c-90a8-36f669064e30]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:03:43 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-baeeadbe-42b5-401c-a488-b300243ae006 tempest-VolumesSnapshotTestJSON-35733676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e0851290-2854-4346-b71d-7a936dec4fa0.7c5d0382-5534-48e5-9ecf-39328edacb67 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:03:43 devstack sudo[106143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e0851290-2854-4346-b71d-7a936dec4fa0.7c5d0382-5534-48e5-9ecf-39328edacb67
Jun 15 16:03:43 devstack sudo[106143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:03:44 devstack sudo[106143]: pam_unix(sudo:session): session closed for user root
Jun 15 16:03:44 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-baeeadbe-42b5-401c-a488-b300243ae006 tempest-VolumesSnapshotTestJSON-35733676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e0851290-2854-4346-b71d-7a936dec4fa0.7c5d0382-5534-48e5-9ecf-39328edacb67" returned: 0 in 0.808s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:03:44 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-baeeadbe-42b5-401c-a488-b300243ae006 tempest-VolumesSnapshotTestJSON-35733676 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e0851290-2854-4346-b71d-7a936dec4fa0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 16:03:44 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-baeeadbe-42b5-401c-a488-b300243ae006 tempest-VolumesSnapshotTestJSON-35733676 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e0851290-2854-4346-b71d-7a936dec4fa0 {{(pid=91863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 15 16:03:44 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-baeeadbe-42b5-401c-a488-b300243ae006 tempest-VolumesSnapshotTestJSON-35733676 None] Creating direct copy from snapshot {{(pid=91863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 15 16:03:44 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fd6899c-dbad-4688-b041-adadde55e9c8]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:03:44 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-baeeadbe-42b5-401c-a488-b300243ae006 tempest-VolumesSnapshotTestJSON-35733676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e0851290-2854-4346-b71d-7a936dec4fa0 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:03:44 devstack sudo[106151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e0851290-2854-4346-b71d-7a936dec4fa0
Jun 15 16:03:44 devstack sudo[106151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:03:45 devstack sudo[106151]: pam_unix(sudo:session): session closed for user root
Jun 15 16:03:45 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-baeeadbe-42b5-401c-a488-b300243ae006 tempest-VolumesSnapshotTestJSON-35733676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e0851290-2854-4346-b71d-7a936dec4fa0" returned: 0 in 0.825s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:03:45 devstack cinder-volume[91863]: DEBUG cinder.utils [None req-baeeadbe-42b5-401c-a488-b300243ae006 tempest-VolumesSnapshotTestJSON-35733676 None] Path /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e962a4e9-3d4c-4be4-b1d4-3f3f0543bbc7 not found in is_blk_device check {{(pid=91863) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 15 16:03:45 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-baeeadbe-42b5-401c-a488-b300243ae006 tempest-VolumesSnapshotTestJSON-35733676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e0851290-2854-4346-b71d-7a936dec4fa0 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e962a4e9-3d4c-4be4-b1d4-3f3f0543bbc7 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:03:45 devstack sudo[106157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e0851290-2854-4346-b71d-7a936dec4fa0 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e962a4e9-3d4c-4be4-b1d4-3f3f0543bbc7
Jun 15 16:03:45 devstack sudo[106157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:03:49 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea62c356-57f8-4ff5-9f0e-84bed64ef0d4 tempest-SnapshotDependencyTests-1867067896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 16:03:49 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-ea62c356-57f8-4ff5-9f0e-84bed64ef0d4 tempest-SnapshotDependencyTests-1867067896 None] Flow 'volume_create_manager' (4ddbcd93-47b7-41ff-ad4d-edc46adc5a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:03:49 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-ea62c356-57f8-4ff5-9f0e-84bed64ef0d4 tempest-SnapshotDependencyTests-1867067896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a215fdb-fa31-4f17-9169-1886634a3b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:03:49 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-ea62c356-57f8-4ff5-9f0e-84bed64ef0d4 tempest-SnapshotDependencyTests-1867067896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a215fdb-fa31-4f17-9169-1886634a3b81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:03:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-748027583',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7b985d2-650f-4bce-8ba5-bfcf827cf7dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dc72fe22f54485db6a74667377ba0d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:03:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:03:49Z,use_quota=True,user_id='383951b41687430c822311b86754ed4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:03:49 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-ea62c356-57f8-4ff5-9f0e-84bed64ef0d4 tempest-SnapshotDependencyTests-1867067896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (312df3c1-8839-4546-a510-2ba2cada922a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:03:49 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-ea62c356-57f8-4ff5-9f0e-84bed64ef0d4 tempest-SnapshotDependencyTests-1867067896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (312df3c1-8839-4546-a510-2ba2cada922a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:03:49 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-ea62c356-57f8-4ff5-9f0e-84bed64ef0d4 tempest-SnapshotDependencyTests-1867067896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4cd246e-5077-4dd8-bcae-0efeb423d64c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:03:49 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-ea62c356-57f8-4ff5-9f0e-84bed64ef0d4 tempest-SnapshotDependencyTests-1867067896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4cd246e-5077-4dd8-bcae-0efeb423d64c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7b985d2-650f-4bce-8ba5-bfcf827cf7dd', 'volume_name': 'volume-b7b985d2-650f-4bce-8ba5-bfcf827cf7dd', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:03:49 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-ea62c356-57f8-4ff5-9f0e-84bed64ef0d4 tempest-SnapshotDependencyTests-1867067896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4eaec2b-4a2c-4d1d-96c0-baff8e6ebfbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:03:49 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-ea62c356-57f8-4ff5-9f0e-84bed64ef0d4 tempest-SnapshotDependencyTests-1867067896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4eaec2b-4a2c-4d1d-96c0-baff8e6ebfbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:03:49 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-ea62c356-57f8-4ff5-9f0e-84bed64ef0d4 tempest-SnapshotDependencyTests-1867067896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (471a47eb-dc28-4628-acf4-4dff8d7c5a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:03:49 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-ea62c356-57f8-4ff5-9f0e-84bed64ef0d4 tempest-SnapshotDependencyTests-1867067896 None] Volume b7b985d2-650f-4bce-8ba5-bfcf827cf7dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7b985d2-650f-4bce-8ba5-bfcf827cf7dd', 'volume_size': 1}
Jun 15 16:03:49 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-ea62c356-57f8-4ff5-9f0e-84bed64ef0d4 tempest-SnapshotDependencyTests-1867067896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:03:51 devstack sudo[106157]: pam_unix(sudo:session): session closed for user root
Jun 15 16:03:51 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-baeeadbe-42b5-401c-a488-b300243ae006 tempest-VolumesSnapshotTestJSON-35733676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e0851290-2854-4346-b71d-7a936dec4fa0 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e962a4e9-3d4c-4be4-b1d4-3f3f0543bbc7" returned: 0 in 5.857s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:03:51 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[83515584-239b-4a10-bb3f-2c299af562f9]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:03:51 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-baeeadbe-42b5-401c-a488-b300243ae006 tempest-VolumesSnapshotTestJSON-35733676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e0851290-2854-4346-b71d-7a936dec4fa0 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:03:51 devstack sudo[106234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e0851290-2854-4346-b71d-7a936dec4fa0
Jun 15 16:03:51 devstack sudo[106234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:03:52 devstack sudo[106234]: pam_unix(sudo:session): session closed for user root
Jun 15 16:03:52 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-baeeadbe-42b5-401c-a488-b300243ae006 tempest-VolumesSnapshotTestJSON-35733676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e0851290-2854-4346-b71d-7a936dec4fa0" returned: 0 in 0.940s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:03:52 devstack cinder-volume[91863]: DEBUG cinder.image.image_utils [None req-baeeadbe-42b5-401c-a488-b300243ae006 tempest-VolumesSnapshotTestJSON-35733676 None] Image conversion details: src /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e0851290-2854-4346-b71d-7a936dec4fa0, size 1024.00 MB, duration 5.86 sec, destination /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e962a4e9-3d4c-4be4-b1d4-3f3f0543bbc7 {{(pid=91863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 15 16:03:52 devstack cinder-volume[91863]: INFO cinder.image.image_utils [None req-baeeadbe-42b5-401c-a488-b300243ae006 tempest-VolumesSnapshotTestJSON-35733676 None] Converted 1024.00 MB image at 174.80 MB/s
Jun 15 16:03:52 devstack cinder-volume[91863]: WARNING cinder.volume.drivers.remotefs [None req-baeeadbe-42b5-401c-a488-b300243ae006 tempest-VolumesSnapshotTestJSON-35733676 None] /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e962a4e9-3d4c-4be4-b1d4-3f3f0543bbc7 is being set with open permissions: ugo+rw
Jun 15 16:03:52 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-baeeadbe-42b5-401c-a488-b300243ae006 tempest-VolumesSnapshotTestJSON-35733676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e962a4e9-3d4c-4be4-b1d4-3f3f0543bbc7 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:03:52 devstack sudo[106241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e962a4e9-3d4c-4be4-b1d4-3f3f0543bbc7
Jun 15 16:03:52 devstack sudo[106241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:03:53 devstack sudo[106241]: pam_unix(sudo:session): session closed for user root
Jun 15 16:03:53 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-baeeadbe-42b5-401c-a488-b300243ae006 tempest-VolumesSnapshotTestJSON-35733676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e962a4e9-3d4c-4be4-b1d4-3f3f0543bbc7" returned: 0 in 0.828s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:03:53 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-baeeadbe-42b5-401c-a488-b300243ae006 tempest-VolumesSnapshotTestJSON-35733676 None] Lock "cinder-quobyte-e962a4e9-3d4c-4be4-b1d4-3f3f0543bbc7" released by "_copy_volume_from_snapshot" :: held 9.371s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:03:53 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-baeeadbe-42b5-401c-a488-b300243ae006 tempest-VolumesSnapshotTestJSON-35733676 None] Lock "cinder-quobyte-7c5d0382-5534-48e5-9ecf-39328edacb67-e962a4e9-3d4c-4be4-b1d4-3f3f0543bbc7" released by "_create_volume_from_snapshot" :: held 9.410s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:03:53 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-baeeadbe-42b5-401c-a488-b300243ae006 tempest-VolumesSnapshotTestJSON-35733676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.427s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:03:53 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-ea62c356-57f8-4ff5-9f0e-84bed64ef0d4 tempest-SnapshotDependencyTests-1867067896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.695s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:03:53 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-ea62c356-57f8-4ff5-9f0e-84bed64ef0d4 tempest-SnapshotDependencyTests-1867067896 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:03:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-748027583',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7b985d2-650f-4bce-8ba5-bfcf827cf7dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dc72fe22f54485db6a74667377ba0d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:03:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:03:49Z,use_quota=True,user_id='383951b41687430c822311b86754ed4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 16:03:53 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-ea62c356-57f8-4ff5-9f0e-84bed64ef0d4 tempest-SnapshotDependencyTests-1867067896 None] Creating volume b7b985d2-650f-4bce-8ba5-bfcf827cf7dd {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 16:03:53 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-ea62c356-57f8-4ff5-9f0e-84bed64ef0d4 tempest-SnapshotDependencyTests-1867067896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:03:53 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-ea62c356-57f8-4ff5-9f0e-84bed64ef0d4 tempest-SnapshotDependencyTests-1867067896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:03:53 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-ea62c356-57f8-4ff5-9f0e-84bed64ef0d4 tempest-SnapshotDependencyTests-1867067896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:03:53 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-ea62c356-57f8-4ff5-9f0e-84bed64ef0d4 tempest-SnapshotDependencyTests-1867067896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:03:53 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-ea62c356-57f8-4ff5-9f0e-84bed64ef0d4 tempest-SnapshotDependencyTests-1867067896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:03:53 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-ea62c356-57f8-4ff5-9f0e-84bed64ef0d4 tempest-SnapshotDependencyTests-1867067896 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 16:03:53 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-ea62c356-57f8-4ff5-9f0e-84bed64ef0d4 tempest-SnapshotDependencyTests-1867067896 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 16:03:53 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ea62c356-57f8-4ff5-9f0e-84bed64ef0d4 tempest-SnapshotDependencyTests-1867067896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b7b985d2-650f-4bce-8ba5-bfcf827cf7dd 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:03:53 devstack sudo[106245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b7b985d2-650f-4bce-8ba5-bfcf827cf7dd 1073741824
Jun 15 16:03:53 devstack sudo[106245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:03:53 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-baeeadbe-42b5-401c-a488-b300243ae006 tempest-VolumesSnapshotTestJSON-35733676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccec7291-9309-48c5-a1ca-0c4f62ced087) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e962a4e9-3d4c-4be4-b1d4-3f3f0543bbc7', 'volume_size': 2, 'snapshot_id': '7c5d0382-5534-48e5-9ecf-39328edacb67'}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:03:53 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-baeeadbe-42b5-401c-a488-b300243ae006 tempest-VolumesSnapshotTestJSON-35733676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44368d60-de77-4117-bf8a-7b8813f98edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:03:53 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-baeeadbe-42b5-401c-a488-b300243ae006 tempest-VolumesSnapshotTestJSON-35733676 None] Volume volume-e962a4e9-3d4c-4be4-b1d4-3f3f0543bbc7 (e962a4e9-3d4c-4be4-b1d4-3f3f0543bbc7): created successfully
Jun 15 16:03:53 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-baeeadbe-42b5-401c-a488-b300243ae006 tempest-VolumesSnapshotTestJSON-35733676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44368d60-de77-4117-bf8a-7b8813f98edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:03:53 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-baeeadbe-42b5-401c-a488-b300243ae006 tempest-VolumesSnapshotTestJSON-35733676 None] Flow 'volume_create_manager' (2be5745d-7c3b-4d56-99f9-0594ac5f714d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:03:53 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-baeeadbe-42b5-401c-a488-b300243ae006 tempest-VolumesSnapshotTestJSON-35733676 None] Created volume successfully.
Jun 15 16:03:53 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-1787494f-443f-4062-8ad9-01af55c4d4cc tempest-VolumesSnapshotTestJSON-35733676 None] Acquiring lock "cinder-e962a4e9-3d4c-4be4-b1d4-3f3f0543bbc7-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:03:53 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-1787494f-443f-4062-8ad9-01af55c4d4cc tempest-VolumesSnapshotTestJSON-35733676 None] Lock "cinder-e962a4e9-3d4c-4be4-b1d4-3f3f0543bbc7-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:03:53 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-1787494f-443f-4062-8ad9-01af55c4d4cc tempest-VolumesSnapshotTestJSON-35733676 None] Acquiring lock "cinder-quobyte-e962a4e9-3d4c-4be4-b1d4-3f3f0543bbc7" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:03:53 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-1787494f-443f-4062-8ad9-01af55c4d4cc tempest-VolumesSnapshotTestJSON-35733676 None] Lock "cinder-quobyte-e962a4e9-3d4c-4be4-b1d4-3f3f0543bbc7" acquired by "delete_volume" :: waited 0.023s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:03:53 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b70cee-41f5-4d7c-9f80-bd7c62f3c4cc]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:03:53 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-1787494f-443f-4062-8ad9-01af55c4d4cc tempest-VolumesSnapshotTestJSON-35733676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e962a4e9-3d4c-4be4-b1d4-3f3f0543bbc7 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:03:53 devstack sudo[106250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e962a4e9-3d4c-4be4-b1d4-3f3f0543bbc7
Jun 15 16:03:53 devstack sudo[106250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:03:54 devstack sudo[106245]: pam_unix(sudo:session): session closed for user root
Jun 15 16:03:54 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ea62c356-57f8-4ff5-9f0e-84bed64ef0d4 tempest-SnapshotDependencyTests-1867067896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b7b985d2-650f-4bce-8ba5-bfcf827cf7dd 1073741824" returned: 0 in 1.057s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:03:54 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ea62c356-57f8-4ff5-9f0e-84bed64ef0d4 tempest-SnapshotDependencyTests-1867067896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b7b985d2-650f-4bce-8ba5-bfcf827cf7dd {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:03:54 devstack sudo[106252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b7b985d2-650f-4bce-8ba5-bfcf827cf7dd
Jun 15 16:03:54 devstack sudo[106252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:03:54 devstack sudo[106250]: pam_unix(sudo:session): session closed for user root
Jun 15 16:03:54 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-1787494f-443f-4062-8ad9-01af55c4d4cc tempest-VolumesSnapshotTestJSON-35733676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e962a4e9-3d4c-4be4-b1d4-3f3f0543bbc7" returned: 0 in 1.053s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:03:54 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-1787494f-443f-4062-8ad9-01af55c4d4cc tempest-VolumesSnapshotTestJSON-35733676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e962a4e9-3d4c-4be4-b1d4-3f3f0543bbc7 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:03:54 devstack sudo[106258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e962a4e9-3d4c-4be4-b1d4-3f3f0543bbc7
Jun 15 16:03:54 devstack sudo[106258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:03:55 devstack sudo[106252]: pam_unix(sudo:session): session closed for user root
Jun 15 16:03:55 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ea62c356-57f8-4ff5-9f0e-84bed64ef0d4 tempest-SnapshotDependencyTests-1867067896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b7b985d2-650f-4bce-8ba5-bfcf827cf7dd" returned: 0 in 0.817s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:03:55 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-ea62c356-57f8-4ff5-9f0e-84bed64ef0d4 tempest-SnapshotDependencyTests-1867067896 None] <== create_volume: return (1930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 16:03:55 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-ea62c356-57f8-4ff5-9f0e-84bed64ef0d4 tempest-SnapshotDependencyTests-1867067896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.933s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:03:55 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-ea62c356-57f8-4ff5-9f0e-84bed64ef0d4 tempest-SnapshotDependencyTests-1867067896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (471a47eb-dc28-4628-acf4-4dff8d7c5a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7b985d2-650f-4bce-8ba5-bfcf827cf7dd', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:03:55 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-ea62c356-57f8-4ff5-9f0e-84bed64ef0d4 tempest-SnapshotDependencyTests-1867067896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a00fca4-930f-42ed-a0a3-82b4721fcb7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:03:55 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-ea62c356-57f8-4ff5-9f0e-84bed64ef0d4 tempest-SnapshotDependencyTests-1867067896 None] Volume volume-b7b985d2-650f-4bce-8ba5-bfcf827cf7dd (b7b985d2-650f-4bce-8ba5-bfcf827cf7dd): created successfully
Jun 15 16:03:55 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-ea62c356-57f8-4ff5-9f0e-84bed64ef0d4 tempest-SnapshotDependencyTests-1867067896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a00fca4-930f-42ed-a0a3-82b4721fcb7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:03:55 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-ea62c356-57f8-4ff5-9f0e-84bed64ef0d4 tempest-SnapshotDependencyTests-1867067896 None] Flow 'volume_create_manager' (4ddbcd93-47b7-41ff-ad4d-edc46adc5a05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:03:55 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-ea62c356-57f8-4ff5-9f0e-84bed64ef0d4 tempest-SnapshotDependencyTests-1867067896 None] Created volume successfully.
Jun 15 16:03:55 devstack sudo[106258]: pam_unix(sudo:session): session closed for user root
Jun 15 16:03:55 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-1787494f-443f-4062-8ad9-01af55c4d4cc tempest-VolumesSnapshotTestJSON-35733676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e962a4e9-3d4c-4be4-b1d4-3f3f0543bbc7" returned: 0 in 0.595s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:03:55 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-1787494f-443f-4062-8ad9-01af55c4d4cc tempest-VolumesSnapshotTestJSON-35733676 None] Lock "cinder-quobyte-e962a4e9-3d4c-4be4-b1d4-3f3f0543bbc7" released by "delete_volume" :: held 1.717s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:03:55 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-1787494f-443f-4062-8ad9-01af55c4d4cc tempest-VolumesSnapshotTestJSON-35733676 None] Created reservations ['a19a0eb8-a1c6-45ac-804f-cc09514b324b', '3ec32ae5-e582-441a-a9a7-031ffa6ae594', '4afb47e1-0624-45f1-91b4-7025df370db4', 'ae990121-38e3-4788-85d8-ea79dcdf800f'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 16:03:55 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-1787494f-443f-4062-8ad9-01af55c4d4cc tempest-VolumesSnapshotTestJSON-35733676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:03:55 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-1787494f-443f-4062-8ad9-01af55c4d4cc tempest-VolumesSnapshotTestJSON-35733676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:03:55 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-1787494f-443f-4062-8ad9-01af55c4d4cc tempest-VolumesSnapshotTestJSON-35733676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:03:55 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-1787494f-443f-4062-8ad9-01af55c4d4cc tempest-VolumesSnapshotTestJSON-35733676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:03:55 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-1787494f-443f-4062-8ad9-01af55c4d4cc tempest-VolumesSnapshotTestJSON-35733676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:03:55 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-1787494f-443f-4062-8ad9-01af55c4d4cc tempest-VolumesSnapshotTestJSON-35733676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:03:55 devstack sudo[106297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 16:03:55 devstack sudo[106297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:03:56 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-71cb0ceb-3cb8-4773-bb61-6e4a3d111a4e tempest-VolumesSnapshotTestJSON-35733676 None] Acquiring lock "cinder-7c5d0382-5534-48e5-9ecf-39328edacb67-delete_snapshot" by "delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:03:56 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-450b2eca-5c92-4954-99c8-f93d7319d54e tempest-SnapshotDependencyTests-1867067896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:03:56 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-450b2eca-5c92-4954-99c8-f93d7319d54e tempest-SnapshotDependencyTests-1867067896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:03:56 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-71cb0ceb-3cb8-4773-bb61-6e4a3d111a4e tempest-VolumesSnapshotTestJSON-35733676 None] Lock "cinder-7c5d0382-5534-48e5-9ecf-39328edacb67-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:03:56 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-71cb0ceb-3cb8-4773-bb61-6e4a3d111a4e tempest-VolumesSnapshotTestJSON-35733676 None] Acquiring lock "cinder-quobyte-e0851290-2854-4346-b71d-7a936dec4fa0" by "delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:03:56 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-450b2eca-5c92-4954-99c8-f93d7319d54e tempest-SnapshotDependencyTests-1867067896 None] Creating offline snapshot cfb1b771-763e-4707-b0b4-7741cd84ff84 of volume b7b985d2-650f-4bce-8ba5-bfcf827cf7dd {{(pid=91863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 15 16:03:56 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-71cb0ceb-3cb8-4773-bb61-6e4a3d111a4e tempest-VolumesSnapshotTestJSON-35733676 None] Lock "cinder-quobyte-e0851290-2854-4346-b71d-7a936dec4fa0" acquired by "delete_snapshot" :: waited 0.052s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:03:56 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-71cb0ceb-3cb8-4773-bb61-6e4a3d111a4e tempest-VolumesSnapshotTestJSON-35733676 None] Acquiring lock "cinder-quobyte-7c5d0382-5534-48e5-9ecf-39328edacb67" by "_delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:03:56 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d04eb9-601e-409a-8860-6276fdd6ff7d]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:03:56 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-450b2eca-5c92-4954-99c8-f93d7319d54e tempest-SnapshotDependencyTests-1867067896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b7b985d2-650f-4bce-8ba5-bfcf827cf7dd {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:03:56 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-71cb0ceb-3cb8-4773-bb61-6e4a3d111a4e tempest-VolumesSnapshotTestJSON-35733676 None] Lock "cinder-quobyte-7c5d0382-5534-48e5-9ecf-39328edacb67" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:03:56 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-71cb0ceb-3cb8-4773-bb61-6e4a3d111a4e tempest-VolumesSnapshotTestJSON-35733676 None] Deleting offline snapshot 7c5d0382-5534-48e5-9ecf-39328edacb67 of volume e0851290-2854-4346-b71d-7a936dec4fa0 {{(pid=91863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 15 16:03:56 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-71cb0ceb-3cb8-4773-bb61-6e4a3d111a4e tempest-VolumesSnapshotTestJSON-35733676 None] snapshot_file for this snap is: volume-e0851290-2854-4346-b71d-7a936dec4fa0.7c5d0382-5534-48e5-9ecf-39328edacb67 {{(pid=91863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 15 16:03:56 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f63eb2a-c689-4134-9aa8-0276092330a3]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:03:56 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-71cb0ceb-3cb8-4773-bb61-6e4a3d111a4e tempest-VolumesSnapshotTestJSON-35733676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e0851290-2854-4346-b71d-7a936dec4fa0.7c5d0382-5534-48e5-9ecf-39328edacb67 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:03:56 devstack sudo[106302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b7b985d2-650f-4bce-8ba5-bfcf827cf7dd
Jun 15 16:03:56 devstack sudo[106302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:03:56 devstack sudo[106303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e0851290-2854-4346-b71d-7a936dec4fa0.7c5d0382-5534-48e5-9ecf-39328edacb67
Jun 15 16:03:56 devstack sudo[106303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:03:56 devstack sudo[106297]: pam_unix(sudo:session): session closed for user root
Jun 15 16:03:56 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-1787494f-443f-4062-8ad9-01af55c4d4cc tempest-VolumesSnapshotTestJSON-35733676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.883s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:03:56 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-1787494f-443f-4062-8ad9-01af55c4d4cc tempest-VolumesSnapshotTestJSON-35733676 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 16:03:56 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-1787494f-443f-4062-8ad9-01af55c4d4cc tempest-VolumesSnapshotTestJSON-35733676 None] Deleted volume successfully.
Jun 15 16:03:56 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-1787494f-443f-4062-8ad9-01af55c4d4cc tempest-VolumesSnapshotTestJSON-35733676 None] Lock "cinder-e962a4e9-3d4c-4be4-b1d4-3f3f0543bbc7-delete_volume" released by "delete_volume" :: held 2.979s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:03:57 devstack sudo[106302]: pam_unix(sudo:session): session closed for user root
Jun 15 16:03:57 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-450b2eca-5c92-4954-99c8-f93d7319d54e tempest-SnapshotDependencyTests-1867067896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b7b985d2-650f-4bce-8ba5-bfcf827cf7dd" returned: 0 in 0.839s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:03:57 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-450b2eca-5c92-4954-99c8-f93d7319d54e tempest-SnapshotDependencyTests-1867067896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b7b985d2-650f-4bce-8ba5-bfcf827cf7dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b7b985d2-650f-4bce-8ba5-bfcf827cf7dd.cfb1b771-763e-4707-b0b4-7741cd84ff84 1G {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:03:57 devstack sudo[106303]: pam_unix(sudo:session): session closed for user root
Jun 15 16:03:57 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-71cb0ceb-3cb8-4773-bb61-6e4a3d111a4e tempest-VolumesSnapshotTestJSON-35733676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e0851290-2854-4346-b71d-7a936dec4fa0.7c5d0382-5534-48e5-9ecf-39328edacb67" returned: 0 in 0.797s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:03:57 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-71cb0ceb-3cb8-4773-bb61-6e4a3d111a4e tempest-VolumesSnapshotTestJSON-35733676 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e0851290-2854-4346-b71d-7a936dec4fa0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 16:03:57 devstack sudo[106314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b7b985d2-650f-4bce-8ba5-bfcf827cf7dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b7b985d2-650f-4bce-8ba5-bfcf827cf7dd.cfb1b771-763e-4707-b0b4-7741cd84ff84 1G
Jun 15 16:03:57 devstack sudo[106314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:03:57 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9571c95b-bb1d-4af7-837b-31387ca3c5c4]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:03:57 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-71cb0ceb-3cb8-4773-bb61-6e4a3d111a4e tempest-VolumesSnapshotTestJSON-35733676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e0851290-2854-4346-b71d-7a936dec4fa0 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:03:57 devstack sudo[106316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e0851290-2854-4346-b71d-7a936dec4fa0
Jun 15 16:03:57 devstack sudo[106316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:03:57 devstack sudo[106314]: pam_unix(sudo:session): session closed for user root
Jun 15 16:03:57 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-450b2eca-5c92-4954-99c8-f93d7319d54e tempest-SnapshotDependencyTests-1867067896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b7b985d2-650f-4bce-8ba5-bfcf827cf7dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b7b985d2-650f-4bce-8ba5-bfcf827cf7dd.cfb1b771-763e-4707-b0b4-7741cd84ff84 1G" returned: 0 in 0.769s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:03:57 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-450b2eca-5c92-4954-99c8-f93d7319d54e tempest-SnapshotDependencyTests-1867067896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7b985d2-650f-4bce-8ba5-bfcf827cf7dd -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b7b985d2-650f-4bce-8ba5-bfcf827cf7dd.cfb1b771-763e-4707-b0b4-7741cd84ff84 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:03:57 devstack sudo[106325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7b985d2-650f-4bce-8ba5-bfcf827cf7dd -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b7b985d2-650f-4bce-8ba5-bfcf827cf7dd.cfb1b771-763e-4707-b0b4-7741cd84ff84
Jun 15 16:03:57 devstack sudo[106325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:03:57 devstack sudo[106316]: pam_unix(sudo:session): session closed for user root
Jun 15 16:03:57 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-71cb0ceb-3cb8-4773-bb61-6e4a3d111a4e tempest-VolumesSnapshotTestJSON-35733676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e0851290-2854-4346-b71d-7a936dec4fa0" returned: 0 in 0.760s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:03:57 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-71cb0ceb-3cb8-4773-bb61-6e4a3d111a4e tempest-VolumesSnapshotTestJSON-35733676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e0851290-2854-4346-b71d-7a936dec4fa0.7c5d0382-5534-48e5-9ecf-39328edacb67 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:03:57 devstack sudo[106327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e0851290-2854-4346-b71d-7a936dec4fa0.7c5d0382-5534-48e5-9ecf-39328edacb67
Jun 15 16:03:57 devstack sudo[106327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:03:58 devstack sudo[106325]: pam_unix(sudo:session): session closed for user root
Jun 15 16:03:58 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-450b2eca-5c92-4954-99c8-f93d7319d54e tempest-SnapshotDependencyTests-1867067896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7b985d2-650f-4bce-8ba5-bfcf827cf7dd -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b7b985d2-650f-4bce-8ba5-bfcf827cf7dd.cfb1b771-763e-4707-b0b4-7741cd84ff84" returned: 0 in 0.669s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:03:58 devstack cinder-volume[91863]: WARNING cinder.volume.drivers.remotefs [None req-450b2eca-5c92-4954-99c8-f93d7319d54e tempest-SnapshotDependencyTests-1867067896 None] /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b7b985d2-650f-4bce-8ba5-bfcf827cf7dd.cfb1b771-763e-4707-b0b4-7741cd84ff84 is being set with open permissions: ugo+rw
Jun 15 16:03:58 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-450b2eca-5c92-4954-99c8-f93d7319d54e tempest-SnapshotDependencyTests-1867067896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b7b985d2-650f-4bce-8ba5-bfcf827cf7dd.cfb1b771-763e-4707-b0b4-7741cd84ff84 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:03:58 devstack sudo[106335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b7b985d2-650f-4bce-8ba5-bfcf827cf7dd.cfb1b771-763e-4707-b0b4-7741cd84ff84
Jun 15 16:03:58 devstack sudo[106335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:03:58 devstack sudo[106327]: pam_unix(sudo:session): session closed for user root
Jun 15 16:03:58 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-71cb0ceb-3cb8-4773-bb61-6e4a3d111a4e tempest-VolumesSnapshotTestJSON-35733676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e0851290-2854-4346-b71d-7a936dec4fa0.7c5d0382-5534-48e5-9ecf-39328edacb67" returned: 0 in 0.764s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:03:58 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-71cb0ceb-3cb8-4773-bb61-6e4a3d111a4e tempest-VolumesSnapshotTestJSON-35733676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e0851290-2854-4346-b71d-7a936dec4fa0.7c5d0382-5534-48e5-9ecf-39328edacb67 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:03:58 devstack sudo[106337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e0851290-2854-4346-b71d-7a936dec4fa0.7c5d0382-5534-48e5-9ecf-39328edacb67
Jun 15 16:03:58 devstack sudo[106337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:03:59 devstack sudo[106335]: pam_unix(sudo:session): session closed for user root
Jun 15 16:03:59 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-450b2eca-5c92-4954-99c8-f93d7319d54e tempest-SnapshotDependencyTests-1867067896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b7b985d2-650f-4bce-8ba5-bfcf827cf7dd.cfb1b771-763e-4707-b0b4-7741cd84ff84" returned: 0 in 0.633s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:03:59 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-450b2eca-5c92-4954-99c8-f93d7319d54e tempest-SnapshotDependencyTests-1867067896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b7b985d2-650f-4bce-8ba5-bfcf827cf7dd.info {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:03:59 devstack sudo[106341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b7b985d2-650f-4bce-8ba5-bfcf827cf7dd.info
Jun 15 16:03:59 devstack sudo[106341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:03:59 devstack sudo[106337]: pam_unix(sudo:session): session closed for user root
Jun 15 16:03:59 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-71cb0ceb-3cb8-4773-bb61-6e4a3d111a4e tempest-VolumesSnapshotTestJSON-35733676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e0851290-2854-4346-b71d-7a936dec4fa0.7c5d0382-5534-48e5-9ecf-39328edacb67" returned: 0 in 0.623s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:03:59 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-71cb0ceb-3cb8-4773-bb61-6e4a3d111a4e tempest-VolumesSnapshotTestJSON-35733676 None] Lock "cinder-quobyte-7c5d0382-5534-48e5-9ecf-39328edacb67" released by "_delete_snapshot" :: held 3.068s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:03:59 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-71cb0ceb-3cb8-4773-bb61-6e4a3d111a4e tempest-VolumesSnapshotTestJSON-35733676 None] Lock "cinder-quobyte-e0851290-2854-4346-b71d-7a936dec4fa0" released by "delete_snapshot" :: held 3.109s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:03:59 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-71cb0ceb-3cb8-4773-bb61-6e4a3d111a4e tempest-VolumesSnapshotTestJSON-35733676 None] Created reservations ['adbd8730-06f7-4fd6-824d-a34c0a740f30', '7668335d-0bc5-46be-874a-6b356281f89b', '157cf68a-356d-438a-a2a1-f4e41b82c8a9', '026d45db-7137-4301-bf36-ec73a6ba1699'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 16:03:59 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-71cb0ceb-3cb8-4773-bb61-6e4a3d111a4e tempest-VolumesSnapshotTestJSON-35733676 None] Delete snapshot completed successfully.
Jun 15 16:03:59 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-71cb0ceb-3cb8-4773-bb61-6e4a3d111a4e tempest-VolumesSnapshotTestJSON-35733676 None] Lock "cinder-7c5d0382-5534-48e5-9ecf-39328edacb67-delete_snapshot" released by "delete_snapshot" :: held 3.282s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:03:59 devstack sudo[106341]: pam_unix(sudo:session): session closed for user root
Jun 15 16:03:59 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-450b2eca-5c92-4954-99c8-f93d7319d54e tempest-SnapshotDependencyTests-1867067896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b7b985d2-650f-4bce-8ba5-bfcf827cf7dd.info" returned: 0 in 0.593s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:03:59 devstack cinder-volume[91863]: WARNING cinder.volume.drivers.remotefs [None req-450b2eca-5c92-4954-99c8-f93d7319d54e tempest-SnapshotDependencyTests-1867067896 None] /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b7b985d2-650f-4bce-8ba5-bfcf827cf7dd.info is being set with open permissions: ugo+rw
Jun 15 16:03:59 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-450b2eca-5c92-4954-99c8-f93d7319d54e tempest-SnapshotDependencyTests-1867067896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b7b985d2-650f-4bce-8ba5-bfcf827cf7dd.info {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:03:59 devstack sudo[106344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b7b985d2-650f-4bce-8ba5-bfcf827cf7dd.info
Jun 15 16:03:59 devstack sudo[106344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:04:00 devstack sudo[106344]: pam_unix(sudo:session): session closed for user root
Jun 15 16:04:00 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-450b2eca-5c92-4954-99c8-f93d7319d54e tempest-SnapshotDependencyTests-1867067896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b7b985d2-650f-4bce-8ba5-bfcf827cf7dd.info" returned: 0 in 0.591s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:04:00 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-450b2eca-5c92-4954-99c8-f93d7319d54e tempest-SnapshotDependencyTests-1867067896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.241s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:04:00 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-5032c023-e3dc-4084-ac87-df1c6d84ff80 tempest-VolumesSnapshotTestJSON-35733676 None] Acquiring lock "cinder-e0851290-2854-4346-b71d-7a936dec4fa0-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:04:00 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-450b2eca-5c92-4954-99c8-f93d7319d54e tempest-SnapshotDependencyTests-1867067896 None] Create snapshot completed successfully
Jun 15 16:04:00 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-5032c023-e3dc-4084-ac87-df1c6d84ff80 tempest-VolumesSnapshotTestJSON-35733676 None] Lock "cinder-e0851290-2854-4346-b71d-7a936dec4fa0-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:04:00 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-5032c023-e3dc-4084-ac87-df1c6d84ff80 tempest-VolumesSnapshotTestJSON-35733676 None] Acquiring lock "cinder-quobyte-e0851290-2854-4346-b71d-7a936dec4fa0" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:04:00 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-5032c023-e3dc-4084-ac87-df1c6d84ff80 tempest-VolumesSnapshotTestJSON-35733676 None] Lock "cinder-quobyte-e0851290-2854-4346-b71d-7a936dec4fa0" acquired by "delete_volume" :: waited 0.012s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:04:00 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee4fb41e-cb70-40b0-b647-c8cd57219310]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:04:00 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5032c023-e3dc-4084-ac87-df1c6d84ff80 tempest-VolumesSnapshotTestJSON-35733676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e0851290-2854-4346-b71d-7a936dec4fa0 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:04:00 devstack sudo[106347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e0851290-2854-4346-b71d-7a936dec4fa0
Jun 15 16:04:00 devstack sudo[106347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:04:01 devstack sudo[106347]: pam_unix(sudo:session): session closed for user root
Jun 15 16:04:01 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5032c023-e3dc-4084-ac87-df1c6d84ff80 tempest-VolumesSnapshotTestJSON-35733676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e0851290-2854-4346-b71d-7a936dec4fa0" returned: 0 in 0.793s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:04:01 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5032c023-e3dc-4084-ac87-df1c6d84ff80 tempest-VolumesSnapshotTestJSON-35733676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e0851290-2854-4346-b71d-7a936dec4fa0 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:04:01 devstack sudo[106352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e0851290-2854-4346-b71d-7a936dec4fa0
Jun 15 16:04:01 devstack sudo[106352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:04:01 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-608c40bc-a483-4120-9693-ab9307b7866f tempest-SnapshotDependencyTests-1867067896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 16:04:01 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-608c40bc-a483-4120-9693-ab9307b7866f tempest-SnapshotDependencyTests-1867067896 None] Flow 'volume_create_manager' (4966dd84-ba3a-448d-add3-14dfaea7c6f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:04:01 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-608c40bc-a483-4120-9693-ab9307b7866f tempest-SnapshotDependencyTests-1867067896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3e6d5aa-7b52-4e00-980d-92fea9f37c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:04:01 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-608c40bc-a483-4120-9693-ab9307b7866f tempest-SnapshotDependencyTests-1867067896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3e6d5aa-7b52-4e00-980d-92fea9f37c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:04:02Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=984101dd-f117-4196-8487-6ab22c397c16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dc72fe22f54485db6a74667377ba0d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:04:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=cfb1b771-763e-4707-b0b4-7741cd84ff84,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:04:02Z,use_quota=True,user_id='383951b41687430c822311b86754ed4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:04:01 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-608c40bc-a483-4120-9693-ab9307b7866f tempest-SnapshotDependencyTests-1867067896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaf65e8e-c73f-4d0f-8189-b269b6c1ea3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:04:01 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-608c40bc-a483-4120-9693-ab9307b7866f tempest-SnapshotDependencyTests-1867067896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaf65e8e-c73f-4d0f-8189-b269b6c1ea3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:04:01 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-608c40bc-a483-4120-9693-ab9307b7866f tempest-SnapshotDependencyTests-1867067896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55121dbf-a1a9-4773-a7ca-2c7fc5617a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:04:01 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-608c40bc-a483-4120-9693-ab9307b7866f tempest-SnapshotDependencyTests-1867067896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55121dbf-a1a9-4773-a7ca-2c7fc5617a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '984101dd-f117-4196-8487-6ab22c397c16', 'volume_name': 'volume-984101dd-f117-4196-8487-6ab22c397c16', 'volume_size': 1, 'snapshot_id': 'cfb1b771-763e-4707-b0b4-7741cd84ff84'}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:04:01 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-608c40bc-a483-4120-9693-ab9307b7866f tempest-SnapshotDependencyTests-1867067896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb389b1e-fff0-491d-96a5-4b1d2f55e36c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:04:01 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-608c40bc-a483-4120-9693-ab9307b7866f tempest-SnapshotDependencyTests-1867067896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb389b1e-fff0-491d-96a5-4b1d2f55e36c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:04:01 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-608c40bc-a483-4120-9693-ab9307b7866f tempest-SnapshotDependencyTests-1867067896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef6d99de-99a9-4d78-91b0-6678c3540d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:04:01 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-608c40bc-a483-4120-9693-ab9307b7866f tempest-SnapshotDependencyTests-1867067896 None] Volume 984101dd-f117-4196-8487-6ab22c397c16: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-984101dd-f117-4196-8487-6ab22c397c16', 'volume_size': 1, 'snapshot_id': 'cfb1b771-763e-4707-b0b4-7741cd84ff84'}
Jun 15 16:04:01 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-608c40bc-a483-4120-9693-ab9307b7866f tempest-SnapshotDependencyTests-1867067896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:04:01 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-608c40bc-a483-4120-9693-ab9307b7866f tempest-SnapshotDependencyTests-1867067896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:04:01 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-608c40bc-a483-4120-9693-ab9307b7866f tempest-SnapshotDependencyTests-1867067896 None] Acquiring lock "cinder-quobyte-cfb1b771-763e-4707-b0b4-7741cd84ff84-984101dd-f117-4196-8487-6ab22c397c16" by "_create_volume_from_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:04:01 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-608c40bc-a483-4120-9693-ab9307b7866f tempest-SnapshotDependencyTests-1867067896 None] Lock "cinder-quobyte-cfb1b771-763e-4707-b0b4-7741cd84ff84-984101dd-f117-4196-8487-6ab22c397c16" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:04:01 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-608c40bc-a483-4120-9693-ab9307b7866f tempest-SnapshotDependencyTests-1867067896 None] Creating volume 984101dd-f117-4196-8487-6ab22c397c16 from snapshot cfb1b771-763e-4707-b0b4-7741cd84ff84 {{(pid=91863) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 15 16:04:01 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-608c40bc-a483-4120-9693-ab9307b7866f tempest-SnapshotDependencyTests-1867067896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:04:01 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-608c40bc-a483-4120-9693-ab9307b7866f tempest-SnapshotDependencyTests-1867067896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:04:01 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-608c40bc-a483-4120-9693-ab9307b7866f tempest-SnapshotDependencyTests-1867067896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:04:01 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-608c40bc-a483-4120-9693-ab9307b7866f tempest-SnapshotDependencyTests-1867067896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:04:01 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-608c40bc-a483-4120-9693-ab9307b7866f tempest-SnapshotDependencyTests-1867067896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:04:01 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-608c40bc-a483-4120-9693-ab9307b7866f tempest-SnapshotDependencyTests-1867067896 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 16:04:01 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-608c40bc-a483-4120-9693-ab9307b7866f tempest-SnapshotDependencyTests-1867067896 None] Acquiring lock "cinder-quobyte-984101dd-f117-4196-8487-6ab22c397c16" by "_copy_volume_from_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:04:01 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-608c40bc-a483-4120-9693-ab9307b7866f tempest-SnapshotDependencyTests-1867067896 None] Lock "cinder-quobyte-984101dd-f117-4196-8487-6ab22c397c16" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:04:01 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-608c40bc-a483-4120-9693-ab9307b7866f tempest-SnapshotDependencyTests-1867067896 None] snapshot: cfb1b771-763e-4707-b0b4-7741cd84ff84, volume: 984101dd-f117-4196-8487-6ab22c397c16,  {{(pid=91863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 15 16:04:02 devstack sudo[106352]: pam_unix(sudo:session): session closed for user root
Jun 15 16:04:02 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-608c40bc-a483-4120-9693-ab9307b7866f tempest-SnapshotDependencyTests-1867067896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:04:02 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-608c40bc-a483-4120-9693-ab9307b7866f tempest-SnapshotDependencyTests-1867067896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:04:02 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-608c40bc-a483-4120-9693-ab9307b7866f tempest-SnapshotDependencyTests-1867067896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:04:02 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-608c40bc-a483-4120-9693-ab9307b7866f tempest-SnapshotDependencyTests-1867067896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:04:02 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-608c40bc-a483-4120-9693-ab9307b7866f tempest-SnapshotDependencyTests-1867067896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:04:02 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5032c023-e3dc-4084-ac87-df1c6d84ff80 tempest-VolumesSnapshotTestJSON-35733676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-e0851290-2854-4346-b71d-7a936dec4fa0" returned: 0 in 0.760s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:04:02 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b667ebad-3f5f-42d6-830b-90501210789f]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:04:02 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-608c40bc-a483-4120-9693-ab9307b7866f tempest-SnapshotDependencyTests-1867067896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b7b985d2-650f-4bce-8ba5-bfcf827cf7dd.cfb1b771-763e-4707-b0b4-7741cd84ff84 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:04:02 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-5032c023-e3dc-4084-ac87-df1c6d84ff80 tempest-VolumesSnapshotTestJSON-35733676 None] Lock "cinder-quobyte-e0851290-2854-4346-b71d-7a936dec4fa0" released by "delete_volume" :: held 1.612s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:04:02 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-5032c023-e3dc-4084-ac87-df1c6d84ff80 tempest-VolumesSnapshotTestJSON-35733676 None] Created reservations ['16f4aa0e-aaa4-4116-b1b1-94e65e7f3183', '239af8c5-b34a-4091-aa98-0126935b7ac5', '90faa76b-8f05-4222-8957-ec63693c9f1d', '428bf4ee-2475-4333-ba1a-6dd5c08491ba'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 16:04:02 devstack sudo[106355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b7b985d2-650f-4bce-8ba5-bfcf827cf7dd.cfb1b771-763e-4707-b0b4-7741cd84ff84
Jun 15 16:04:02 devstack sudo[106355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:04:02 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-5032c023-e3dc-4084-ac87-df1c6d84ff80 tempest-VolumesSnapshotTestJSON-35733676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:04:02 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-5032c023-e3dc-4084-ac87-df1c6d84ff80 tempest-VolumesSnapshotTestJSON-35733676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:04:02 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-5032c023-e3dc-4084-ac87-df1c6d84ff80 tempest-VolumesSnapshotTestJSON-35733676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:04:02 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-5032c023-e3dc-4084-ac87-df1c6d84ff80 tempest-VolumesSnapshotTestJSON-35733676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:04:02 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-5032c023-e3dc-4084-ac87-df1c6d84ff80 tempest-VolumesSnapshotTestJSON-35733676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:04:02 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5032c023-e3dc-4084-ac87-df1c6d84ff80 tempest-VolumesSnapshotTestJSON-35733676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:04:02 devstack sudo[106357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 16:04:02 devstack sudo[106357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:04:02 devstack sudo[106357]: pam_unix(sudo:session): session closed for user root
Jun 15 16:04:02 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5032c023-e3dc-4084-ac87-df1c6d84ff80 tempest-VolumesSnapshotTestJSON-35733676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.687s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:04:02 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-5032c023-e3dc-4084-ac87-df1c6d84ff80 tempest-VolumesSnapshotTestJSON-35733676 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 16:04:02 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-5032c023-e3dc-4084-ac87-df1c6d84ff80 tempest-VolumesSnapshotTestJSON-35733676 None] Deleted volume successfully.
Jun 15 16:04:02 devstack sudo[106355]: pam_unix(sudo:session): session closed for user root
Jun 15 16:04:02 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-608c40bc-a483-4120-9693-ab9307b7866f tempest-SnapshotDependencyTests-1867067896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b7b985d2-650f-4bce-8ba5-bfcf827cf7dd.cfb1b771-763e-4707-b0b4-7741cd84ff84" returned: 0 in 0.886s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:04:02 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-608c40bc-a483-4120-9693-ab9307b7866f tempest-SnapshotDependencyTests-1867067896 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7b985d2-650f-4bce-8ba5-bfcf827cf7dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 16:04:02 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-608c40bc-a483-4120-9693-ab9307b7866f tempest-SnapshotDependencyTests-1867067896 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b7b985d2-650f-4bce-8ba5-bfcf827cf7dd {{(pid=91863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 15 16:04:02 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-608c40bc-a483-4120-9693-ab9307b7866f tempest-SnapshotDependencyTests-1867067896 None] Creating direct copy from snapshot {{(pid=91863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 15 16:04:02 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-5032c023-e3dc-4084-ac87-df1c6d84ff80 tempest-VolumesSnapshotTestJSON-35733676 None] Lock "cinder-e0851290-2854-4346-b71d-7a936dec4fa0-delete_volume" released by "delete_volume" :: held 2.547s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:04:02 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d548698-cbae-4578-b87d-caf790a52d0f]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:04:02 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-608c40bc-a483-4120-9693-ab9307b7866f tempest-SnapshotDependencyTests-1867067896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b7b985d2-650f-4bce-8ba5-bfcf827cf7dd {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:04:03 devstack sudo[106363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b7b985d2-650f-4bce-8ba5-bfcf827cf7dd
Jun 15 16:04:03 devstack sudo[106363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:04:03 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b038616-9635-47ab-988d-8c4e2a2c3e22 tempest-VolumesSnapshotTestJSON-35733676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 16:04:03 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-0b038616-9635-47ab-988d-8c4e2a2c3e22 tempest-VolumesSnapshotTestJSON-35733676 None] Flow 'volume_create_manager' (ecea5054-dd81-482a-b539-059733b028ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:04:03 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-0b038616-9635-47ab-988d-8c4e2a2c3e22 tempest-VolumesSnapshotTestJSON-35733676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99b8e338-efe9-40c9-b674-b4676b860210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:04:03 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-0b038616-9635-47ab-988d-8c4e2a2c3e22 tempest-VolumesSnapshotTestJSON-35733676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99b8e338-efe9-40c9-b674-b4676b860210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:04:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2075634020',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36f08219-eabf-4804-8f04-2d686a027361,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f573920ba84746b3a4b936f5c5af18d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:04:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:04:03Z,use_quota=True,user_id='a5748e74c6b14c5095a8e36fe2ab7316',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:04:03 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-0b038616-9635-47ab-988d-8c4e2a2c3e22 tempest-VolumesSnapshotTestJSON-35733676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74706107-7bc6-4a3c-ab51-66a712ca38ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:04:03 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-0b038616-9635-47ab-988d-8c4e2a2c3e22 tempest-VolumesSnapshotTestJSON-35733676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74706107-7bc6-4a3c-ab51-66a712ca38ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:04:03 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-0b038616-9635-47ab-988d-8c4e2a2c3e22 tempest-VolumesSnapshotTestJSON-35733676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81010e1d-a706-415c-a63b-dd6ce4b372c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:04:03 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-0b038616-9635-47ab-988d-8c4e2a2c3e22 tempest-VolumesSnapshotTestJSON-35733676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81010e1d-a706-415c-a63b-dd6ce4b372c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36f08219-eabf-4804-8f04-2d686a027361', 'volume_name': 'volume-36f08219-eabf-4804-8f04-2d686a027361', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:04:03 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-0b038616-9635-47ab-988d-8c4e2a2c3e22 tempest-VolumesSnapshotTestJSON-35733676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffc77190-3fb7-4b8a-91f8-be6520926a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:04:03 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-0b038616-9635-47ab-988d-8c4e2a2c3e22 tempest-VolumesSnapshotTestJSON-35733676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffc77190-3fb7-4b8a-91f8-be6520926a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:04:03 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-0b038616-9635-47ab-988d-8c4e2a2c3e22 tempest-VolumesSnapshotTestJSON-35733676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85154db0-0a35-4de3-8bf6-b70c0f0030d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:04:03 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-0b038616-9635-47ab-988d-8c4e2a2c3e22 tempest-VolumesSnapshotTestJSON-35733676 None] Volume 36f08219-eabf-4804-8f04-2d686a027361: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36f08219-eabf-4804-8f04-2d686a027361', 'volume_size': 1}
Jun 15 16:04:03 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-0b038616-9635-47ab-988d-8c4e2a2c3e22 tempest-VolumesSnapshotTestJSON-35733676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:04:03 devstack sudo[106363]: pam_unix(sudo:session): session closed for user root
Jun 15 16:04:03 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-608c40bc-a483-4120-9693-ab9307b7866f tempest-SnapshotDependencyTests-1867067896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b7b985d2-650f-4bce-8ba5-bfcf827cf7dd" returned: 0 in 0.782s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:04:03 devstack cinder-volume[91863]: DEBUG cinder.utils [None req-608c40bc-a483-4120-9693-ab9307b7866f tempest-SnapshotDependencyTests-1867067896 None] Path /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-984101dd-f117-4196-8487-6ab22c397c16 not found in is_blk_device check {{(pid=91863) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 15 16:04:03 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-608c40bc-a483-4120-9693-ab9307b7866f tempest-SnapshotDependencyTests-1867067896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b7b985d2-650f-4bce-8ba5-bfcf827cf7dd /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-984101dd-f117-4196-8487-6ab22c397c16 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:04:03 devstack sudo[106370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b7b985d2-650f-4bce-8ba5-bfcf827cf7dd /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-984101dd-f117-4196-8487-6ab22c397c16
Jun 15 16:04:03 devstack sudo[106370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:04:09 devstack sudo[106370]: pam_unix(sudo:session): session closed for user root
Jun 15 16:04:09 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-608c40bc-a483-4120-9693-ab9307b7866f tempest-SnapshotDependencyTests-1867067896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b7b985d2-650f-4bce-8ba5-bfcf827cf7dd /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-984101dd-f117-4196-8487-6ab22c397c16" returned: 0 in 5.311s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:04:09 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b064b72c-d8c7-40c0-b92b-2d2e2b0856b0]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:04:09 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-608c40bc-a483-4120-9693-ab9307b7866f tempest-SnapshotDependencyTests-1867067896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b7b985d2-650f-4bce-8ba5-bfcf827cf7dd {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:04:09 devstack sudo[106387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b7b985d2-650f-4bce-8ba5-bfcf827cf7dd
Jun 15 16:04:09 devstack sudo[106387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:04:10 devstack sudo[106387]: pam_unix(sudo:session): session closed for user root
Jun 15 16:04:10 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-608c40bc-a483-4120-9693-ab9307b7866f tempest-SnapshotDependencyTests-1867067896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b7b985d2-650f-4bce-8ba5-bfcf827cf7dd" returned: 0 in 1.091s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:04:10 devstack cinder-volume[91863]: DEBUG cinder.image.image_utils [None req-608c40bc-a483-4120-9693-ab9307b7866f tempest-SnapshotDependencyTests-1867067896 None] Image conversion details: src /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b7b985d2-650f-4bce-8ba5-bfcf827cf7dd, size 1024.00 MB, duration 5.31 sec, destination /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-984101dd-f117-4196-8487-6ab22c397c16 {{(pid=91863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 15 16:04:10 devstack cinder-volume[91863]: INFO cinder.image.image_utils [None req-608c40bc-a483-4120-9693-ab9307b7866f tempest-SnapshotDependencyTests-1867067896 None] Converted 1024.00 MB image at 192.78 MB/s
Jun 15 16:04:10 devstack cinder-volume[91863]: WARNING cinder.volume.drivers.remotefs [None req-608c40bc-a483-4120-9693-ab9307b7866f tempest-SnapshotDependencyTests-1867067896 None] /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-984101dd-f117-4196-8487-6ab22c397c16 is being set with open permissions: ugo+rw
Jun 15 16:04:10 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-608c40bc-a483-4120-9693-ab9307b7866f tempest-SnapshotDependencyTests-1867067896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-984101dd-f117-4196-8487-6ab22c397c16 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:04:10 devstack sudo[106393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-984101dd-f117-4196-8487-6ab22c397c16
Jun 15 16:04:10 devstack sudo[106393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:04:10 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-e76fba93-9cb6-490a-8e69-572b5ef377f9 tempest-VolumesNegativeTest-523729614 None] Acquiring lock "cinder-1d09dae1-fa0a-4a7c-a26d-df6e57d5bdbd-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:04:10 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-e76fba93-9cb6-490a-8e69-572b5ef377f9 tempest-VolumesNegativeTest-523729614 None] Lock "cinder-1d09dae1-fa0a-4a7c-a26d-df6e57d5bdbd-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:04:10 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-e76fba93-9cb6-490a-8e69-572b5ef377f9 tempest-VolumesNegativeTest-523729614 None] Acquiring lock "cinder-quobyte-1d09dae1-fa0a-4a7c-a26d-df6e57d5bdbd" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:04:10 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-e76fba93-9cb6-490a-8e69-572b5ef377f9 tempest-VolumesNegativeTest-523729614 None] Lock "cinder-quobyte-1d09dae1-fa0a-4a7c-a26d-df6e57d5bdbd" acquired by "delete_volume" :: waited 0.017s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:04:10 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f08b165-6696-4c7d-831c-6220a9315f91]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:04:10 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-e76fba93-9cb6-490a-8e69-572b5ef377f9 tempest-VolumesNegativeTest-523729614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1d09dae1-fa0a-4a7c-a26d-df6e57d5bdbd {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:04:10 devstack sudo[106395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1d09dae1-fa0a-4a7c-a26d-df6e57d5bdbd
Jun 15 16:04:10 devstack sudo[106395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:04:10 devstack sudo[106393]: pam_unix(sudo:session): session closed for user root
Jun 15 16:04:10 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-608c40bc-a483-4120-9693-ab9307b7866f tempest-SnapshotDependencyTests-1867067896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-984101dd-f117-4196-8487-6ab22c397c16" returned: 0 in 0.655s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:04:10 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-608c40bc-a483-4120-9693-ab9307b7866f tempest-SnapshotDependencyTests-1867067896 None] Lock "cinder-quobyte-984101dd-f117-4196-8487-6ab22c397c16" released by "_copy_volume_from_snapshot" :: held 8.841s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:04:10 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-608c40bc-a483-4120-9693-ab9307b7866f tempest-SnapshotDependencyTests-1867067896 None] Lock "cinder-quobyte-cfb1b771-763e-4707-b0b4-7741cd84ff84-984101dd-f117-4196-8487-6ab22c397c16" released by "_create_volume_from_snapshot" :: held 8.880s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:04:10 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-608c40bc-a483-4120-9693-ab9307b7866f tempest-SnapshotDependencyTests-1867067896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.900s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:04:10 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-0b038616-9635-47ab-988d-8c4e2a2c3e22 tempest-VolumesSnapshotTestJSON-35733676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.559s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:04:10 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-0b038616-9635-47ab-988d-8c4e2a2c3e22 tempest-VolumesSnapshotTestJSON-35733676 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:04:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2075634020',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36f08219-eabf-4804-8f04-2d686a027361,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f573920ba84746b3a4b936f5c5af18d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:04:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:04:03Z,use_quota=True,user_id='a5748e74c6b14c5095a8e36fe2ab7316',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 16:04:10 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-0b038616-9635-47ab-988d-8c4e2a2c3e22 tempest-VolumesSnapshotTestJSON-35733676 None] Creating volume 36f08219-eabf-4804-8f04-2d686a027361 {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 16:04:10 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-0b038616-9635-47ab-988d-8c4e2a2c3e22 tempest-VolumesSnapshotTestJSON-35733676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:04:10 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-0b038616-9635-47ab-988d-8c4e2a2c3e22 tempest-VolumesSnapshotTestJSON-35733676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:04:10 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-0b038616-9635-47ab-988d-8c4e2a2c3e22 tempest-VolumesSnapshotTestJSON-35733676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:04:10 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-0b038616-9635-47ab-988d-8c4e2a2c3e22 tempest-VolumesSnapshotTestJSON-35733676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:04:10 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-0b038616-9635-47ab-988d-8c4e2a2c3e22 tempest-VolumesSnapshotTestJSON-35733676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:04:10 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-0b038616-9635-47ab-988d-8c4e2a2c3e22 tempest-VolumesSnapshotTestJSON-35733676 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 16:04:10 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-0b038616-9635-47ab-988d-8c4e2a2c3e22 tempest-VolumesSnapshotTestJSON-35733676 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 16:04:10 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-0b038616-9635-47ab-988d-8c4e2a2c3e22 tempest-VolumesSnapshotTestJSON-35733676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36f08219-eabf-4804-8f04-2d686a027361 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:04:10 devstack sudo[106398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36f08219-eabf-4804-8f04-2d686a027361 1073741824
Jun 15 16:04:10 devstack sudo[106398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:04:10 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-608c40bc-a483-4120-9693-ab9307b7866f tempest-SnapshotDependencyTests-1867067896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef6d99de-99a9-4d78-91b0-6678c3540d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-984101dd-f117-4196-8487-6ab22c397c16', 'volume_size': 1, 'snapshot_id': 'cfb1b771-763e-4707-b0b4-7741cd84ff84'}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:04:10 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-608c40bc-a483-4120-9693-ab9307b7866f tempest-SnapshotDependencyTests-1867067896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfadb213-0c90-4cd6-8dde-a803c6f8200d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:04:10 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-608c40bc-a483-4120-9693-ab9307b7866f tempest-SnapshotDependencyTests-1867067896 None] Volume volume-984101dd-f117-4196-8487-6ab22c397c16 (984101dd-f117-4196-8487-6ab22c397c16): created successfully
Jun 15 16:04:10 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-608c40bc-a483-4120-9693-ab9307b7866f tempest-SnapshotDependencyTests-1867067896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfadb213-0c90-4cd6-8dde-a803c6f8200d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:04:10 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-608c40bc-a483-4120-9693-ab9307b7866f tempest-SnapshotDependencyTests-1867067896 None] Flow 'volume_create_manager' (4966dd84-ba3a-448d-add3-14dfaea7c6f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:04:10 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-608c40bc-a483-4120-9693-ab9307b7866f tempest-SnapshotDependencyTests-1867067896 None] Created volume successfully.
Jun 15 16:04:11 devstack sudo[106395]: pam_unix(sudo:session): session closed for user root
Jun 15 16:04:11 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-e76fba93-9cb6-490a-8e69-572b5ef377f9 tempest-VolumesNegativeTest-523729614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1d09dae1-fa0a-4a7c-a26d-df6e57d5bdbd" returned: 0 in 0.793s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:04:11 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-e76fba93-9cb6-490a-8e69-572b5ef377f9 tempest-VolumesNegativeTest-523729614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1d09dae1-fa0a-4a7c-a26d-df6e57d5bdbd {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:04:11 devstack sudo[106403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1d09dae1-fa0a-4a7c-a26d-df6e57d5bdbd
Jun 15 16:04:11 devstack sudo[106403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:04:11 devstack sudo[106398]: pam_unix(sudo:session): session closed for user root
Jun 15 16:04:11 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-0b038616-9635-47ab-988d-8c4e2a2c3e22 tempest-VolumesSnapshotTestJSON-35733676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36f08219-eabf-4804-8f04-2d686a027361 1073741824" returned: 0 in 0.854s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:04:11 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-0b038616-9635-47ab-988d-8c4e2a2c3e22 tempest-VolumesSnapshotTestJSON-35733676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36f08219-eabf-4804-8f04-2d686a027361 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:04:11 devstack sudo[106409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36f08219-eabf-4804-8f04-2d686a027361
Jun 15 16:04:11 devstack sudo[106409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:04:11 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-b0fcd433-0029-4e9f-bebf-42355bd7b680 tempest-SnapshotDependencyTests-1867067896 None] Acquiring lock "cinder-cfb1b771-763e-4707-b0b4-7741cd84ff84-delete_snapshot" by "delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:04:11 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-b0fcd433-0029-4e9f-bebf-42355bd7b680 tempest-SnapshotDependencyTests-1867067896 None] Lock "cinder-cfb1b771-763e-4707-b0b4-7741cd84ff84-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:04:11 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-b0fcd433-0029-4e9f-bebf-42355bd7b680 tempest-SnapshotDependencyTests-1867067896 None] Acquiring lock "cinder-quobyte-b7b985d2-650f-4bce-8ba5-bfcf827cf7dd" by "delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:04:11 devstack sudo[106403]: pam_unix(sudo:session): session closed for user root
Jun 15 16:04:11 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-b0fcd433-0029-4e9f-bebf-42355bd7b680 tempest-SnapshotDependencyTests-1867067896 None] Lock "cinder-quobyte-b7b985d2-650f-4bce-8ba5-bfcf827cf7dd" acquired by "delete_snapshot" :: waited 0.020s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:04:11 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-b0fcd433-0029-4e9f-bebf-42355bd7b680 tempest-SnapshotDependencyTests-1867067896 None] Acquiring lock "cinder-quobyte-cfb1b771-763e-4707-b0b4-7741cd84ff84" by "_delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:04:11 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-e76fba93-9cb6-490a-8e69-572b5ef377f9 tempest-VolumesNegativeTest-523729614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1d09dae1-fa0a-4a7c-a26d-df6e57d5bdbd" returned: 0 in 0.741s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:04:11 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-e76fba93-9cb6-490a-8e69-572b5ef377f9 tempest-VolumesNegativeTest-523729614 None] Lock "cinder-quobyte-1d09dae1-fa0a-4a7c-a26d-df6e57d5bdbd" released by "delete_volume" :: held 1.587s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:04:11 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-b0fcd433-0029-4e9f-bebf-42355bd7b680 tempest-SnapshotDependencyTests-1867067896 None] Lock "cinder-quobyte-cfb1b771-763e-4707-b0b4-7741cd84ff84" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:04:11 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-b0fcd433-0029-4e9f-bebf-42355bd7b680 tempest-SnapshotDependencyTests-1867067896 None] Deleting offline snapshot cfb1b771-763e-4707-b0b4-7741cd84ff84 of volume b7b985d2-650f-4bce-8ba5-bfcf827cf7dd {{(pid=91863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 15 16:04:11 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-b0fcd433-0029-4e9f-bebf-42355bd7b680 tempest-SnapshotDependencyTests-1867067896 None] snapshot_file for this snap is: volume-b7b985d2-650f-4bce-8ba5-bfcf827cf7dd.cfb1b771-763e-4707-b0b4-7741cd84ff84 {{(pid=91863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 15 16:04:11 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[14525790-993b-463d-af85-bde382d7153d]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:04:11 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-b0fcd433-0029-4e9f-bebf-42355bd7b680 tempest-SnapshotDependencyTests-1867067896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b7b985d2-650f-4bce-8ba5-bfcf827cf7dd.cfb1b771-763e-4707-b0b4-7741cd84ff84 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:04:12 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-e76fba93-9cb6-490a-8e69-572b5ef377f9 tempest-VolumesNegativeTest-523729614 None] Created reservations ['cd249b17-0b25-4459-9020-445a7b6d2ac8', 'de659464-f59f-4b90-a79b-4162613277d1', '19d906e6-2329-453e-b4ea-1abb78dbd4f1', '17b4b251-e1e3-417b-92a3-014cade151f1'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 16:04:12 devstack sudo[106411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b7b985d2-650f-4bce-8ba5-bfcf827cf7dd.cfb1b771-763e-4707-b0b4-7741cd84ff84
Jun 15 16:04:12 devstack sudo[106411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:04:12 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-e76fba93-9cb6-490a-8e69-572b5ef377f9 tempest-VolumesNegativeTest-523729614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:04:12 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-e76fba93-9cb6-490a-8e69-572b5ef377f9 tempest-VolumesNegativeTest-523729614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:04:12 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-e76fba93-9cb6-490a-8e69-572b5ef377f9 tempest-VolumesNegativeTest-523729614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:04:12 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-e76fba93-9cb6-490a-8e69-572b5ef377f9 tempest-VolumesNegativeTest-523729614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:04:12 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-e76fba93-9cb6-490a-8e69-572b5ef377f9 tempest-VolumesNegativeTest-523729614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:04:12 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-e76fba93-9cb6-490a-8e69-572b5ef377f9 tempest-VolumesNegativeTest-523729614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:04:12 devstack sudo[106413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 16:04:12 devstack sudo[106413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:04:12 devstack sudo[106409]: pam_unix(sudo:session): session closed for user root
Jun 15 16:04:12 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-0b038616-9635-47ab-988d-8c4e2a2c3e22 tempest-VolumesSnapshotTestJSON-35733676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36f08219-eabf-4804-8f04-2d686a027361" returned: 0 in 0.714s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:04:12 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-0b038616-9635-47ab-988d-8c4e2a2c3e22 tempest-VolumesSnapshotTestJSON-35733676 None] <== create_volume: return (1614ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 16:04:12 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-0b038616-9635-47ab-988d-8c4e2a2c3e22 tempest-VolumesSnapshotTestJSON-35733676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.617s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:04:12 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-0b038616-9635-47ab-988d-8c4e2a2c3e22 tempest-VolumesSnapshotTestJSON-35733676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85154db0-0a35-4de3-8bf6-b70c0f0030d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36f08219-eabf-4804-8f04-2d686a027361', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:04:12 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-0b038616-9635-47ab-988d-8c4e2a2c3e22 tempest-VolumesSnapshotTestJSON-35733676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfd0290c-c76d-409d-a592-faaf2a2d1f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:04:12 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-0b038616-9635-47ab-988d-8c4e2a2c3e22 tempest-VolumesSnapshotTestJSON-35733676 None] Volume volume-36f08219-eabf-4804-8f04-2d686a027361 (36f08219-eabf-4804-8f04-2d686a027361): created successfully
Jun 15 16:04:12 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-0b038616-9635-47ab-988d-8c4e2a2c3e22 tempest-VolumesSnapshotTestJSON-35733676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfd0290c-c76d-409d-a592-faaf2a2d1f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:04:12 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-0b038616-9635-47ab-988d-8c4e2a2c3e22 tempest-VolumesSnapshotTestJSON-35733676 None] Flow 'volume_create_manager' (ecea5054-dd81-482a-b539-059733b028ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:04:12 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-0b038616-9635-47ab-988d-8c4e2a2c3e22 tempest-VolumesSnapshotTestJSON-35733676 None] Created volume successfully.
Jun 15 16:04:12 devstack sudo[106413]: pam_unix(sudo:session): session closed for user root
Jun 15 16:04:12 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-e76fba93-9cb6-490a-8e69-572b5ef377f9 tempest-VolumesNegativeTest-523729614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.613s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:04:12 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-e76fba93-9cb6-490a-8e69-572b5ef377f9 tempest-VolumesNegativeTest-523729614 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 16:04:12 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-e76fba93-9cb6-490a-8e69-572b5ef377f9 tempest-VolumesNegativeTest-523729614 None] Deleted volume successfully.
Jun 15 16:04:12 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-e76fba93-9cb6-490a-8e69-572b5ef377f9 tempest-VolumesNegativeTest-523729614 None] Lock "cinder-1d09dae1-fa0a-4a7c-a26d-df6e57d5bdbd-delete_volume" released by "delete_volume" :: held 2.532s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:04:12 devstack sudo[106411]: pam_unix(sudo:session): session closed for user root
Jun 15 16:04:12 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-b0fcd433-0029-4e9f-bebf-42355bd7b680 tempest-SnapshotDependencyTests-1867067896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b7b985d2-650f-4bce-8ba5-bfcf827cf7dd.cfb1b771-763e-4707-b0b4-7741cd84ff84" returned: 0 in 0.997s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:04:12 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-b0fcd433-0029-4e9f-bebf-42355bd7b680 tempest-SnapshotDependencyTests-1867067896 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7b985d2-650f-4bce-8ba5-bfcf827cf7dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 16:04:12 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c1ed139-3eee-44ef-8fee-627b2814bcc1]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:04:12 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-b0fcd433-0029-4e9f-bebf-42355bd7b680 tempest-SnapshotDependencyTests-1867067896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b7b985d2-650f-4bce-8ba5-bfcf827cf7dd {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:04:13 devstack sudo[106420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b7b985d2-650f-4bce-8ba5-bfcf827cf7dd
Jun 15 16:04:13 devstack sudo[106420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:04:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-d894eec7-9ecb-49da-a193-f3b91eb2011e tempest-VolumesSnapshotTestJSON-35733676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:04:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-d894eec7-9ecb-49da-a193-f3b91eb2011e tempest-VolumesSnapshotTestJSON-35733676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:04:13 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-d894eec7-9ecb-49da-a193-f3b91eb2011e tempest-VolumesSnapshotTestJSON-35733676 None] Creating offline snapshot a4860ef3-a2d7-4e6a-ba49-2e7f4537764d of volume 36f08219-eabf-4804-8f04-2d686a027361 {{(pid=91863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 15 16:04:13 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1978639-d838-4cf3-ab90-0a5a3d71a812]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:04:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-d894eec7-9ecb-49da-a193-f3b91eb2011e tempest-VolumesSnapshotTestJSON-35733676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36f08219-eabf-4804-8f04-2d686a027361 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:04:13 devstack sudo[106423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36f08219-eabf-4804-8f04-2d686a027361
Jun 15 16:04:13 devstack sudo[106423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:04:13 devstack sudo[106420]: pam_unix(sudo:session): session closed for user root
Jun 15 16:04:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-b0fcd433-0029-4e9f-bebf-42355bd7b680 tempest-SnapshotDependencyTests-1867067896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b7b985d2-650f-4bce-8ba5-bfcf827cf7dd" returned: 0 in 1.000s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:04:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-b0fcd433-0029-4e9f-bebf-42355bd7b680 tempest-SnapshotDependencyTests-1867067896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b7b985d2-650f-4bce-8ba5-bfcf827cf7dd.cfb1b771-763e-4707-b0b4-7741cd84ff84 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:04:14 devstack sudo[106428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b7b985d2-650f-4bce-8ba5-bfcf827cf7dd.cfb1b771-763e-4707-b0b4-7741cd84ff84
Jun 15 16:04:14 devstack sudo[106428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:04:14 devstack sudo[106423]: pam_unix(sudo:session): session closed for user root
Jun 15 16:04:14 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-d894eec7-9ecb-49da-a193-f3b91eb2011e tempest-VolumesSnapshotTestJSON-35733676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36f08219-eabf-4804-8f04-2d686a027361" returned: 0 in 0.898s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:04:14 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-d894eec7-9ecb-49da-a193-f3b91eb2011e tempest-VolumesSnapshotTestJSON-35733676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36f08219-eabf-4804-8f04-2d686a027361,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36f08219-eabf-4804-8f04-2d686a027361.a4860ef3-a2d7-4e6a-ba49-2e7f4537764d 1G {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:04:14 devstack sudo[106433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36f08219-eabf-4804-8f04-2d686a027361,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36f08219-eabf-4804-8f04-2d686a027361.a4860ef3-a2d7-4e6a-ba49-2e7f4537764d 1G
Jun 15 16:04:14 devstack sudo[106433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:04:14 devstack sudo[106428]: pam_unix(sudo:session): session closed for user root
Jun 15 16:04:14 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-b0fcd433-0029-4e9f-bebf-42355bd7b680 tempest-SnapshotDependencyTests-1867067896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b7b985d2-650f-4bce-8ba5-bfcf827cf7dd.cfb1b771-763e-4707-b0b4-7741cd84ff84" returned: 0 in 0.793s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:04:14 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-b0fcd433-0029-4e9f-bebf-42355bd7b680 tempest-SnapshotDependencyTests-1867067896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b7b985d2-650f-4bce-8ba5-bfcf827cf7dd.cfb1b771-763e-4707-b0b4-7741cd84ff84 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:04:14 devstack sudo[106439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b7b985d2-650f-4bce-8ba5-bfcf827cf7dd.cfb1b771-763e-4707-b0b4-7741cd84ff84
Jun 15 16:04:14 devstack sudo[106439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:04:15 devstack sudo[106433]: pam_unix(sudo:session): session closed for user root
Jun 15 16:04:15 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-d894eec7-9ecb-49da-a193-f3b91eb2011e tempest-VolumesSnapshotTestJSON-35733676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36f08219-eabf-4804-8f04-2d686a027361,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36f08219-eabf-4804-8f04-2d686a027361.a4860ef3-a2d7-4e6a-ba49-2e7f4537764d 1G" returned: 0 in 0.906s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:04:15 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-d894eec7-9ecb-49da-a193-f3b91eb2011e tempest-VolumesSnapshotTestJSON-35733676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36f08219-eabf-4804-8f04-2d686a027361 -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36f08219-eabf-4804-8f04-2d686a027361.a4860ef3-a2d7-4e6a-ba49-2e7f4537764d {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:04:15 devstack sudo[106445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36f08219-eabf-4804-8f04-2d686a027361 -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36f08219-eabf-4804-8f04-2d686a027361.a4860ef3-a2d7-4e6a-ba49-2e7f4537764d
Jun 15 16:04:15 devstack sudo[106445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:04:15 devstack sudo[106439]: pam_unix(sudo:session): session closed for user root
Jun 15 16:04:15 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-b0fcd433-0029-4e9f-bebf-42355bd7b680 tempest-SnapshotDependencyTests-1867067896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b7b985d2-650f-4bce-8ba5-bfcf827cf7dd.cfb1b771-763e-4707-b0b4-7741cd84ff84" returned: 0 in 0.719s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:04:15 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-b0fcd433-0029-4e9f-bebf-42355bd7b680 tempest-SnapshotDependencyTests-1867067896 None] Lock "cinder-quobyte-cfb1b771-763e-4707-b0b4-7741cd84ff84" released by "_delete_snapshot" :: held 3.636s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:04:15 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-b0fcd433-0029-4e9f-bebf-42355bd7b680 tempest-SnapshotDependencyTests-1867067896 None] Lock "cinder-quobyte-b7b985d2-650f-4bce-8ba5-bfcf827cf7dd" released by "delete_snapshot" :: held 3.678s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:04:15 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-b0fcd433-0029-4e9f-bebf-42355bd7b680 tempest-SnapshotDependencyTests-1867067896 None] Created reservations ['6d3b8ad0-481e-46a1-bcf8-7a3bf26e3538', '72b7711d-c45e-47a8-a99c-50729bf1a35a', 'd797e295-4c3d-4aaf-a2fa-ccca366c5f25', '9291ab64-45c9-4d61-bb29-56064213db8d'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 16:04:15 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-b0fcd433-0029-4e9f-bebf-42355bd7b680 tempest-SnapshotDependencyTests-1867067896 None] Delete snapshot completed successfully.
Jun 15 16:04:15 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-b0fcd433-0029-4e9f-bebf-42355bd7b680 tempest-SnapshotDependencyTests-1867067896 None] Lock "cinder-cfb1b771-763e-4707-b0b4-7741cd84ff84-delete_snapshot" released by "delete_snapshot" :: held 3.814s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:04:16 devstack sudo[106445]: pam_unix(sudo:session): session closed for user root
Jun 15 16:04:16 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-d894eec7-9ecb-49da-a193-f3b91eb2011e tempest-VolumesSnapshotTestJSON-35733676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36f08219-eabf-4804-8f04-2d686a027361 -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36f08219-eabf-4804-8f04-2d686a027361.a4860ef3-a2d7-4e6a-ba49-2e7f4537764d" returned: 0 in 0.739s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:04:16 devstack cinder-volume[91863]: WARNING cinder.volume.drivers.remotefs [None req-d894eec7-9ecb-49da-a193-f3b91eb2011e tempest-VolumesSnapshotTestJSON-35733676 None] /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36f08219-eabf-4804-8f04-2d686a027361.a4860ef3-a2d7-4e6a-ba49-2e7f4537764d is being set with open permissions: ugo+rw
Jun 15 16:04:16 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-d894eec7-9ecb-49da-a193-f3b91eb2011e tempest-VolumesSnapshotTestJSON-35733676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36f08219-eabf-4804-8f04-2d686a027361.a4860ef3-a2d7-4e6a-ba49-2e7f4537764d {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:04:16 devstack sudo[106452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36f08219-eabf-4804-8f04-2d686a027361.a4860ef3-a2d7-4e6a-ba49-2e7f4537764d
Jun 15 16:04:16 devstack sudo[106452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:04:16 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-049ebd1b-5ca5-4e89-a81d-e23491294d6e tempest-SnapshotDependencyTests-1867067896 None] Acquiring lock "cinder-b7b985d2-650f-4bce-8ba5-bfcf827cf7dd-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:04:16 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-049ebd1b-5ca5-4e89-a81d-e23491294d6e tempest-SnapshotDependencyTests-1867067896 None] Lock "cinder-b7b985d2-650f-4bce-8ba5-bfcf827cf7dd-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:04:16 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-049ebd1b-5ca5-4e89-a81d-e23491294d6e tempest-SnapshotDependencyTests-1867067896 None] Acquiring lock "cinder-quobyte-b7b985d2-650f-4bce-8ba5-bfcf827cf7dd" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:04:16 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-049ebd1b-5ca5-4e89-a81d-e23491294d6e tempest-SnapshotDependencyTests-1867067896 None] Lock "cinder-quobyte-b7b985d2-650f-4bce-8ba5-bfcf827cf7dd" acquired by "delete_volume" :: waited 0.014s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:04:16 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[56fbb983-2296-48c8-88b2-0ae02ab4ce3a]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:04:16 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-049ebd1b-5ca5-4e89-a81d-e23491294d6e tempest-SnapshotDependencyTests-1867067896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b7b985d2-650f-4bce-8ba5-bfcf827cf7dd {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:04:16 devstack sudo[106454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b7b985d2-650f-4bce-8ba5-bfcf827cf7dd
Jun 15 16:04:16 devstack sudo[106454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:04:16 devstack sudo[106452]: pam_unix(sudo:session): session closed for user root
Jun 15 16:04:16 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-d894eec7-9ecb-49da-a193-f3b91eb2011e tempest-VolumesSnapshotTestJSON-35733676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36f08219-eabf-4804-8f04-2d686a027361.a4860ef3-a2d7-4e6a-ba49-2e7f4537764d" returned: 0 in 0.653s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:04:16 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-d894eec7-9ecb-49da-a193-f3b91eb2011e tempest-VolumesSnapshotTestJSON-35733676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36f08219-eabf-4804-8f04-2d686a027361.info {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:04:16 devstack sudo[106457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36f08219-eabf-4804-8f04-2d686a027361.info
Jun 15 16:04:16 devstack sudo[106457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:04:17 devstack sudo[106454]: pam_unix(sudo:session): session closed for user root
Jun 15 16:04:17 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-049ebd1b-5ca5-4e89-a81d-e23491294d6e tempest-SnapshotDependencyTests-1867067896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b7b985d2-650f-4bce-8ba5-bfcf827cf7dd" returned: 0 in 0.777s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:04:17 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-049ebd1b-5ca5-4e89-a81d-e23491294d6e tempest-SnapshotDependencyTests-1867067896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b7b985d2-650f-4bce-8ba5-bfcf827cf7dd {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:04:17 devstack sudo[106462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b7b985d2-650f-4bce-8ba5-bfcf827cf7dd
Jun 15 16:04:17 devstack sudo[106462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:04:17 devstack sudo[106457]: pam_unix(sudo:session): session closed for user root
Jun 15 16:04:17 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-d894eec7-9ecb-49da-a193-f3b91eb2011e tempest-VolumesSnapshotTestJSON-35733676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36f08219-eabf-4804-8f04-2d686a027361.info" returned: 0 in 0.648s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:04:17 devstack cinder-volume[91863]: WARNING cinder.volume.drivers.remotefs [None req-d894eec7-9ecb-49da-a193-f3b91eb2011e tempest-VolumesSnapshotTestJSON-35733676 None] /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36f08219-eabf-4804-8f04-2d686a027361.info is being set with open permissions: ugo+rw
Jun 15 16:04:17 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-d894eec7-9ecb-49da-a193-f3b91eb2011e tempest-VolumesSnapshotTestJSON-35733676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36f08219-eabf-4804-8f04-2d686a027361.info {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:04:17 devstack sudo[106465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36f08219-eabf-4804-8f04-2d686a027361.info
Jun 15 16:04:17 devstack sudo[106465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:04:17 devstack sudo[106462]: pam_unix(sudo:session): session closed for user root
Jun 15 16:04:17 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-049ebd1b-5ca5-4e89-a81d-e23491294d6e tempest-SnapshotDependencyTests-1867067896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b7b985d2-650f-4bce-8ba5-bfcf827cf7dd" returned: 0 in 0.665s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:04:17 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-049ebd1b-5ca5-4e89-a81d-e23491294d6e tempest-SnapshotDependencyTests-1867067896 None] Lock "cinder-quobyte-b7b985d2-650f-4bce-8ba5-bfcf827cf7dd" released by "delete_volume" :: held 1.518s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:04:17 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-049ebd1b-5ca5-4e89-a81d-e23491294d6e tempest-SnapshotDependencyTests-1867067896 None] Created reservations ['09f191f6-4d6d-4789-bed7-963eddd6d944', '98f23512-2c4e-439e-b817-f865b0ad3a29', 'd1a5b717-0442-4f85-83ba-f9935f33daad', 'a61e9fd3-385b-4fa5-8c5c-9bcccc7863e8'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 16:04:17 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-049ebd1b-5ca5-4e89-a81d-e23491294d6e tempest-SnapshotDependencyTests-1867067896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:04:17 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-049ebd1b-5ca5-4e89-a81d-e23491294d6e tempest-SnapshotDependencyTests-1867067896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:04:17 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-049ebd1b-5ca5-4e89-a81d-e23491294d6e tempest-SnapshotDependencyTests-1867067896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:04:17 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-049ebd1b-5ca5-4e89-a81d-e23491294d6e tempest-SnapshotDependencyTests-1867067896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:04:17 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-049ebd1b-5ca5-4e89-a81d-e23491294d6e tempest-SnapshotDependencyTests-1867067896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:04:17 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-049ebd1b-5ca5-4e89-a81d-e23491294d6e tempest-SnapshotDependencyTests-1867067896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:04:17 devstack sudo[106468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 16:04:17 devstack sudo[106468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:04:17 devstack sudo[106465]: pam_unix(sudo:session): session closed for user root
Jun 15 16:04:17 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-d894eec7-9ecb-49da-a193-f3b91eb2011e tempest-VolumesSnapshotTestJSON-35733676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36f08219-eabf-4804-8f04-2d686a027361.info" returned: 0 in 0.591s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:04:18 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-d894eec7-9ecb-49da-a193-f3b91eb2011e tempest-VolumesSnapshotTestJSON-35733676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.572s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:04:18 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-d894eec7-9ecb-49da-a193-f3b91eb2011e tempest-VolumesSnapshotTestJSON-35733676 None] Create snapshot completed successfully
Jun 15 16:04:18 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-e5e8e256-5d6f-46d6-98e8-73b5f11493b1 tempest-SnapshotDependencyTests-1867067896 None] Acquiring lock "cinder-984101dd-f117-4196-8487-6ab22c397c16-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:04:18 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-e5e8e256-5d6f-46d6-98e8-73b5f11493b1 tempest-SnapshotDependencyTests-1867067896 None] Lock "cinder-984101dd-f117-4196-8487-6ab22c397c16-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:04:18 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-e5e8e256-5d6f-46d6-98e8-73b5f11493b1 tempest-SnapshotDependencyTests-1867067896 None] Acquiring lock "cinder-quobyte-984101dd-f117-4196-8487-6ab22c397c16" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:04:18 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-e5e8e256-5d6f-46d6-98e8-73b5f11493b1 tempest-SnapshotDependencyTests-1867067896 None] Lock "cinder-quobyte-984101dd-f117-4196-8487-6ab22c397c16" acquired by "delete_volume" :: waited 0.015s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:04:18 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c840f0-11a3-4bf5-8ef0-ab3c3ce62d0f]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:04:18 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-e5e8e256-5d6f-46d6-98e8-73b5f11493b1 tempest-SnapshotDependencyTests-1867067896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-984101dd-f117-4196-8487-6ab22c397c16 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:04:18 devstack sudo[106468]: pam_unix(sudo:session): session closed for user root
Jun 15 16:04:18 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-049ebd1b-5ca5-4e89-a81d-e23491294d6e tempest-SnapshotDependencyTests-1867067896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.653s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:04:18 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-049ebd1b-5ca5-4e89-a81d-e23491294d6e tempest-SnapshotDependencyTests-1867067896 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 16:04:18 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-049ebd1b-5ca5-4e89-a81d-e23491294d6e tempest-SnapshotDependencyTests-1867067896 None] Deleted volume successfully.
Jun 15 16:04:18 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-049ebd1b-5ca5-4e89-a81d-e23491294d6e tempest-SnapshotDependencyTests-1867067896 None] Lock "cinder-b7b985d2-650f-4bce-8ba5-bfcf827cf7dd-delete_volume" released by "delete_volume" :: held 2.414s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:04:18 devstack sudo[106472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-984101dd-f117-4196-8487-6ab22c397c16
Jun 15 16:04:18 devstack sudo[106472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:04:19 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fb614cd-250d-4728-bc48-252aea337502 tempest-VolumesSnapshotTestJSON-35733676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 16:04:19 devstack sudo[106472]: pam_unix(sudo:session): session closed for user root
Jun 15 16:04:19 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8fb614cd-250d-4728-bc48-252aea337502 tempest-VolumesSnapshotTestJSON-35733676 None] Flow 'volume_create_manager' (4612ac2c-9596-4aa4-a5b2-920de7f9180d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:04:19 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8fb614cd-250d-4728-bc48-252aea337502 tempest-VolumesSnapshotTestJSON-35733676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (349ec040-fa42-44f4-9ffa-ce3545a1f667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:04:19 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-e5e8e256-5d6f-46d6-98e8-73b5f11493b1 tempest-SnapshotDependencyTests-1867067896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-984101dd-f117-4196-8487-6ab22c397c16" returned: 0 in 0.858s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:04:19 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-e5e8e256-5d6f-46d6-98e8-73b5f11493b1 tempest-SnapshotDependencyTests-1867067896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-984101dd-f117-4196-8487-6ab22c397c16 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:04:19 devstack sudo[106477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-984101dd-f117-4196-8487-6ab22c397c16
Jun 15 16:04:19 devstack sudo[106477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:04:19 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8fb614cd-250d-4728-bc48-252aea337502 tempest-VolumesSnapshotTestJSON-35733676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (349ec040-fa42-44f4-9ffa-ce3545a1f667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:04:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-441215551',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5591a174-ee41-41c5-9d12-97c50ea7b9a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f573920ba84746b3a4b936f5c5af18d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:04:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a4860ef3-a2d7-4e6a-ba49-2e7f4537764d,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:04:19Z,use_quota=True,user_id='a5748e74c6b14c5095a8e36fe2ab7316',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:04:19 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8fb614cd-250d-4728-bc48-252aea337502 tempest-VolumesSnapshotTestJSON-35733676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e478dafa-a311-4f99-81f0-6c9f56f7e8b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:04:19 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8fb614cd-250d-4728-bc48-252aea337502 tempest-VolumesSnapshotTestJSON-35733676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e478dafa-a311-4f99-81f0-6c9f56f7e8b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:04:19 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8fb614cd-250d-4728-bc48-252aea337502 tempest-VolumesSnapshotTestJSON-35733676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28f7031a-b3d9-4782-9cbf-f75d97058ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:04:19 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8fb614cd-250d-4728-bc48-252aea337502 tempest-VolumesSnapshotTestJSON-35733676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28f7031a-b3d9-4782-9cbf-f75d97058ab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5591a174-ee41-41c5-9d12-97c50ea7b9a2', 'volume_name': 'volume-5591a174-ee41-41c5-9d12-97c50ea7b9a2', 'volume_size': 1, 'snapshot_id': 'a4860ef3-a2d7-4e6a-ba49-2e7f4537764d'}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:04:19 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8fb614cd-250d-4728-bc48-252aea337502 tempest-VolumesSnapshotTestJSON-35733676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (836db73f-297d-4a8f-ac67-9d70db1c47d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:04:19 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8fb614cd-250d-4728-bc48-252aea337502 tempest-VolumesSnapshotTestJSON-35733676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (836db73f-297d-4a8f-ac67-9d70db1c47d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:04:19 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8fb614cd-250d-4728-bc48-252aea337502 tempest-VolumesSnapshotTestJSON-35733676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64c13bf8-72dc-481a-8a09-a4e5d6eb3b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:04:19 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-8fb614cd-250d-4728-bc48-252aea337502 tempest-VolumesSnapshotTestJSON-35733676 None] Volume 5591a174-ee41-41c5-9d12-97c50ea7b9a2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5591a174-ee41-41c5-9d12-97c50ea7b9a2', 'volume_size': 1, 'snapshot_id': 'a4860ef3-a2d7-4e6a-ba49-2e7f4537764d'}
Jun 15 16:04:19 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-8fb614cd-250d-4728-bc48-252aea337502 tempest-VolumesSnapshotTestJSON-35733676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:04:19 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-8fb614cd-250d-4728-bc48-252aea337502 tempest-VolumesSnapshotTestJSON-35733676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:04:19 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-8fb614cd-250d-4728-bc48-252aea337502 tempest-VolumesSnapshotTestJSON-35733676 None] Acquiring lock "cinder-quobyte-a4860ef3-a2d7-4e6a-ba49-2e7f4537764d-5591a174-ee41-41c5-9d12-97c50ea7b9a2" by "_create_volume_from_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:04:19 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-8fb614cd-250d-4728-bc48-252aea337502 tempest-VolumesSnapshotTestJSON-35733676 None] Lock "cinder-quobyte-a4860ef3-a2d7-4e6a-ba49-2e7f4537764d-5591a174-ee41-41c5-9d12-97c50ea7b9a2" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:04:19 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-8fb614cd-250d-4728-bc48-252aea337502 tempest-VolumesSnapshotTestJSON-35733676 None] Creating volume 5591a174-ee41-41c5-9d12-97c50ea7b9a2 from snapshot a4860ef3-a2d7-4e6a-ba49-2e7f4537764d {{(pid=91863) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 15 16:04:19 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-8fb614cd-250d-4728-bc48-252aea337502 tempest-VolumesSnapshotTestJSON-35733676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:04:19 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-8fb614cd-250d-4728-bc48-252aea337502 tempest-VolumesSnapshotTestJSON-35733676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:04:19 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-8fb614cd-250d-4728-bc48-252aea337502 tempest-VolumesSnapshotTestJSON-35733676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:04:19 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-8fb614cd-250d-4728-bc48-252aea337502 tempest-VolumesSnapshotTestJSON-35733676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:04:19 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-8fb614cd-250d-4728-bc48-252aea337502 tempest-VolumesSnapshotTestJSON-35733676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:04:19 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-8fb614cd-250d-4728-bc48-252aea337502 tempest-VolumesSnapshotTestJSON-35733676 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 16:04:19 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-8fb614cd-250d-4728-bc48-252aea337502 tempest-VolumesSnapshotTestJSON-35733676 None] Acquiring lock "cinder-quobyte-5591a174-ee41-41c5-9d12-97c50ea7b9a2" by "_copy_volume_from_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:04:19 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-8fb614cd-250d-4728-bc48-252aea337502 tempest-VolumesSnapshotTestJSON-35733676 None] Lock "cinder-quobyte-5591a174-ee41-41c5-9d12-97c50ea7b9a2" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:04:19 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-8fb614cd-250d-4728-bc48-252aea337502 tempest-VolumesSnapshotTestJSON-35733676 None] snapshot: a4860ef3-a2d7-4e6a-ba49-2e7f4537764d, volume: 5591a174-ee41-41c5-9d12-97c50ea7b9a2,  {{(pid=91863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 15 16:04:19 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-8fb614cd-250d-4728-bc48-252aea337502 tempest-VolumesSnapshotTestJSON-35733676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:04:19 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-8fb614cd-250d-4728-bc48-252aea337502 tempest-VolumesSnapshotTestJSON-35733676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:04:19 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-8fb614cd-250d-4728-bc48-252aea337502 tempest-VolumesSnapshotTestJSON-35733676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:04:19 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-8fb614cd-250d-4728-bc48-252aea337502 tempest-VolumesSnapshotTestJSON-35733676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:04:19 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-8fb614cd-250d-4728-bc48-252aea337502 tempest-VolumesSnapshotTestJSON-35733676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:04:19 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[941287ad-0c8e-48d4-95d2-26439c2268f9]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:04:19 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-8fb614cd-250d-4728-bc48-252aea337502 tempest-VolumesSnapshotTestJSON-35733676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36f08219-eabf-4804-8f04-2d686a027361.a4860ef3-a2d7-4e6a-ba49-2e7f4537764d {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:04:19 devstack sudo[106479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36f08219-eabf-4804-8f04-2d686a027361.a4860ef3-a2d7-4e6a-ba49-2e7f4537764d
Jun 15 16:04:19 devstack sudo[106479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:04:19 devstack sudo[106477]: pam_unix(sudo:session): session closed for user root
Jun 15 16:04:19 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-e5e8e256-5d6f-46d6-98e8-73b5f11493b1 tempest-SnapshotDependencyTests-1867067896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-984101dd-f117-4196-8487-6ab22c397c16" returned: 0 in 0.625s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:04:19 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-e5e8e256-5d6f-46d6-98e8-73b5f11493b1 tempest-SnapshotDependencyTests-1867067896 None] Lock "cinder-quobyte-984101dd-f117-4196-8487-6ab22c397c16" released by "delete_volume" :: held 1.531s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:04:20 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-e5e8e256-5d6f-46d6-98e8-73b5f11493b1 tempest-SnapshotDependencyTests-1867067896 None] Created reservations ['2f76844d-1227-4f62-a777-85cc3587391c', '76eb52c1-48cc-48b9-ac75-c8d328787c1c', '3bb45094-46f1-4221-a817-d55c6de63a03', '735aefe0-0eb6-4bf1-88e8-cce68f22ff31'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 16:04:20 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-e5e8e256-5d6f-46d6-98e8-73b5f11493b1 tempest-SnapshotDependencyTests-1867067896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:04:20 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-e5e8e256-5d6f-46d6-98e8-73b5f11493b1 tempest-SnapshotDependencyTests-1867067896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:04:20 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-e5e8e256-5d6f-46d6-98e8-73b5f11493b1 tempest-SnapshotDependencyTests-1867067896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:04:20 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-e5e8e256-5d6f-46d6-98e8-73b5f11493b1 tempest-SnapshotDependencyTests-1867067896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:04:20 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-e5e8e256-5d6f-46d6-98e8-73b5f11493b1 tempest-SnapshotDependencyTests-1867067896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:04:20 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-e5e8e256-5d6f-46d6-98e8-73b5f11493b1 tempest-SnapshotDependencyTests-1867067896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:04:20 devstack sudo[106482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 16:04:20 devstack sudo[106482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:04:20 devstack sudo[106479]: pam_unix(sudo:session): session closed for user root
Jun 15 16:04:20 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-8fb614cd-250d-4728-bc48-252aea337502 tempest-VolumesSnapshotTestJSON-35733676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36f08219-eabf-4804-8f04-2d686a027361.a4860ef3-a2d7-4e6a-ba49-2e7f4537764d" returned: 0 in 0.948s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:04:20 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-8fb614cd-250d-4728-bc48-252aea337502 tempest-VolumesSnapshotTestJSON-35733676 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36f08219-eabf-4804-8f04-2d686a027361(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 16:04:20 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-8fb614cd-250d-4728-bc48-252aea337502 tempest-VolumesSnapshotTestJSON-35733676 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36f08219-eabf-4804-8f04-2d686a027361 {{(pid=91863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 15 16:04:20 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-8fb614cd-250d-4728-bc48-252aea337502 tempest-VolumesSnapshotTestJSON-35733676 None] Creating direct copy from snapshot {{(pid=91863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 15 16:04:20 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea2987cd-fd7b-45be-9d72-144c51a1dba5]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:04:20 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-8fb614cd-250d-4728-bc48-252aea337502 tempest-VolumesSnapshotTestJSON-35733676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36f08219-eabf-4804-8f04-2d686a027361 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:04:20 devstack sudo[106489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36f08219-eabf-4804-8f04-2d686a027361
Jun 15 16:04:20 devstack sudo[106489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:04:21 devstack sudo[106482]: pam_unix(sudo:session): session closed for user root
Jun 15 16:04:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-e5e8e256-5d6f-46d6-98e8-73b5f11493b1 tempest-SnapshotDependencyTests-1867067896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.825s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:04:21 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-e5e8e256-5d6f-46d6-98e8-73b5f11493b1 tempest-SnapshotDependencyTests-1867067896 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 16:04:21 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-e5e8e256-5d6f-46d6-98e8-73b5f11493b1 tempest-SnapshotDependencyTests-1867067896 None] Deleted volume successfully.
Jun 15 16:04:21 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-e5e8e256-5d6f-46d6-98e8-73b5f11493b1 tempest-SnapshotDependencyTests-1867067896 None] Lock "cinder-984101dd-f117-4196-8487-6ab22c397c16-delete_volume" released by "delete_volume" :: held 2.706s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:04:21 devstack sudo[106489]: pam_unix(sudo:session): session closed for user root
Jun 15 16:04:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-8fb614cd-250d-4728-bc48-252aea337502 tempest-VolumesSnapshotTestJSON-35733676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36f08219-eabf-4804-8f04-2d686a027361" returned: 0 in 0.862s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:04:21 devstack cinder-volume[91863]: DEBUG cinder.utils [None req-8fb614cd-250d-4728-bc48-252aea337502 tempest-VolumesSnapshotTestJSON-35733676 None] Path /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5591a174-ee41-41c5-9d12-97c50ea7b9a2 not found in is_blk_device check {{(pid=91863) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 15 16:04:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-8fb614cd-250d-4728-bc48-252aea337502 tempest-VolumesSnapshotTestJSON-35733676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36f08219-eabf-4804-8f04-2d686a027361 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5591a174-ee41-41c5-9d12-97c50ea7b9a2 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:04:21 devstack sudo[106495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36f08219-eabf-4804-8f04-2d686a027361 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5591a174-ee41-41c5-9d12-97c50ea7b9a2
Jun 15 16:04:21 devstack sudo[106495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:04:27 devstack sudo[106495]: pam_unix(sudo:session): session closed for user root
Jun 15 16:04:27 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-8fb614cd-250d-4728-bc48-252aea337502 tempest-VolumesSnapshotTestJSON-35733676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36f08219-eabf-4804-8f04-2d686a027361 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5591a174-ee41-41c5-9d12-97c50ea7b9a2" returned: 0 in 6.035s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:04:27 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c36f94c-2de4-47c0-a37e-c873c2acc63a]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:04:27 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-8fb614cd-250d-4728-bc48-252aea337502 tempest-VolumesSnapshotTestJSON-35733676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36f08219-eabf-4804-8f04-2d686a027361 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:04:27 devstack sudo[106515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36f08219-eabf-4804-8f04-2d686a027361
Jun 15 16:04:27 devstack sudo[106515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:04:28 devstack sudo[106515]: pam_unix(sudo:session): session closed for user root
Jun 15 16:04:28 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-8fb614cd-250d-4728-bc48-252aea337502 tempest-VolumesSnapshotTestJSON-35733676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36f08219-eabf-4804-8f04-2d686a027361" returned: 0 in 1.080s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:04:28 devstack cinder-volume[91863]: DEBUG cinder.image.image_utils [None req-8fb614cd-250d-4728-bc48-252aea337502 tempest-VolumesSnapshotTestJSON-35733676 None] Image conversion details: src /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36f08219-eabf-4804-8f04-2d686a027361, size 1024.00 MB, duration 6.04 sec, destination /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5591a174-ee41-41c5-9d12-97c50ea7b9a2 {{(pid=91863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 15 16:04:28 devstack cinder-volume[91863]: INFO cinder.image.image_utils [None req-8fb614cd-250d-4728-bc48-252aea337502 tempest-VolumesSnapshotTestJSON-35733676 None] Converted 1024.00 MB image at 169.63 MB/s
Jun 15 16:04:28 devstack cinder-volume[91863]: WARNING cinder.volume.drivers.remotefs [None req-8fb614cd-250d-4728-bc48-252aea337502 tempest-VolumesSnapshotTestJSON-35733676 None] /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5591a174-ee41-41c5-9d12-97c50ea7b9a2 is being set with open permissions: ugo+rw
Jun 15 16:04:28 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-8fb614cd-250d-4728-bc48-252aea337502 tempest-VolumesSnapshotTestJSON-35733676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5591a174-ee41-41c5-9d12-97c50ea7b9a2 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:04:28 devstack sudo[106520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5591a174-ee41-41c5-9d12-97c50ea7b9a2
Jun 15 16:04:28 devstack sudo[106520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:04:29 devstack sudo[106520]: pam_unix(sudo:session): session closed for user root
Jun 15 16:04:29 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-8fb614cd-250d-4728-bc48-252aea337502 tempest-VolumesSnapshotTestJSON-35733676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5591a174-ee41-41c5-9d12-97c50ea7b9a2" returned: 0 in 0.730s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:04:29 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-8fb614cd-250d-4728-bc48-252aea337502 tempest-VolumesSnapshotTestJSON-35733676 None] Lock "cinder-quobyte-5591a174-ee41-41c5-9d12-97c50ea7b9a2" released by "_copy_volume_from_snapshot" :: held 9.774s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:04:29 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-8fb614cd-250d-4728-bc48-252aea337502 tempest-VolumesSnapshotTestJSON-35733676 None] Lock "cinder-quobyte-a4860ef3-a2d7-4e6a-ba49-2e7f4537764d-5591a174-ee41-41c5-9d12-97c50ea7b9a2" released by "_create_volume_from_snapshot" :: held 9.824s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:04:29 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-8fb614cd-250d-4728-bc48-252aea337502 tempest-VolumesSnapshotTestJSON-35733676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.849s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:04:29 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8fb614cd-250d-4728-bc48-252aea337502 tempest-VolumesSnapshotTestJSON-35733676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64c13bf8-72dc-481a-8a09-a4e5d6eb3b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5591a174-ee41-41c5-9d12-97c50ea7b9a2', 'volume_size': 1, 'snapshot_id': 'a4860ef3-a2d7-4e6a-ba49-2e7f4537764d'}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:04:29 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8fb614cd-250d-4728-bc48-252aea337502 tempest-VolumesSnapshotTestJSON-35733676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3711a0ae-3c5d-4fc3-a25f-d41ebba66eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:04:29 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-8fb614cd-250d-4728-bc48-252aea337502 tempest-VolumesSnapshotTestJSON-35733676 None] Volume volume-5591a174-ee41-41c5-9d12-97c50ea7b9a2 (5591a174-ee41-41c5-9d12-97c50ea7b9a2): created successfully
Jun 15 16:04:29 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8fb614cd-250d-4728-bc48-252aea337502 tempest-VolumesSnapshotTestJSON-35733676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3711a0ae-3c5d-4fc3-a25f-d41ebba66eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:04:29 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8fb614cd-250d-4728-bc48-252aea337502 tempest-VolumesSnapshotTestJSON-35733676 None] Flow 'volume_create_manager' (4612ac2c-9596-4aa4-a5b2-920de7f9180d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:04:29 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-8fb614cd-250d-4728-bc48-252aea337502 tempest-VolumesSnapshotTestJSON-35733676 None] Created volume successfully.
Jun 15 16:04:29 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-51548cb0-1e45-4808-b811-d90e5ae16d79 tempest-VolumesSnapshotTestJSON-35733676 None] Acquiring lock "cinder-5591a174-ee41-41c5-9d12-97c50ea7b9a2-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:04:29 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-51548cb0-1e45-4808-b811-d90e5ae16d79 tempest-VolumesSnapshotTestJSON-35733676 None] Lock "cinder-5591a174-ee41-41c5-9d12-97c50ea7b9a2-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:04:29 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-51548cb0-1e45-4808-b811-d90e5ae16d79 tempest-VolumesSnapshotTestJSON-35733676 None] Acquiring lock "cinder-quobyte-5591a174-ee41-41c5-9d12-97c50ea7b9a2" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:04:29 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-51548cb0-1e45-4808-b811-d90e5ae16d79 tempest-VolumesSnapshotTestJSON-35733676 None] Lock "cinder-quobyte-5591a174-ee41-41c5-9d12-97c50ea7b9a2" acquired by "delete_volume" :: waited 0.022s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:04:29 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[64a6e436-1e95-4d72-8a35-e9e5458a3927]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:04:29 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-51548cb0-1e45-4808-b811-d90e5ae16d79 tempest-VolumesSnapshotTestJSON-35733676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5591a174-ee41-41c5-9d12-97c50ea7b9a2 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:04:29 devstack sudo[106524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5591a174-ee41-41c5-9d12-97c50ea7b9a2
Jun 15 16:04:29 devstack sudo[106524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:04:30 devstack sudo[106524]: pam_unix(sudo:session): session closed for user root
Jun 15 16:04:30 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-51548cb0-1e45-4808-b811-d90e5ae16d79 tempest-VolumesSnapshotTestJSON-35733676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5591a174-ee41-41c5-9d12-97c50ea7b9a2" returned: 0 in 0.820s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:04:30 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-51548cb0-1e45-4808-b811-d90e5ae16d79 tempest-VolumesSnapshotTestJSON-35733676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5591a174-ee41-41c5-9d12-97c50ea7b9a2 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:04:30 devstack sudo[106529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5591a174-ee41-41c5-9d12-97c50ea7b9a2
Jun 15 16:04:30 devstack sudo[106529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:04:31 devstack cinder-volume[91863]: DEBUG oslo_service.periodic_task [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 16:04:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:04:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:04:31 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:04:31 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:04:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:04:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:04:31 devstack sudo[106529]: pam_unix(sudo:session): session closed for user root
Jun 15 16:04:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-51548cb0-1e45-4808-b811-d90e5ae16d79 tempest-VolumesSnapshotTestJSON-35733676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-5591a174-ee41-41c5-9d12-97c50ea7b9a2" returned: 0 in 0.659s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:04:31 devstack sudo[106532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 16:04:31 devstack sudo[106532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:04:31 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-51548cb0-1e45-4808-b811-d90e5ae16d79 tempest-VolumesSnapshotTestJSON-35733676 None] Lock "cinder-quobyte-5591a174-ee41-41c5-9d12-97c50ea7b9a2" released by "delete_volume" :: held 1.545s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:04:31 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-51548cb0-1e45-4808-b811-d90e5ae16d79 tempest-VolumesSnapshotTestJSON-35733676 None] Created reservations ['65bd2a41-a43f-4d6b-853f-6b98ac521ee9', 'eb22f189-dbe8-4d0e-ab2b-6cfabe9eb6d2', 'd4627953-26d4-464d-80d5-82586edd538e', '26e0fbaa-34e7-4951-be68-d2bf06215fa3'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 16:04:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-51548cb0-1e45-4808-b811-d90e5ae16d79 tempest-VolumesSnapshotTestJSON-35733676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:04:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-51548cb0-1e45-4808-b811-d90e5ae16d79 tempest-VolumesSnapshotTestJSON-35733676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:04:31 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-51548cb0-1e45-4808-b811-d90e5ae16d79 tempest-VolumesSnapshotTestJSON-35733676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:04:31 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-51548cb0-1e45-4808-b811-d90e5ae16d79 tempest-VolumesSnapshotTestJSON-35733676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:04:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-51548cb0-1e45-4808-b811-d90e5ae16d79 tempest-VolumesSnapshotTestJSON-35733676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:04:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-51548cb0-1e45-4808-b811-d90e5ae16d79 tempest-VolumesSnapshotTestJSON-35733676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:04:31 devstack sudo[106534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 16:04:31 devstack sudo[106534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:04:31 devstack sudo[106532]: pam_unix(sudo:session): session closed for user root
Jun 15 16:04:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.776s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:04:31 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 16:04:31 devstack cinder-volume[91863]: DEBUG oslo_service.periodic_task [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Running periodic task VolumeManager._thread_info {{(pid=91863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 16:04:31 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] thread count: 28 {{(pid=91863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 15 16:04:31 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] thread info: [<_MainThread(MainThread, started 131088232640640)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131088122704576)>, <Thread(Thread-3 (stat_writer), started daemon 131088123058112)>, <Thread(Rabbit-heartbeat, started daemon 131088121268864)>, <Thread(Thread-5 (_runner), started daemon 131088121904192)>, <Thread(Thread-7 (_runner), started daemon 131088122037248)>, <Thread(fd_logger, started daemon 131088119630784)>, <Thread(privsep_reader, started daemon 131088119781440)>, <Thread(tpool_thread_0, started daemon 131088111617728)>, <Thread(tpool_thread_1, started daemon 131088103225024)>, <Thread(tpool_thread_2, started daemon 131088094832320)>, <Thread(tpool_thread_3, started daemon 131088086439616)>, <Thread(tpool_thread_4, started daemon 131088078046912)>, <Thread(tpool_thread_5, started daemon 131088069654208)>, <Thread(tpool_thread_6, started daemon 131088061261504)>, <Thread(tpool_thread_7, started daemon 131088052868800)>, <Thread(tpool_thread_8, started daemon 131088044476096)>, <Thread(tpool_thread_9, started daemon 131088036083392)>, <Thread(tpool_thread_10, started daemon 131088027690688)>, <Thread(tpool_thread_11, started daemon 131088019297984)>, <Thread(tpool_thread_12, started daemon 131088010905280)>, <Thread(tpool_thread_13, started daemon 131088002512576)>, <Thread(tpool_thread_14, started daemon 131087994119872)>, <Thread(tpool_thread_15, started daemon 131087985727168)>, <Thread(tpool_thread_16, started daemon 131087977334464)>, <Thread(tpool_thread_17, started daemon 131087968941760)>, <Thread(tpool_thread_18, started daemon 131087960549056)>, <Thread(tpool_thread_19, started daemon 131087952156352)>] {{(pid=91863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 15 16:04:31 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-ce8f4719-d70c-4a97-9b78-63c6cc828254 tempest-VolumesSnapshotTestJSON-35733676 None] Acquiring lock "cinder-a4860ef3-a2d7-4e6a-ba49-2e7f4537764d-delete_snapshot" by "delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:04:31 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-ce8f4719-d70c-4a97-9b78-63c6cc828254 tempest-VolumesSnapshotTestJSON-35733676 None] Lock "cinder-a4860ef3-a2d7-4e6a-ba49-2e7f4537764d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:04:32 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-ce8f4719-d70c-4a97-9b78-63c6cc828254 tempest-VolumesSnapshotTestJSON-35733676 None] Acquiring lock "cinder-quobyte-36f08219-eabf-4804-8f04-2d686a027361" by "delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:04:32 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-ce8f4719-d70c-4a97-9b78-63c6cc828254 tempest-VolumesSnapshotTestJSON-35733676 None] Lock "cinder-quobyte-36f08219-eabf-4804-8f04-2d686a027361" acquired by "delete_snapshot" :: waited 0.033s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:04:32 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-ce8f4719-d70c-4a97-9b78-63c6cc828254 tempest-VolumesSnapshotTestJSON-35733676 None] Acquiring lock "cinder-quobyte-a4860ef3-a2d7-4e6a-ba49-2e7f4537764d" by "_delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:04:32 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-ce8f4719-d70c-4a97-9b78-63c6cc828254 tempest-VolumesSnapshotTestJSON-35733676 None] Lock "cinder-quobyte-a4860ef3-a2d7-4e6a-ba49-2e7f4537764d" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:04:32 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-ce8f4719-d70c-4a97-9b78-63c6cc828254 tempest-VolumesSnapshotTestJSON-35733676 None] Deleting offline snapshot a4860ef3-a2d7-4e6a-ba49-2e7f4537764d of volume 36f08219-eabf-4804-8f04-2d686a027361 {{(pid=91863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 15 16:04:32 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-ce8f4719-d70c-4a97-9b78-63c6cc828254 tempest-VolumesSnapshotTestJSON-35733676 None] snapshot_file for this snap is: volume-36f08219-eabf-4804-8f04-2d686a027361.a4860ef3-a2d7-4e6a-ba49-2e7f4537764d {{(pid=91863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 15 16:04:32 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[669f02b1-79fd-484c-a344-62fb320b58db]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:04:32 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ce8f4719-d70c-4a97-9b78-63c6cc828254 tempest-VolumesSnapshotTestJSON-35733676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36f08219-eabf-4804-8f04-2d686a027361.a4860ef3-a2d7-4e6a-ba49-2e7f4537764d {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:04:32 devstack sudo[106534]: pam_unix(sudo:session): session closed for user root
Jun 15 16:04:32 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-51548cb0-1e45-4808-b811-d90e5ae16d79 tempest-VolumesSnapshotTestJSON-35733676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.801s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:04:32 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-51548cb0-1e45-4808-b811-d90e5ae16d79 tempest-VolumesSnapshotTestJSON-35733676 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 16:04:32 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-51548cb0-1e45-4808-b811-d90e5ae16d79 tempest-VolumesSnapshotTestJSON-35733676 None] Deleted volume successfully.
Jun 15 16:04:32 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-51548cb0-1e45-4808-b811-d90e5ae16d79 tempest-VolumesSnapshotTestJSON-35733676 None] Lock "cinder-5591a174-ee41-41c5-9d12-97c50ea7b9a2-delete_volume" released by "delete_volume" :: held 2.627s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:04:32 devstack sudo[106539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36f08219-eabf-4804-8f04-2d686a027361.a4860ef3-a2d7-4e6a-ba49-2e7f4537764d
Jun 15 16:04:32 devstack sudo[106539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:04:32 devstack sudo[106539]: pam_unix(sudo:session): session closed for user root
Jun 15 16:04:32 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ce8f4719-d70c-4a97-9b78-63c6cc828254 tempest-VolumesSnapshotTestJSON-35733676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36f08219-eabf-4804-8f04-2d686a027361.a4860ef3-a2d7-4e6a-ba49-2e7f4537764d" returned: 0 in 0.790s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:04:32 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-ce8f4719-d70c-4a97-9b78-63c6cc828254 tempest-VolumesSnapshotTestJSON-35733676 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36f08219-eabf-4804-8f04-2d686a027361(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 16:04:32 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d207cd-49fa-4799-9305-2ec35214d01f]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:04:32 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ce8f4719-d70c-4a97-9b78-63c6cc828254 tempest-VolumesSnapshotTestJSON-35733676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36f08219-eabf-4804-8f04-2d686a027361 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:04:33 devstack sudo[106544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36f08219-eabf-4804-8f04-2d686a027361
Jun 15 16:04:33 devstack sudo[106544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:04:33 devstack sudo[106544]: pam_unix(sudo:session): session closed for user root
Jun 15 16:04:33 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ce8f4719-d70c-4a97-9b78-63c6cc828254 tempest-VolumesSnapshotTestJSON-35733676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36f08219-eabf-4804-8f04-2d686a027361" returned: 0 in 0.849s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:04:33 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ce8f4719-d70c-4a97-9b78-63c6cc828254 tempest-VolumesSnapshotTestJSON-35733676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36f08219-eabf-4804-8f04-2d686a027361.a4860ef3-a2d7-4e6a-ba49-2e7f4537764d {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:04:33 devstack sudo[106550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36f08219-eabf-4804-8f04-2d686a027361.a4860ef3-a2d7-4e6a-ba49-2e7f4537764d
Jun 15 16:04:33 devstack sudo[106550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:04:34 devstack sudo[106550]: pam_unix(sudo:session): session closed for user root
Jun 15 16:04:34 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ce8f4719-d70c-4a97-9b78-63c6cc828254 tempest-VolumesSnapshotTestJSON-35733676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36f08219-eabf-4804-8f04-2d686a027361.a4860ef3-a2d7-4e6a-ba49-2e7f4537764d" returned: 0 in 0.946s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:04:34 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ce8f4719-d70c-4a97-9b78-63c6cc828254 tempest-VolumesSnapshotTestJSON-35733676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36f08219-eabf-4804-8f04-2d686a027361.a4860ef3-a2d7-4e6a-ba49-2e7f4537764d {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:04:34 devstack sudo[106556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36f08219-eabf-4804-8f04-2d686a027361.a4860ef3-a2d7-4e6a-ba49-2e7f4537764d
Jun 15 16:04:34 devstack sudo[106556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:04:35 devstack sudo[106556]: pam_unix(sudo:session): session closed for user root
Jun 15 16:04:35 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ce8f4719-d70c-4a97-9b78-63c6cc828254 tempest-VolumesSnapshotTestJSON-35733676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36f08219-eabf-4804-8f04-2d686a027361.a4860ef3-a2d7-4e6a-ba49-2e7f4537764d" returned: 0 in 0.845s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:04:35 devstack cinder-volume[91863]: DEBUG dbcounter [-] [91863] Writing DB stats cinder:SELECT=72,cinder:INSERT=21,cinder:UPDATE=84,cinder:DELETE=6 {{(pid=91863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 16:04:35 devstack cinder-volume[91863]: DEBUG dbcounter [-] [91863] Writing DB stats cinder:SELECT=69,cinder:INSERT=21,cinder:UPDATE=84,cinder:DELETE=9 {{(pid=91863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 16:04:35 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-ce8f4719-d70c-4a97-9b78-63c6cc828254 tempest-VolumesSnapshotTestJSON-35733676 None] Lock "cinder-quobyte-a4860ef3-a2d7-4e6a-ba49-2e7f4537764d" released by "_delete_snapshot" :: held 3.622s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:04:35 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-ce8f4719-d70c-4a97-9b78-63c6cc828254 tempest-VolumesSnapshotTestJSON-35733676 None] Lock "cinder-quobyte-36f08219-eabf-4804-8f04-2d686a027361" released by "delete_snapshot" :: held 3.673s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:04:35 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-ce8f4719-d70c-4a97-9b78-63c6cc828254 tempest-VolumesSnapshotTestJSON-35733676 None] Created reservations ['d17e440d-763e-4a57-a422-22ea57b8601e', 'c753ec7f-abe8-4d0c-a9a7-8202dfe0e011', 'c66cb230-574c-4d3b-b44d-26d5cd632e8f', '8a11e286-675c-4a45-aa5c-9565bfc655cd'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 16:04:35 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-ce8f4719-d70c-4a97-9b78-63c6cc828254 tempest-VolumesSnapshotTestJSON-35733676 None] Delete snapshot completed successfully.
Jun 15 16:04:35 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-ce8f4719-d70c-4a97-9b78-63c6cc828254 tempest-VolumesSnapshotTestJSON-35733676 None] Lock "cinder-a4860ef3-a2d7-4e6a-ba49-2e7f4537764d-delete_snapshot" released by "delete_snapshot" :: held 3.903s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:04:36 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-5d103395-d3d4-43ba-b994-2c7be5a80ec9 tempest-VolumesSnapshotTestJSON-35733676 None] Acquiring lock "cinder-36f08219-eabf-4804-8f04-2d686a027361-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:04:36 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-5d103395-d3d4-43ba-b994-2c7be5a80ec9 tempest-VolumesSnapshotTestJSON-35733676 None] Lock "cinder-36f08219-eabf-4804-8f04-2d686a027361-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:04:36 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-5d103395-d3d4-43ba-b994-2c7be5a80ec9 tempest-VolumesSnapshotTestJSON-35733676 None] Acquiring lock "cinder-quobyte-36f08219-eabf-4804-8f04-2d686a027361" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:04:36 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-5d103395-d3d4-43ba-b994-2c7be5a80ec9 tempest-VolumesSnapshotTestJSON-35733676 None] Lock "cinder-quobyte-36f08219-eabf-4804-8f04-2d686a027361" acquired by "delete_volume" :: waited 0.028s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:04:36 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[270764ee-5144-43fb-8c50-e67767b7947f]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:04:36 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5d103395-d3d4-43ba-b994-2c7be5a80ec9 tempest-VolumesSnapshotTestJSON-35733676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36f08219-eabf-4804-8f04-2d686a027361 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:04:36 devstack sudo[106560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36f08219-eabf-4804-8f04-2d686a027361
Jun 15 16:04:36 devstack sudo[106560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:04:37 devstack sudo[106560]: pam_unix(sudo:session): session closed for user root
Jun 15 16:04:37 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5d103395-d3d4-43ba-b994-2c7be5a80ec9 tempest-VolumesSnapshotTestJSON-35733676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36f08219-eabf-4804-8f04-2d686a027361" returned: 0 in 0.828s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:04:37 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5d103395-d3d4-43ba-b994-2c7be5a80ec9 tempest-VolumesSnapshotTestJSON-35733676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36f08219-eabf-4804-8f04-2d686a027361 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:04:37 devstack sudo[106565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36f08219-eabf-4804-8f04-2d686a027361
Jun 15 16:04:37 devstack sudo[106565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:04:38 devstack sudo[106565]: pam_unix(sudo:session): session closed for user root
Jun 15 16:04:38 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5d103395-d3d4-43ba-b994-2c7be5a80ec9 tempest-VolumesSnapshotTestJSON-35733676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-36f08219-eabf-4804-8f04-2d686a027361" returned: 0 in 0.853s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:04:38 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-5d103395-d3d4-43ba-b994-2c7be5a80ec9 tempest-VolumesSnapshotTestJSON-35733676 None] Lock "cinder-quobyte-36f08219-eabf-4804-8f04-2d686a027361" released by "delete_volume" :: held 1.761s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:04:38 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-5d103395-d3d4-43ba-b994-2c7be5a80ec9 tempest-VolumesSnapshotTestJSON-35733676 None] Created reservations ['4d0628d5-acd6-47e6-85d6-8969810f54af', '4fb6e930-e787-485b-93e5-da8007617be5', 'b0e00761-c86b-42ad-affa-11ae1478b037', 'a6be6fba-1d62-4c27-9e8a-f6c93f02e5cd'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 16:04:38 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-5d103395-d3d4-43ba-b994-2c7be5a80ec9 tempest-VolumesSnapshotTestJSON-35733676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:04:38 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-5d103395-d3d4-43ba-b994-2c7be5a80ec9 tempest-VolumesSnapshotTestJSON-35733676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:04:38 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-5d103395-d3d4-43ba-b994-2c7be5a80ec9 tempest-VolumesSnapshotTestJSON-35733676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:04:38 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-5d103395-d3d4-43ba-b994-2c7be5a80ec9 tempest-VolumesSnapshotTestJSON-35733676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:04:38 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-5d103395-d3d4-43ba-b994-2c7be5a80ec9 tempest-VolumesSnapshotTestJSON-35733676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:04:38 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5d103395-d3d4-43ba-b994-2c7be5a80ec9 tempest-VolumesSnapshotTestJSON-35733676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:04:38 devstack sudo[106602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 16:04:38 devstack sudo[106602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:04:38 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-c71d046c-5a88-4497-8350-2df7968277ea tempest-VolumesSnapshotTestJSON-35733676 None] Acquiring lock "cinder-76c913c9-6030-4a0e-80c8-66c72477133e-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:04:38 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-c71d046c-5a88-4497-8350-2df7968277ea tempest-VolumesSnapshotTestJSON-35733676 None] Lock "cinder-76c913c9-6030-4a0e-80c8-66c72477133e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:04:38 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-c71d046c-5a88-4497-8350-2df7968277ea tempest-VolumesSnapshotTestJSON-35733676 None] Acquiring lock "cinder-quobyte-76c913c9-6030-4a0e-80c8-66c72477133e" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:04:38 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-c71d046c-5a88-4497-8350-2df7968277ea tempest-VolumesSnapshotTestJSON-35733676 None] Lock "cinder-quobyte-76c913c9-6030-4a0e-80c8-66c72477133e" acquired by "delete_volume" :: waited 0.028s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:04:38 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[08fa3a98-4ffa-4aeb-8930-70c0fd3748cf]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:04:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c71d046c-5a88-4497-8350-2df7968277ea tempest-VolumesSnapshotTestJSON-35733676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-76c913c9-6030-4a0e-80c8-66c72477133e {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:04:39 devstack sudo[106606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-76c913c9-6030-4a0e-80c8-66c72477133e
Jun 15 16:04:39 devstack sudo[106606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:04:39 devstack sudo[106602]: pam_unix(sudo:session): session closed for user root
Jun 15 16:04:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5d103395-d3d4-43ba-b994-2c7be5a80ec9 tempest-VolumesSnapshotTestJSON-35733676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.812s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:04:39 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-5d103395-d3d4-43ba-b994-2c7be5a80ec9 tempest-VolumesSnapshotTestJSON-35733676 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 16:04:39 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-5d103395-d3d4-43ba-b994-2c7be5a80ec9 tempest-VolumesSnapshotTestJSON-35733676 None] Deleted volume successfully.
Jun 15 16:04:39 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-5d103395-d3d4-43ba-b994-2c7be5a80ec9 tempest-VolumesSnapshotTestJSON-35733676 None] Lock "cinder-36f08219-eabf-4804-8f04-2d686a027361-delete_volume" released by "delete_volume" :: held 2.916s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:04:40 devstack sudo[106606]: pam_unix(sudo:session): session closed for user root
Jun 15 16:04:40 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c71d046c-5a88-4497-8350-2df7968277ea tempest-VolumesSnapshotTestJSON-35733676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-76c913c9-6030-4a0e-80c8-66c72477133e" returned: 0 in 1.013s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:04:40 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c71d046c-5a88-4497-8350-2df7968277ea tempest-VolumesSnapshotTestJSON-35733676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-76c913c9-6030-4a0e-80c8-66c72477133e {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:04:40 devstack sudo[106612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-76c913c9-6030-4a0e-80c8-66c72477133e
Jun 15 16:04:40 devstack sudo[106612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:04:40 devstack sudo[106612]: pam_unix(sudo:session): session closed for user root
Jun 15 16:04:40 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c71d046c-5a88-4497-8350-2df7968277ea tempest-VolumesSnapshotTestJSON-35733676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-76c913c9-6030-4a0e-80c8-66c72477133e" returned: 0 in 0.762s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:04:40 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-c71d046c-5a88-4497-8350-2df7968277ea tempest-VolumesSnapshotTestJSON-35733676 None] Lock "cinder-quobyte-76c913c9-6030-4a0e-80c8-66c72477133e" released by "delete_volume" :: held 1.883s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:04:40 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-c71d046c-5a88-4497-8350-2df7968277ea tempest-VolumesSnapshotTestJSON-35733676 None] Created reservations ['4fa51360-b4e6-4798-b92a-b9b3fe7c6405', 'fbc6aff8-39a9-46cd-b9db-65c14ff519e6', 'b8c26059-dc2b-4b8f-83ac-4b6f74f29dfe', '841fad05-9279-4ea4-a9ca-f9482e00a0b4'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 16:04:40 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-c71d046c-5a88-4497-8350-2df7968277ea tempest-VolumesSnapshotTestJSON-35733676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:04:40 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-c71d046c-5a88-4497-8350-2df7968277ea tempest-VolumesSnapshotTestJSON-35733676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:04:40 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-c71d046c-5a88-4497-8350-2df7968277ea tempest-VolumesSnapshotTestJSON-35733676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:04:40 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-c71d046c-5a88-4497-8350-2df7968277ea tempest-VolumesSnapshotTestJSON-35733676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:04:40 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-c71d046c-5a88-4497-8350-2df7968277ea tempest-VolumesSnapshotTestJSON-35733676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:04:40 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c71d046c-5a88-4497-8350-2df7968277ea tempest-VolumesSnapshotTestJSON-35733676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:04:40 devstack sudo[106615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 16:04:40 devstack sudo[106615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:04:41 devstack sudo[106615]: pam_unix(sudo:session): session closed for user root
Jun 15 16:04:41 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c71d046c-5a88-4497-8350-2df7968277ea tempest-VolumesSnapshotTestJSON-35733676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.626s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:04:41 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-c71d046c-5a88-4497-8350-2df7968277ea tempest-VolumesSnapshotTestJSON-35733676 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 16:04:41 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-c71d046c-5a88-4497-8350-2df7968277ea tempest-VolumesSnapshotTestJSON-35733676 None] Deleted volume successfully.
Jun 15 16:04:41 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-c71d046c-5a88-4497-8350-2df7968277ea tempest-VolumesSnapshotTestJSON-35733676 None] Lock "cinder-76c913c9-6030-4a0e-80c8-66c72477133e-delete_volume" released by "delete_volume" :: held 2.781s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:04:50 devstack cinder-volume[91863]: DEBUG dbcounter [-] [91863] Writing DB stats cinder:SELECT=17,cinder:INSERT=8,cinder:UPDATE=23 {{(pid=91863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 16:04:51 devstack cinder-volume[91863]: DEBUG dbcounter [-] [91863] Writing DB stats cinder:SELECT=12,cinder:INSERT=4,cinder:UPDATE=20,cinder:DELETE=2 {{(pid=91863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 16:05:02 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-56f9b791-361a-4562-97d7-4ecdc581313c tempest-TestMinimumBasicScenario-876912226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 16:05:02 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-56f9b791-361a-4562-97d7-4ecdc581313c tempest-TestMinimumBasicScenario-876912226 None] Flow 'volume_create_manager' (f993eb1f-8a60-4b12-b259-0dc9331b3fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:05:02 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-56f9b791-361a-4562-97d7-4ecdc581313c tempest-TestMinimumBasicScenario-876912226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f461c1a-997c-416f-ae86-93bd738b6073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:05:02 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-56f9b791-361a-4562-97d7-4ecdc581313c tempest-TestMinimumBasicScenario-876912226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f461c1a-997c-416f-ae86-93bd738b6073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:05:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1457164758',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a103c420-2fb1-4630-b304-5d982d5eac39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14ab4a228a18485786771e6333b09298',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:05:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:05:02Z,use_quota=True,user_id='5a6482fa06fd4a56922cef8810242719',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:05:02 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-56f9b791-361a-4562-97d7-4ecdc581313c tempest-TestMinimumBasicScenario-876912226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e40c6b2-80fa-42c6-9043-602cb56457ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:05:02 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-56f9b791-361a-4562-97d7-4ecdc581313c tempest-TestMinimumBasicScenario-876912226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e40c6b2-80fa-42c6-9043-602cb56457ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:05:02 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-56f9b791-361a-4562-97d7-4ecdc581313c tempest-TestMinimumBasicScenario-876912226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b25fcda-3c8b-486f-8b99-2b4738820525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:05:02 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-56f9b791-361a-4562-97d7-4ecdc581313c tempest-TestMinimumBasicScenario-876912226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b25fcda-3c8b-486f-8b99-2b4738820525) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a103c420-2fb1-4630-b304-5d982d5eac39', 'volume_name': 'volume-a103c420-2fb1-4630-b304-5d982d5eac39', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:05:02 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-56f9b791-361a-4562-97d7-4ecdc581313c tempest-TestMinimumBasicScenario-876912226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa7127d9-dd56-4e16-9074-8298fc8de7ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:05:02 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-56f9b791-361a-4562-97d7-4ecdc581313c tempest-TestMinimumBasicScenario-876912226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa7127d9-dd56-4e16-9074-8298fc8de7ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:05:02 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-56f9b791-361a-4562-97d7-4ecdc581313c tempest-TestMinimumBasicScenario-876912226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (509436e7-8236-40c1-8ab6-57e77bb0c2bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:05:02 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-56f9b791-361a-4562-97d7-4ecdc581313c tempest-TestMinimumBasicScenario-876912226 None] Volume a103c420-2fb1-4630-b304-5d982d5eac39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a103c420-2fb1-4630-b304-5d982d5eac39', 'volume_size': 1}
Jun 15 16:05:02 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-56f9b791-361a-4562-97d7-4ecdc581313c tempest-TestMinimumBasicScenario-876912226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:05:02 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-56f9b791-361a-4562-97d7-4ecdc581313c tempest-TestMinimumBasicScenario-876912226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:05:02 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-56f9b791-361a-4562-97d7-4ecdc581313c tempest-TestMinimumBasicScenario-876912226 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:05:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1457164758',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a103c420-2fb1-4630-b304-5d982d5eac39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14ab4a228a18485786771e6333b09298',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:05:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:05:02Z,use_quota=True,user_id='5a6482fa06fd4a56922cef8810242719',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 16:05:02 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-56f9b791-361a-4562-97d7-4ecdc581313c tempest-TestMinimumBasicScenario-876912226 None] Creating volume a103c420-2fb1-4630-b304-5d982d5eac39 {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 16:05:02 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-56f9b791-361a-4562-97d7-4ecdc581313c tempest-TestMinimumBasicScenario-876912226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:05:02 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-56f9b791-361a-4562-97d7-4ecdc581313c tempest-TestMinimumBasicScenario-876912226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:05:02 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-56f9b791-361a-4562-97d7-4ecdc581313c tempest-TestMinimumBasicScenario-876912226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:05:02 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-56f9b791-361a-4562-97d7-4ecdc581313c tempest-TestMinimumBasicScenario-876912226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:05:02 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-56f9b791-361a-4562-97d7-4ecdc581313c tempest-TestMinimumBasicScenario-876912226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:05:02 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-56f9b791-361a-4562-97d7-4ecdc581313c tempest-TestMinimumBasicScenario-876912226 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 16:05:02 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-56f9b791-361a-4562-97d7-4ecdc581313c tempest-TestMinimumBasicScenario-876912226 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 16:05:02 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-56f9b791-361a-4562-97d7-4ecdc581313c tempest-TestMinimumBasicScenario-876912226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a103c420-2fb1-4630-b304-5d982d5eac39 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:05:02 devstack sudo[106729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a103c420-2fb1-4630-b304-5d982d5eac39 1073741824
Jun 15 16:05:02 devstack sudo[106729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:05:03 devstack sudo[106729]: pam_unix(sudo:session): session closed for user root
Jun 15 16:05:03 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-56f9b791-361a-4562-97d7-4ecdc581313c tempest-TestMinimumBasicScenario-876912226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a103c420-2fb1-4630-b304-5d982d5eac39 1073741824" returned: 0 in 0.976s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:05:03 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-56f9b791-361a-4562-97d7-4ecdc581313c tempest-TestMinimumBasicScenario-876912226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a103c420-2fb1-4630-b304-5d982d5eac39 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:05:03 devstack sudo[106735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a103c420-2fb1-4630-b304-5d982d5eac39
Jun 15 16:05:03 devstack sudo[106735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:05:04 devstack sudo[106735]: pam_unix(sudo:session): session closed for user root
Jun 15 16:05:04 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-56f9b791-361a-4562-97d7-4ecdc581313c tempest-TestMinimumBasicScenario-876912226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a103c420-2fb1-4630-b304-5d982d5eac39" returned: 0 in 0.710s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:05:04 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-56f9b791-361a-4562-97d7-4ecdc581313c tempest-TestMinimumBasicScenario-876912226 None] <== create_volume: return (1733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 16:05:04 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-56f9b791-361a-4562-97d7-4ecdc581313c tempest-TestMinimumBasicScenario-876912226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.737s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:05:04 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-56f9b791-361a-4562-97d7-4ecdc581313c tempest-TestMinimumBasicScenario-876912226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (509436e7-8236-40c1-8ab6-57e77bb0c2bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a103c420-2fb1-4630-b304-5d982d5eac39', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:05:04 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-56f9b791-361a-4562-97d7-4ecdc581313c tempest-TestMinimumBasicScenario-876912226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (738bdc18-8f08-4d09-8d37-d76e2aeeb059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:05:04 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-56f9b791-361a-4562-97d7-4ecdc581313c tempest-TestMinimumBasicScenario-876912226 None] Volume volume-a103c420-2fb1-4630-b304-5d982d5eac39 (a103c420-2fb1-4630-b304-5d982d5eac39): created successfully
Jun 15 16:05:04 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-56f9b791-361a-4562-97d7-4ecdc581313c tempest-TestMinimumBasicScenario-876912226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (738bdc18-8f08-4d09-8d37-d76e2aeeb059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:05:04 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-56f9b791-361a-4562-97d7-4ecdc581313c tempest-TestMinimumBasicScenario-876912226 None] Flow 'volume_create_manager' (f993eb1f-8a60-4b12-b259-0dc9331b3fa1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:05:04 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-56f9b791-361a-4562-97d7-4ecdc581313c tempest-TestMinimumBasicScenario-876912226 None] Created volume successfully.
Jun 15 16:05:08 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [req-968f609d-fc44-48dc-b3c0-09e1988746bc req-ce8c7a5a-733b-43ea-8276-8401287498a2 tempest-TestMinimumBasicScenario-876912226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:05:08 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [req-968f609d-fc44-48dc-b3c0-09e1988746bc req-ce8c7a5a-733b-43ea-8276-8401287498a2 tempest-TestMinimumBasicScenario-876912226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:05:08 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce45f15-197e-429e-a638-e2986a8865a7]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:05:08 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-968f609d-fc44-48dc-b3c0-09e1988746bc req-ce8c7a5a-733b-43ea-8276-8401287498a2 tempest-TestMinimumBasicScenario-876912226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a103c420-2fb1-4630-b304-5d982d5eac39 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:05:08 devstack sudo[106748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a103c420-2fb1-4630-b304-5d982d5eac39
Jun 15 16:05:08 devstack sudo[106748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:05:09 devstack sudo[106748]: pam_unix(sudo:session): session closed for user root
Jun 15 16:05:09 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-968f609d-fc44-48dc-b3c0-09e1988746bc req-ce8c7a5a-733b-43ea-8276-8401287498a2 tempest-TestMinimumBasicScenario-876912226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a103c420-2fb1-4630-b304-5d982d5eac39" returned: 0 in 0.839s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:05:09 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [req-968f609d-fc44-48dc-b3c0-09e1988746bc req-ce8c7a5a-733b-43ea-8276-8401287498a2 tempest-TestMinimumBasicScenario-876912226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.857s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:05:09 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [req-968f609d-fc44-48dc-b3c0-09e1988746bc req-ce8c7a5a-733b-43ea-8276-8401287498a2 tempest-TestMinimumBasicScenario-876912226 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc', 'name': 'volume-a103c420-2fb1-4630-b304-5d982d5eac39', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c8a81052-1429-455f-b108-f6cd39ad459f', 'enforce_multipath': True} {{(pid=91863) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 15 16:05:09 devstack cinder-volume[91863]: INFO cinder.volume.manager [req-968f609d-fc44-48dc-b3c0-09e1988746bc req-ce8c7a5a-733b-43ea-8276-8401287498a2 tempest-TestMinimumBasicScenario-876912226 None] attachment_update completed successfully.
Jun 15 16:05:11 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-b554d7c2-e4c4-4e4d-b932-262dab290890 tempest-TestInstancesWithCinderVolumes-211740280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 16:05:11 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-b554d7c2-e4c4-4e4d-b932-262dab290890 tempest-TestInstancesWithCinderVolumes-211740280 None] Flow 'volume_create_manager' (af910f4e-a693-4a0d-ac7d-ef4e6b4d63cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:05:11 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-b554d7c2-e4c4-4e4d-b932-262dab290890 tempest-TestInstancesWithCinderVolumes-211740280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (019833a7-eab7-4c97-89a4-dfadf2023381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:05:11 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-b554d7c2-e4c4-4e4d-b932-262dab290890 tempest-TestInstancesWithCinderVolumes-211740280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (019833a7-eab7-4c97-89a4-dfadf2023381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:05:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-234982908',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c5de600-d287-4a3c-b077-8362728f574f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99a850adfe334f6ea5054d161a494e89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:05:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:05:11Z,use_quota=True,user_id='2844147868d043fcb9f09c39d494e72a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6baf7e0b-f067-43ad-9bb3-f173002485b1),volume_type_id=6baf7e0b-f067-43ad-9bb3-f173002485b1)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:05:11 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-b554d7c2-e4c4-4e4d-b932-262dab290890 tempest-TestInstancesWithCinderVolumes-211740280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3132aba3-3536-477a-8dae-ad144a640575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:05:11 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-b554d7c2-e4c4-4e4d-b932-262dab290890 tempest-TestInstancesWithCinderVolumes-211740280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3132aba3-3536-477a-8dae-ad144a640575) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:05:11 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-b554d7c2-e4c4-4e4d-b932-262dab290890 tempest-TestInstancesWithCinderVolumes-211740280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f31ba063-1f33-494c-b30b-2734db64fbee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:05:11 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-b554d7c2-e4c4-4e4d-b932-262dab290890 tempest-TestInstancesWithCinderVolumes-211740280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f31ba063-1f33-494c-b30b-2734db64fbee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c5de600-d287-4a3c-b077-8362728f574f', 'volume_name': 'volume-4c5de600-d287-4a3c-b077-8362728f574f', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:05:11 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-b554d7c2-e4c4-4e4d-b932-262dab290890 tempest-TestInstancesWithCinderVolumes-211740280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2f78b55-a98e-481b-bce7-e949335d8e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:05:11 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-b554d7c2-e4c4-4e4d-b932-262dab290890 tempest-TestInstancesWithCinderVolumes-211740280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2f78b55-a98e-481b-bce7-e949335d8e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:05:11 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-b554d7c2-e4c4-4e4d-b932-262dab290890 tempest-TestInstancesWithCinderVolumes-211740280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e20f2a0-d148-499d-b516-23a7335efd63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:05:11 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-b554d7c2-e4c4-4e4d-b932-262dab290890 tempest-TestInstancesWithCinderVolumes-211740280 None] Volume 4c5de600-d287-4a3c-b077-8362728f574f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c5de600-d287-4a3c-b077-8362728f574f', 'volume_size': 1}
Jun 15 16:05:11 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-b554d7c2-e4c4-4e4d-b932-262dab290890 tempest-TestInstancesWithCinderVolumes-211740280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:05:11 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-b554d7c2-e4c4-4e4d-b932-262dab290890 tempest-TestInstancesWithCinderVolumes-211740280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:05:11 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-b554d7c2-e4c4-4e4d-b932-262dab290890 tempest-TestInstancesWithCinderVolumes-211740280 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:05:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-234982908',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c5de600-d287-4a3c-b077-8362728f574f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99a850adfe334f6ea5054d161a494e89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:05:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:05:11Z,use_quota=True,user_id='2844147868d043fcb9f09c39d494e72a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6baf7e0b-f067-43ad-9bb3-f173002485b1),volume_type_id=6baf7e0b-f067-43ad-9bb3-f173002485b1)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 16:05:11 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-b554d7c2-e4c4-4e4d-b932-262dab290890 tempest-TestInstancesWithCinderVolumes-211740280 None] Creating volume 4c5de600-d287-4a3c-b077-8362728f574f {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 16:05:11 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-b554d7c2-e4c4-4e4d-b932-262dab290890 tempest-TestInstancesWithCinderVolumes-211740280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:05:11 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-b554d7c2-e4c4-4e4d-b932-262dab290890 tempest-TestInstancesWithCinderVolumes-211740280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:05:11 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-b554d7c2-e4c4-4e4d-b932-262dab290890 tempest-TestInstancesWithCinderVolumes-211740280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:05:11 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-b554d7c2-e4c4-4e4d-b932-262dab290890 tempest-TestInstancesWithCinderVolumes-211740280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:05:11 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-b554d7c2-e4c4-4e4d-b932-262dab290890 tempest-TestInstancesWithCinderVolumes-211740280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:05:11 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-b554d7c2-e4c4-4e4d-b932-262dab290890 tempest-TestInstancesWithCinderVolumes-211740280 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 16:05:11 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-b554d7c2-e4c4-4e4d-b932-262dab290890 tempest-TestInstancesWithCinderVolumes-211740280 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 16:05:11 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-b554d7c2-e4c4-4e4d-b932-262dab290890 tempest-TestInstancesWithCinderVolumes-211740280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4c5de600-d287-4a3c-b077-8362728f574f 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:05:11 devstack sudo[107164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4c5de600-d287-4a3c-b077-8362728f574f 1073741824
Jun 15 16:05:11 devstack sudo[107164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:05:11 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a2804fd-f922-425d-9b99-a7627f1bf286 tempest-TestInstancesWithCinderVolumes-211740280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 16:05:11 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-9a2804fd-f922-425d-9b99-a7627f1bf286 tempest-TestInstancesWithCinderVolumes-211740280 None] Flow 'volume_create_manager' (4684fdab-8f02-4b25-ae33-538d2b2a2705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:05:11 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-9a2804fd-f922-425d-9b99-a7627f1bf286 tempest-TestInstancesWithCinderVolumes-211740280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d61f075-1375-4d28-bd76-25633bfb39b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:05:11 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-9a2804fd-f922-425d-9b99-a7627f1bf286 tempest-TestInstancesWithCinderVolumes-211740280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d61f075-1375-4d28-bd76-25633bfb39b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:05:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1536939644',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=190befd4-76c0-4378-b6ec-77dfe718fd18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99a850adfe334f6ea5054d161a494e89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:05:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:05:12Z,use_quota=True,user_id='2844147868d043fcb9f09c39d494e72a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(40ca40eb-1805-4d96-9823-4eb4f11314b2),volume_type_id=40ca40eb-1805-4d96-9823-4eb4f11314b2)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:05:11 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-9a2804fd-f922-425d-9b99-a7627f1bf286 tempest-TestInstancesWithCinderVolumes-211740280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6d41b74-4972-4894-8ca8-0a89f7b4972f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:05:11 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-9a2804fd-f922-425d-9b99-a7627f1bf286 tempest-TestInstancesWithCinderVolumes-211740280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6d41b74-4972-4894-8ca8-0a89f7b4972f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:05:11 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-9a2804fd-f922-425d-9b99-a7627f1bf286 tempest-TestInstancesWithCinderVolumes-211740280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56efa394-dc20-40ad-a376-cd40ef6a6b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:05:11 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-9a2804fd-f922-425d-9b99-a7627f1bf286 tempest-TestInstancesWithCinderVolumes-211740280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56efa394-dc20-40ad-a376-cd40ef6a6b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '190befd4-76c0-4378-b6ec-77dfe718fd18', 'volume_name': 'volume-190befd4-76c0-4378-b6ec-77dfe718fd18', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:05:11 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-9a2804fd-f922-425d-9b99-a7627f1bf286 tempest-TestInstancesWithCinderVolumes-211740280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f333638-d53a-4697-8fa9-8256a382c55d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:05:11 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-9a2804fd-f922-425d-9b99-a7627f1bf286 tempest-TestInstancesWithCinderVolumes-211740280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f333638-d53a-4697-8fa9-8256a382c55d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:05:11 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-9a2804fd-f922-425d-9b99-a7627f1bf286 tempest-TestInstancesWithCinderVolumes-211740280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81b63f8d-4d1c-4632-8d83-cbaf18bb5eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:05:11 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-9a2804fd-f922-425d-9b99-a7627f1bf286 tempest-TestInstancesWithCinderVolumes-211740280 None] Volume 190befd4-76c0-4378-b6ec-77dfe718fd18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-190befd4-76c0-4378-b6ec-77dfe718fd18', 'volume_size': 1}
Jun 15 16:05:11 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-9a2804fd-f922-425d-9b99-a7627f1bf286 tempest-TestInstancesWithCinderVolumes-211740280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:05:12 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-813a008e-b3c2-4ce1-bea8-b82f9f802f78 tempest-TestInstancesWithCinderVolumes-211740280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 16:05:12 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-813a008e-b3c2-4ce1-bea8-b82f9f802f78 tempest-TestInstancesWithCinderVolumes-211740280 None] Flow 'volume_create_manager' (8077ba9b-23c3-4cd9-b3f9-599b2da0ed5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:05:12 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-813a008e-b3c2-4ce1-bea8-b82f9f802f78 tempest-TestInstancesWithCinderVolumes-211740280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b54fac0e-8c23-4885-a5b0-cea168d456a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:05:12 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-813a008e-b3c2-4ce1-bea8-b82f9f802f78 tempest-TestInstancesWithCinderVolumes-211740280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b54fac0e-8c23-4885-a5b0-cea168d456a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:05:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2062881149',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97b34023-e498-4fd2-9ce1-2fb380bfb652,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99a850adfe334f6ea5054d161a494e89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:05:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:05:12Z,use_quota=True,user_id='2844147868d043fcb9f09c39d494e72a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69444cd2-63c5-493f-aec2-f05266061cc6),volume_type_id=69444cd2-63c5-493f-aec2-f05266061cc6)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:05:12 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-813a008e-b3c2-4ce1-bea8-b82f9f802f78 tempest-TestInstancesWithCinderVolumes-211740280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17c0a7fb-8a83-465b-8c40-43ca05ed5be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:05:12 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-813a008e-b3c2-4ce1-bea8-b82f9f802f78 tempest-TestInstancesWithCinderVolumes-211740280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17c0a7fb-8a83-465b-8c40-43ca05ed5be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:05:12 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-813a008e-b3c2-4ce1-bea8-b82f9f802f78 tempest-TestInstancesWithCinderVolumes-211740280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17d88845-5999-428d-94ab-1b3acdb65de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:05:12 devstack cinder-volume[91863]: DEBUG cinder.image.glance [None req-813a008e-b3c2-4ce1-bea8-b82f9f802f78 tempest-TestInstancesWithCinderVolumes-211740280 None] Creating Keystone auth plugin from conf {{(pid=91863) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 15 16:05:12 devstack sudo[107164]: pam_unix(sudo:session): session closed for user root
Jun 15 16:05:12 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-b554d7c2-e4c4-4e4d-b932-262dab290890 tempest-TestInstancesWithCinderVolumes-211740280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4c5de600-d287-4a3c-b077-8362728f574f 1073741824" returned: 0 in 0.934s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:05:12 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-b554d7c2-e4c4-4e4d-b932-262dab290890 tempest-TestInstancesWithCinderVolumes-211740280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4c5de600-d287-4a3c-b077-8362728f574f {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:05:12 devstack sudo[107170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4c5de600-d287-4a3c-b077-8362728f574f
Jun 15 16:05:12 devstack sudo[107170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:05:12 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-813a008e-b3c2-4ce1-bea8-b82f9f802f78 tempest-TestInstancesWithCinderVolumes-211740280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17d88845-5999-428d-94ab-1b3acdb65de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '97b34023-e498-4fd2-9ce1-2fb380bfb652', 'volume_name': 'volume-97b34023-e498-4fd2-9ce1-2fb380bfb652', 'volume_size': 1, 'image_id': '9930945e-e1b3-45c9-8c64-6e8082b7735b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9930945e-e1b3-45c9-8c64-6e8082b7735b', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--588154820', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '99a850adfe334f6ea5054d161a494e89', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9930945e-e1b3-45c9-8c64-6e8082b7735b', 'created_at': datetime.datetime(2026, 6, 15, 14, 5, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 14, 5, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9930945e-e1b3-45c9-8c64-6e8082b7735b/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x77394a2566f0>}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:05:12 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-813a008e-b3c2-4ce1-bea8-b82f9f802f78 tempest-TestInstancesWithCinderVolumes-211740280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab3298f5-129f-4e12-a540-fc0b86d42a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:05:12 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-813a008e-b3c2-4ce1-bea8-b82f9f802f78 tempest-TestInstancesWithCinderVolumes-211740280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab3298f5-129f-4e12-a540-fc0b86d42a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:05:12 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-813a008e-b3c2-4ce1-bea8-b82f9f802f78 tempest-TestInstancesWithCinderVolumes-211740280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (388bce1f-9e02-45dd-8610-8656cc717e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:05:12 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-813a008e-b3c2-4ce1-bea8-b82f9f802f78 tempest-TestInstancesWithCinderVolumes-211740280 None] Volume 97b34023-e498-4fd2-9ce1-2fb380bfb652: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-97b34023-e498-4fd2-9ce1-2fb380bfb652', 'volume_size': 1, 'image_id': '9930945e-e1b3-45c9-8c64-6e8082b7735b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9930945e-e1b3-45c9-8c64-6e8082b7735b', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--588154820', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '99a850adfe334f6ea5054d161a494e89', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9930945e-e1b3-45c9-8c64-6e8082b7735b', 'created_at': datetime.datetime(2026, 6, 15, 14, 5, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 14, 5, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9930945e-e1b3-45c9-8c64-6e8082b7735b/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x77394a2566f0>}
Jun 15 16:05:12 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-813a008e-b3c2-4ce1-bea8-b82f9f802f78 tempest-TestInstancesWithCinderVolumes-211740280 None] Trying to clone 97b34023-e498-4fd2-9ce1-2fb380bfb652 from image 9930945e-e1b3-45c9-8c64-6e8082b7735b at location (None, [{'url': 'file:///opt/stack/data/glance/images/9930945e-e1b3-45c9-8c64-6e8082b7735b', 'metadata': {}}]). {{(pid=91863) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jun 15 16:05:13 devstack sudo[107170]: pam_unix(sudo:session): session closed for user root
Jun 15 16:05:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-b554d7c2-e4c4-4e4d-b932-262dab290890 tempest-TestInstancesWithCinderVolumes-211740280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4c5de600-d287-4a3c-b077-8362728f574f" returned: 0 in 0.685s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:05:13 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-b554d7c2-e4c4-4e4d-b932-262dab290890 tempest-TestInstancesWithCinderVolumes-211740280 None] <== create_volume: return (1666ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 16:05:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-b554d7c2-e4c4-4e4d-b932-262dab290890 tempest-TestInstancesWithCinderVolumes-211740280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.669s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:05:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-9a2804fd-f922-425d-9b99-a7627f1bf286 tempest-TestInstancesWithCinderVolumes-211740280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.290s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:05:13 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-9a2804fd-f922-425d-9b99-a7627f1bf286 tempest-TestInstancesWithCinderVolumes-211740280 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:05:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1536939644',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=190befd4-76c0-4378-b6ec-77dfe718fd18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99a850adfe334f6ea5054d161a494e89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:05:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:05:12Z,use_quota=True,user_id='2844147868d043fcb9f09c39d494e72a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(40ca40eb-1805-4d96-9823-4eb4f11314b2),volume_type_id=40ca40eb-1805-4d96-9823-4eb4f11314b2)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 16:05:13 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-9a2804fd-f922-425d-9b99-a7627f1bf286 tempest-TestInstancesWithCinderVolumes-211740280 None] Creating volume 190befd4-76c0-4378-b6ec-77dfe718fd18 {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 16:05:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-9a2804fd-f922-425d-9b99-a7627f1bf286 tempest-TestInstancesWithCinderVolumes-211740280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:05:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-9a2804fd-f922-425d-9b99-a7627f1bf286 tempest-TestInstancesWithCinderVolumes-211740280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:05:13 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-9a2804fd-f922-425d-9b99-a7627f1bf286 tempest-TestInstancesWithCinderVolumes-211740280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:05:13 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-9a2804fd-f922-425d-9b99-a7627f1bf286 tempest-TestInstancesWithCinderVolumes-211740280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:05:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-9a2804fd-f922-425d-9b99-a7627f1bf286 tempest-TestInstancesWithCinderVolumes-211740280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:05:13 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-9a2804fd-f922-425d-9b99-a7627f1bf286 tempest-TestInstancesWithCinderVolumes-211740280 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 16:05:13 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-9a2804fd-f922-425d-9b99-a7627f1bf286 tempest-TestInstancesWithCinderVolumes-211740280 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 16:05:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-9a2804fd-f922-425d-9b99-a7627f1bf286 tempest-TestInstancesWithCinderVolumes-211740280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-190befd4-76c0-4378-b6ec-77dfe718fd18 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:05:13 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-b554d7c2-e4c4-4e4d-b932-262dab290890 tempest-TestInstancesWithCinderVolumes-211740280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e20f2a0-d148-499d-b516-23a7335efd63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c5de600-d287-4a3c-b077-8362728f574f', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:05:13 devstack sudo[107173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-190befd4-76c0-4378-b6ec-77dfe718fd18 1073741824
Jun 15 16:05:13 devstack sudo[107173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:05:13 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-b554d7c2-e4c4-4e4d-b932-262dab290890 tempest-TestInstancesWithCinderVolumes-211740280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f72b85f8-a2de-4c01-ad40-f1fe32d56f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:05:13 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-b554d7c2-e4c4-4e4d-b932-262dab290890 tempest-TestInstancesWithCinderVolumes-211740280 None] Volume volume-4c5de600-d287-4a3c-b077-8362728f574f (4c5de600-d287-4a3c-b077-8362728f574f): created successfully
Jun 15 16:05:13 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-b554d7c2-e4c4-4e4d-b932-262dab290890 tempest-TestInstancesWithCinderVolumes-211740280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f72b85f8-a2de-4c01-ad40-f1fe32d56f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:05:13 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-b554d7c2-e4c4-4e4d-b932-262dab290890 tempest-TestInstancesWithCinderVolumes-211740280 None] Flow 'volume_create_manager' (af910f4e-a693-4a0d-ac7d-ef4e6b4d63cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:05:13 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-b554d7c2-e4c4-4e4d-b932-262dab290890 tempest-TestInstancesWithCinderVolumes-211740280 None] Created volume successfully.
Jun 15 16:05:14 devstack sudo[107173]: pam_unix(sudo:session): session closed for user root
Jun 15 16:05:14 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-9a2804fd-f922-425d-9b99-a7627f1bf286 tempest-TestInstancesWithCinderVolumes-211740280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-190befd4-76c0-4378-b6ec-77dfe718fd18 1073741824" returned: 0 in 0.900s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:05:14 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-9a2804fd-f922-425d-9b99-a7627f1bf286 tempest-TestInstancesWithCinderVolumes-211740280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-190befd4-76c0-4378-b6ec-77dfe718fd18 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:05:14 devstack sudo[107179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-190befd4-76c0-4378-b6ec-77dfe718fd18
Jun 15 16:05:14 devstack sudo[107179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:05:14 devstack sudo[107179]: pam_unix(sudo:session): session closed for user root
Jun 15 16:05:14 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-9a2804fd-f922-425d-9b99-a7627f1bf286 tempest-TestInstancesWithCinderVolumes-211740280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-190befd4-76c0-4378-b6ec-77dfe718fd18" returned: 0 in 0.625s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:05:14 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-9a2804fd-f922-425d-9b99-a7627f1bf286 tempest-TestInstancesWithCinderVolumes-211740280 None] <== create_volume: return (1568ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 16:05:14 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-9a2804fd-f922-425d-9b99-a7627f1bf286 tempest-TestInstancesWithCinderVolumes-211740280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.581s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:05:14 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-9a2804fd-f922-425d-9b99-a7627f1bf286 tempest-TestInstancesWithCinderVolumes-211740280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81b63f8d-4d1c-4632-8d83-cbaf18bb5eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-190befd4-76c0-4378-b6ec-77dfe718fd18', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:05:14 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-9a2804fd-f922-425d-9b99-a7627f1bf286 tempest-TestInstancesWithCinderVolumes-211740280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (067fc5a4-8cdd-4f2e-8222-8bbb289493b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:05:14 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-9a2804fd-f922-425d-9b99-a7627f1bf286 tempest-TestInstancesWithCinderVolumes-211740280 None] Volume volume-190befd4-76c0-4378-b6ec-77dfe718fd18 (190befd4-76c0-4378-b6ec-77dfe718fd18): created successfully
Jun 15 16:05:14 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-9a2804fd-f922-425d-9b99-a7627f1bf286 tempest-TestInstancesWithCinderVolumes-211740280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (067fc5a4-8cdd-4f2e-8222-8bbb289493b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:05:14 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-9a2804fd-f922-425d-9b99-a7627f1bf286 tempest-TestInstancesWithCinderVolumes-211740280 None] Flow 'volume_create_manager' (4684fdab-8f02-4b25-ae33-538d2b2a2705) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:05:14 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-9a2804fd-f922-425d-9b99-a7627f1bf286 tempest-TestInstancesWithCinderVolumes-211740280 None] Created volume successfully.
Jun 15 16:05:16 devstack cinder-volume[91863]: DEBUG cinder.image.image_utils [None req-813a008e-b3c2-4ce1-bea8-b82f9f802f78 tempest-TestInstancesWithCinderVolumes-211740280 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9930945e-e1b3-45c9-8c64-6e8082b7735b_arahb24ldevstack@QuobyteHD, size 20.69 MB, duration 3.36 sec {{(pid=91863) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 15 16:05:16 devstack cinder-volume[91863]: INFO cinder.image.image_utils [None req-813a008e-b3c2-4ce1-bea8-b82f9f802f78 tempest-TestInstancesWithCinderVolumes-211740280 None] Image download 20.69 MB at 6.15 MB/s
Jun 15 16:05:16 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfbc3e2c-7099-4c15-a5d4-db32218b7ac6]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:05:16 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-813a008e-b3c2-4ce1-bea8-b82f9f802f78 tempest-TestInstancesWithCinderVolumes-211740280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9930945e-e1b3-45c9-8c64-6e8082b7735b_arahb24ldevstack@QuobyteHD {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:05:16 devstack sudo[107185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9930945e-e1b3-45c9-8c64-6e8082b7735b_arahb24ldevstack@QuobyteHD
Jun 15 16:05:16 devstack sudo[107185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:05:16 devstack sudo[107185]: pam_unix(sudo:session): session closed for user root
Jun 15 16:05:16 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-813a008e-b3c2-4ce1-bea8-b82f9f802f78 tempest-TestInstancesWithCinderVolumes-211740280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9930945e-e1b3-45c9-8c64-6e8082b7735b_arahb24ldevstack@QuobyteHD" returned: 0 in 0.787s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:05:16 devstack cinder-volume[91863]: DEBUG cinder.image.image_utils [None req-813a008e-b3c2-4ce1-bea8-b82f9f802f78 tempest-TestInstancesWithCinderVolumes-211740280 None] Temporary image 9930945e-e1b3-45c9-8c64-6e8082b7735b is fetched for user 2844147868d043fcb9f09c39d494e72a. {{(pid=91863) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 15 16:05:17 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c677c0-b2c3-4300-a6ce-48bbfa43e94c]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:05:17 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-813a008e-b3c2-4ce1-bea8-b82f9f802f78 tempest-TestInstancesWithCinderVolumes-211740280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9930945e-e1b3-45c9-8c64-6e8082b7735b_arahb24ldevstack@QuobyteHD {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:05:17 devstack sudo[107191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9930945e-e1b3-45c9-8c64-6e8082b7735b_arahb24ldevstack@QuobyteHD
Jun 15 16:05:17 devstack sudo[107191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:05:17 devstack sudo[107191]: pam_unix(sudo:session): session closed for user root
Jun 15 16:05:17 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-813a008e-b3c2-4ce1-bea8-b82f9f802f78 tempest-TestInstancesWithCinderVolumes-211740280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9930945e-e1b3-45c9-8c64-6e8082b7735b_arahb24ldevstack@QuobyteHD" returned: 0 in 0.890s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:05:17 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-813a008e-b3c2-4ce1-bea8-b82f9f802f78 tempest-TestInstancesWithCinderVolumes-211740280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:05:17 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-813a008e-b3c2-4ce1-bea8-b82f9f802f78 tempest-TestInstancesWithCinderVolumes-211740280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:05:17 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-813a008e-b3c2-4ce1-bea8-b82f9f802f78 tempest-TestInstancesWithCinderVolumes-211740280 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:05:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2062881149',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97b34023-e498-4fd2-9ce1-2fb380bfb652,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99a850adfe334f6ea5054d161a494e89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:05:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:05:12Z,use_quota=True,user_id='2844147868d043fcb9f09c39d494e72a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69444cd2-63c5-493f-aec2-f05266061cc6),volume_type_id=69444cd2-63c5-493f-aec2-f05266061cc6)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 16:05:17 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-813a008e-b3c2-4ce1-bea8-b82f9f802f78 tempest-TestInstancesWithCinderVolumes-211740280 None] Creating volume 97b34023-e498-4fd2-9ce1-2fb380bfb652 {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 16:05:17 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-813a008e-b3c2-4ce1-bea8-b82f9f802f78 tempest-TestInstancesWithCinderVolumes-211740280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:05:17 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-813a008e-b3c2-4ce1-bea8-b82f9f802f78 tempest-TestInstancesWithCinderVolumes-211740280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:05:17 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-813a008e-b3c2-4ce1-bea8-b82f9f802f78 tempest-TestInstancesWithCinderVolumes-211740280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:05:17 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-813a008e-b3c2-4ce1-bea8-b82f9f802f78 tempest-TestInstancesWithCinderVolumes-211740280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:05:17 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-813a008e-b3c2-4ce1-bea8-b82f9f802f78 tempest-TestInstancesWithCinderVolumes-211740280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:05:17 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-813a008e-b3c2-4ce1-bea8-b82f9f802f78 tempest-TestInstancesWithCinderVolumes-211740280 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 16:05:17 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-813a008e-b3c2-4ce1-bea8-b82f9f802f78 tempest-TestInstancesWithCinderVolumes-211740280 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 16:05:18 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-813a008e-b3c2-4ce1-bea8-b82f9f802f78 tempest-TestInstancesWithCinderVolumes-211740280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-97b34023-e498-4fd2-9ce1-2fb380bfb652 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:05:18 devstack sudo[107198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-97b34023-e498-4fd2-9ce1-2fb380bfb652 1073741824
Jun 15 16:05:18 devstack sudo[107198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:05:18 devstack sudo[107198]: pam_unix(sudo:session): session closed for user root
Jun 15 16:05:18 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-813a008e-b3c2-4ce1-bea8-b82f9f802f78 tempest-TestInstancesWithCinderVolumes-211740280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-97b34023-e498-4fd2-9ce1-2fb380bfb652 1073741824" returned: 0 in 0.924s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:05:18 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-813a008e-b3c2-4ce1-bea8-b82f9f802f78 tempest-TestInstancesWithCinderVolumes-211740280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-97b34023-e498-4fd2-9ce1-2fb380bfb652 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:05:18 devstack sudo[107204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-97b34023-e498-4fd2-9ce1-2fb380bfb652
Jun 15 16:05:18 devstack sudo[107204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:05:19 devstack sudo[107204]: pam_unix(sudo:session): session closed for user root
Jun 15 16:05:19 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-813a008e-b3c2-4ce1-bea8-b82f9f802f78 tempest-TestInstancesWithCinderVolumes-211740280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-97b34023-e498-4fd2-9ce1-2fb380bfb652" returned: 0 in 0.628s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:05:19 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-813a008e-b3c2-4ce1-bea8-b82f9f802f78 tempest-TestInstancesWithCinderVolumes-211740280 None] <== create_volume: return (1607ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 16:05:19 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-813a008e-b3c2-4ce1-bea8-b82f9f802f78 tempest-TestInstancesWithCinderVolumes-211740280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.613s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:05:19 devstack cinder-volume[91863]: DEBUG cinder.volume.volume_utils [None req-813a008e-b3c2-4ce1-bea8-b82f9f802f78 tempest-TestInstancesWithCinderVolumes-211740280 None] Attempting download of 9930945e-e1b3-45c9-8c64-6e8082b7735b ((None, [{'url': 'file:///opt/stack/data/glance/images/9930945e-e1b3-45c9-8c64-6e8082b7735b', 'metadata': {}}])) to volume 97b34023-e498-4fd2-9ce1-2fb380bfb652. {{(pid=91863) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 15 16:05:19 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dcb8d8e-60bd-4e35-8b6e-5186c16dbace]: (4, 'raw') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:05:19 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-813a008e-b3c2-4ce1-bea8-b82f9f802f78 tempest-TestInstancesWithCinderVolumes-211740280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9930945e-e1b3-45c9-8c64-6e8082b7735b__6gu409e {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:05:19 devstack sudo[107207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9930945e-e1b3-45c9-8c64-6e8082b7735b__6gu409e
Jun 15 16:05:19 devstack sudo[107207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:05:20 devstack sudo[107207]: pam_unix(sudo:session): session closed for user root
Jun 15 16:05:20 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-813a008e-b3c2-4ce1-bea8-b82f9f802f78 tempest-TestInstancesWithCinderVolumes-211740280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9930945e-e1b3-45c9-8c64-6e8082b7735b__6gu409e" returned: 0 in 0.729s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:05:20 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-813a008e-b3c2-4ce1-bea8-b82f9f802f78 tempest-TestInstancesWithCinderVolumes-211740280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9930945e-e1b3-45c9-8c64-6e8082b7735b__6gu409e {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:05:20 devstack sudo[107214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9930945e-e1b3-45c9-8c64-6e8082b7735b__6gu409e
Jun 15 16:05:20 devstack sudo[107214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:05:21 devstack sudo[107214]: pam_unix(sudo:session): session closed for user root
Jun 15 16:05:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-813a008e-b3c2-4ce1-bea8-b82f9f802f78 tempest-TestInstancesWithCinderVolumes-211740280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9930945e-e1b3-45c9-8c64-6e8082b7735b__6gu409e" returned: 1 in 0.668s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:05:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-813a008e-b3c2-4ce1-bea8-b82f9f802f78 tempest-TestInstancesWithCinderVolumes-211740280 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9930945e-e1b3-45c9-8c64-6e8082b7735b__6gu409e' failed. Not Retrying. {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 15 16:05:21 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[157ff989-10e1-4979-b7b8-d445aede5d1d]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:05:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-813a008e-b3c2-4ce1-bea8-b82f9f802f78 tempest-TestInstancesWithCinderVolumes-211740280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9930945e-e1b3-45c9-8c64-6e8082b7735b_arahb24ldevstack@QuobyteHD {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:05:21 devstack sudo[107219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9930945e-e1b3-45c9-8c64-6e8082b7735b_arahb24ldevstack@QuobyteHD
Jun 15 16:05:21 devstack sudo[107219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:05:21 devstack sudo[107219]: pam_unix(sudo:session): session closed for user root
Jun 15 16:05:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-813a008e-b3c2-4ce1-bea8-b82f9f802f78 tempest-TestInstancesWithCinderVolumes-211740280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9930945e-e1b3-45c9-8c64-6e8082b7735b_arahb24ldevstack@QuobyteHD" returned: 0 in 0.691s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:05:21 devstack cinder-volume[91863]: DEBUG cinder.image.image_utils [None req-813a008e-b3c2-4ce1-bea8-b82f9f802f78 tempest-TestInstancesWithCinderVolumes-211740280 None] 9930945e-e1b3-45c9-8c64-6e8082b7735b was qcow2, converting to raw {{(pid=91863) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 15 16:05:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-813a008e-b3c2-4ce1-bea8-b82f9f802f78 tempest-TestInstancesWithCinderVolumes-211740280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9930945e-e1b3-45c9-8c64-6e8082b7735b_arahb24ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-97b34023-e498-4fd2-9ce1-2fb380bfb652 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:05:21 devstack sudo[107224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9930945e-e1b3-45c9-8c64-6e8082b7735b_arahb24ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-97b34023-e498-4fd2-9ce1-2fb380bfb652
Jun 15 16:05:21 devstack sudo[107224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:05:23 devstack sudo[107224]: pam_unix(sudo:session): session closed for user root
Jun 15 16:05:23 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-813a008e-b3c2-4ce1-bea8-b82f9f802f78 tempest-TestInstancesWithCinderVolumes-211740280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9930945e-e1b3-45c9-8c64-6e8082b7735b_arahb24ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-97b34023-e498-4fd2-9ce1-2fb380bfb652" returned: 0 in 1.842s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:05:23 devstack cinder-volume[91863]: DEBUG cinder.image.image_utils [None req-813a008e-b3c2-4ce1-bea8-b82f9f802f78 tempest-TestInstancesWithCinderVolumes-211740280 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9930945e-e1b3-45c9-8c64-6e8082b7735b_arahb24ldevstack@QuobyteHD, size 112.00 MB, duration 1.84 sec, destination /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-97b34023-e498-4fd2-9ce1-2fb380bfb652 {{(pid=91863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 15 16:05:23 devstack cinder-volume[91863]: INFO cinder.image.image_utils [None req-813a008e-b3c2-4ce1-bea8-b82f9f802f78 tempest-TestInstancesWithCinderVolumes-211740280 None] Converted 112.00 MB image at 60.75 MB/s
Jun 15 16:05:23 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-813a008e-b3c2-4ce1-bea8-b82f9f802f78 tempest-TestInstancesWithCinderVolumes-211740280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-97b34023-e498-4fd2-9ce1-2fb380bfb652 1G {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:05:23 devstack sudo[107233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-97b34023-e498-4fd2-9ce1-2fb380bfb652 1G
Jun 15 16:05:23 devstack sudo[107233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:05:24 devstack sudo[107233]: pam_unix(sudo:session): session closed for user root
Jun 15 16:05:24 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-813a008e-b3c2-4ce1-bea8-b82f9f802f78 tempest-TestInstancesWithCinderVolumes-211740280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-97b34023-e498-4fd2-9ce1-2fb380bfb652 1G" returned: 0 in 0.671s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:05:24 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2199f55c-0398-4a70-8bef-e1b26621fc3a]: (4, 'raw') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:05:24 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-813a008e-b3c2-4ce1-bea8-b82f9f802f78 tempest-TestInstancesWithCinderVolumes-211740280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-97b34023-e498-4fd2-9ce1-2fb380bfb652 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:05:24 devstack sudo[107244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-97b34023-e498-4fd2-9ce1-2fb380bfb652
Jun 15 16:05:24 devstack sudo[107244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:05:25 devstack sudo[107244]: pam_unix(sudo:session): session closed for user root
Jun 15 16:05:25 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-813a008e-b3c2-4ce1-bea8-b82f9f802f78 tempest-TestInstancesWithCinderVolumes-211740280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-97b34023-e498-4fd2-9ce1-2fb380bfb652" returned: 0 in 0.723s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:05:25 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-813a008e-b3c2-4ce1-bea8-b82f9f802f78 tempest-TestInstancesWithCinderVolumes-211740280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-97b34023-e498-4fd2-9ce1-2fb380bfb652 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:05:25 devstack sudo[107249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-97b34023-e498-4fd2-9ce1-2fb380bfb652
Jun 15 16:05:25 devstack sudo[107249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:05:25 devstack sudo[107249]: pam_unix(sudo:session): session closed for user root
Jun 15 16:05:25 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-813a008e-b3c2-4ce1-bea8-b82f9f802f78 tempest-TestInstancesWithCinderVolumes-211740280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-97b34023-e498-4fd2-9ce1-2fb380bfb652" returned: 1 in 0.725s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:05:25 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-813a008e-b3c2-4ce1-bea8-b82f9f802f78 tempest-TestInstancesWithCinderVolumes-211740280 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-97b34023-e498-4fd2-9ce1-2fb380bfb652' failed. Not Retrying. {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 15 16:05:25 devstack cinder-volume[91863]: DEBUG cinder.volume.volume_utils [None req-813a008e-b3c2-4ce1-bea8-b82f9f802f78 tempest-TestInstancesWithCinderVolumes-211740280 None] Downloaded image 9930945e-e1b3-45c9-8c64-6e8082b7735b ((None, [{'url': 'file:///opt/stack/data/glance/images/9930945e-e1b3-45c9-8c64-6e8082b7735b', 'metadata': {}}])) to volume 97b34023-e498-4fd2-9ce1-2fb380bfb652 successfully. {{(pid=91863) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 15 16:05:25 devstack cinder-volume[91863]: DEBUG cinder.image.image_utils [None req-813a008e-b3c2-4ce1-bea8-b82f9f802f78 tempest-TestInstancesWithCinderVolumes-211740280 None] Temporary image 9930945e-e1b3-45c9-8c64-6e8082b7735b for user 2844147868d043fcb9f09c39d494e72a is deleted. {{(pid=91863) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 15 16:05:25 devstack cinder-volume[91863]: DEBUG cinder.volume.volume_utils [None req-813a008e-b3c2-4ce1-bea8-b82f9f802f78 tempest-TestInstancesWithCinderVolumes-211740280 None] Marking volume 97b34023-e498-4fd2-9ce1-2fb380bfb652 as bootable. {{(pid=91863) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 15 16:05:25 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-813a008e-b3c2-4ce1-bea8-b82f9f802f78 tempest-TestInstancesWithCinderVolumes-211740280 None] Copying metadata from image 9930945e-e1b3-45c9-8c64-6e8082b7735b to 97b34023-e498-4fd2-9ce1-2fb380bfb652. {{(pid=91863) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 15 16:05:25 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-813a008e-b3c2-4ce1-bea8-b82f9f802f78 tempest-TestInstancesWithCinderVolumes-211740280 None] Creating volume glance metadata for volume 97b34023-e498-4fd2-9ce1-2fb380bfb652 backed by image 9930945e-e1b3-45c9-8c64-6e8082b7735b with: {'image_id': '9930945e-e1b3-45c9-8c64-6e8082b7735b', 'image_name': 'tempest-scenario-img--588154820', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=91863) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 15 16:05:25 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-813a008e-b3c2-4ce1-bea8-b82f9f802f78 tempest-TestInstancesWithCinderVolumes-211740280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (388bce1f-9e02-45dd-8610-8656cc717e5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97b34023-e498-4fd2-9ce1-2fb380bfb652', 'volume_size': 1, 'image_id': '9930945e-e1b3-45c9-8c64-6e8082b7735b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9930945e-e1b3-45c9-8c64-6e8082b7735b', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--588154820', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '99a850adfe334f6ea5054d161a494e89', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9930945e-e1b3-45c9-8c64-6e8082b7735b', 'created_at': datetime.datetime(2026, 6, 15, 14, 5, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 14, 5, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9930945e-e1b3-45c9-8c64-6e8082b7735b/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x77394a2566f0>}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:05:25 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-813a008e-b3c2-4ce1-bea8-b82f9f802f78 tempest-TestInstancesWithCinderVolumes-211740280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4c2c323-f2d1-49d9-8599-458e73476491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:05:25 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-813a008e-b3c2-4ce1-bea8-b82f9f802f78 tempest-TestInstancesWithCinderVolumes-211740280 None] Volume volume-97b34023-e498-4fd2-9ce1-2fb380bfb652 (97b34023-e498-4fd2-9ce1-2fb380bfb652): created successfully
Jun 15 16:05:25 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-813a008e-b3c2-4ce1-bea8-b82f9f802f78 tempest-TestInstancesWithCinderVolumes-211740280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4c2c323-f2d1-49d9-8599-458e73476491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:05:25 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-813a008e-b3c2-4ce1-bea8-b82f9f802f78 tempest-TestInstancesWithCinderVolumes-211740280 None] Flow 'volume_create_manager' (8077ba9b-23c3-4cd9-b3f9-599b2da0ed5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:05:25 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-813a008e-b3c2-4ce1-bea8-b82f9f802f78 tempest-TestInstancesWithCinderVolumes-211740280 None] Created volume successfully.
Jun 15 16:05:31 devstack cinder-volume[91863]: DEBUG oslo_service.periodic_task [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 16:05:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:05:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:05:31 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:05:31 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:05:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:05:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:05:31 devstack sudo[107280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 16:05:31 devstack sudo[107280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:05:31 devstack sudo[107280]: pam_unix(sudo:session): session closed for user root
Jun 15 16:05:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.744s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:05:31 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 16:05:31 devstack cinder-volume[91863]: DEBUG oslo_service.periodic_task [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Running periodic task VolumeManager._thread_info {{(pid=91863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 16:05:31 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] thread count: 28 {{(pid=91863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 15 16:05:31 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] thread info: [<_MainThread(MainThread, started 131088232640640)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131088122704576)>, <Thread(Thread-3 (stat_writer), started daemon 131088123058112)>, <Thread(Rabbit-heartbeat, started daemon 131088121268864)>, <Thread(Thread-5 (_runner), started daemon 131088121904192)>, <Thread(Thread-7 (_runner), started daemon 131088122037248)>, <Thread(fd_logger, started daemon 131088119630784)>, <Thread(privsep_reader, started daemon 131088119781440)>, <Thread(tpool_thread_0, started daemon 131088111617728)>, <Thread(tpool_thread_1, started daemon 131088103225024)>, <Thread(tpool_thread_2, started daemon 131088094832320)>, <Thread(tpool_thread_3, started daemon 131088086439616)>, <Thread(tpool_thread_4, started daemon 131088078046912)>, <Thread(tpool_thread_5, started daemon 131088069654208)>, <Thread(tpool_thread_6, started daemon 131088061261504)>, <Thread(tpool_thread_7, started daemon 131088052868800)>, <Thread(tpool_thread_8, started daemon 131088044476096)>, <Thread(tpool_thread_9, started daemon 131088036083392)>, <Thread(tpool_thread_10, started daemon 131088027690688)>, <Thread(tpool_thread_11, started daemon 131088019297984)>, <Thread(tpool_thread_12, started daemon 131088010905280)>, <Thread(tpool_thread_13, started daemon 131088002512576)>, <Thread(tpool_thread_14, started daemon 131087994119872)>, <Thread(tpool_thread_15, started daemon 131087985727168)>, <Thread(tpool_thread_16, started daemon 131087977334464)>, <Thread(tpool_thread_17, started daemon 131087968941760)>, <Thread(tpool_thread_18, started daemon 131087960549056)>, <Thread(tpool_thread_19, started daemon 131087952156352)>] {{(pid=91863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 15 16:05:33 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [req-6ad84695-df6c-4f24-bd91-b10f86501a40 req-ff56b2c8-95f8-425d-ba80-8638f399badd tempest-TestInstancesWithCinderVolumes-211740280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:05:33 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [req-6ad84695-df6c-4f24-bd91-b10f86501a40 req-ff56b2c8-95f8-425d-ba80-8638f399badd tempest-TestInstancesWithCinderVolumes-211740280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:05:33 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[091efe6f-7cc3-4953-be10-9ccbe7c8faac]: (4, 'raw') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:05:33 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-6ad84695-df6c-4f24-bd91-b10f86501a40 req-ff56b2c8-95f8-425d-ba80-8638f399badd tempest-TestInstancesWithCinderVolumes-211740280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-97b34023-e498-4fd2-9ce1-2fb380bfb652 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:05:33 devstack sudo[107352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-97b34023-e498-4fd2-9ce1-2fb380bfb652
Jun 15 16:05:33 devstack sudo[107352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:05:34 devstack sudo[107352]: pam_unix(sudo:session): session closed for user root
Jun 15 16:05:34 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-6ad84695-df6c-4f24-bd91-b10f86501a40 req-ff56b2c8-95f8-425d-ba80-8638f399badd tempest-TestInstancesWithCinderVolumes-211740280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-97b34023-e498-4fd2-9ce1-2fb380bfb652" returned: 0 in 1.094s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:05:34 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-6ad84695-df6c-4f24-bd91-b10f86501a40 req-ff56b2c8-95f8-425d-ba80-8638f399badd tempest-TestInstancesWithCinderVolumes-211740280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-97b34023-e498-4fd2-9ce1-2fb380bfb652 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:05:34 devstack sudo[107398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-97b34023-e498-4fd2-9ce1-2fb380bfb652
Jun 15 16:05:34 devstack sudo[107398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:05:35 devstack sudo[107398]: pam_unix(sudo:session): session closed for user root
Jun 15 16:05:35 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-6ad84695-df6c-4f24-bd91-b10f86501a40 req-ff56b2c8-95f8-425d-ba80-8638f399badd tempest-TestInstancesWithCinderVolumes-211740280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-97b34023-e498-4fd2-9ce1-2fb380bfb652" returned: 1 in 0.783s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:05:35 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-6ad84695-df6c-4f24-bd91-b10f86501a40 req-ff56b2c8-95f8-425d-ba80-8638f399badd tempest-TestInstancesWithCinderVolumes-211740280 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-97b34023-e498-4fd2-9ce1-2fb380bfb652' failed. Not Retrying. {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 15 16:05:35 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [req-6ad84695-df6c-4f24-bd91-b10f86501a40 req-ff56b2c8-95f8-425d-ba80-8638f399badd tempest-TestInstancesWithCinderVolumes-211740280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.970s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:05:35 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [req-6ad84695-df6c-4f24-bd91-b10f86501a40 req-ff56b2c8-95f8-425d-ba80-8638f399badd tempest-TestInstancesWithCinderVolumes-211740280 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc', 'name': 'volume-97b34023-e498-4fd2-9ce1-2fb380bfb652', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c7d707c7-b0fc-4409-9235-e026a0175729', 'enforce_multipath': True} {{(pid=91863) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 15 16:05:35 devstack cinder-volume[91863]: INFO cinder.volume.manager [req-6ad84695-df6c-4f24-bd91-b10f86501a40 req-ff56b2c8-95f8-425d-ba80-8638f399badd tempest-TestInstancesWithCinderVolumes-211740280 None] attachment_update completed successfully.
Jun 15 16:05:45 devstack cinder-volume[91863]: DEBUG dbcounter [-] [91863] Writing DB stats cinder:SELECT=24,cinder:UPDATE=17,cinder:INSERT=8,cinder:DELETE=2 {{(pid=91863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 16:05:45 devstack cinder-volume[91863]: DEBUG dbcounter [-] [91863] Writing DB stats cinder:UPDATE=17,cinder:SELECT=26,cinder:INSERT=5,cinder:DELETE=2 {{(pid=91863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 16:05:58 devstack cinder-volume[91863]: INFO cinder.volume.manager [req-8ccd29b4-65ae-4d50-8733-0c67aef8649a req-0cd5414e-82f0-491c-bd0b-687e2904e649 tempest-TestMinimumBasicScenario-876912226 None] Terminate volume connection completed successfully.
Jun 15 16:05:58 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [req-8ccd29b4-65ae-4d50-8733-0c67aef8649a req-0cd5414e-82f0-491c-bd0b-687e2904e649 tempest-TestMinimumBasicScenario-876912226 None] Deleting attachment c8a81052-1429-455f-b108-f6cd39ad459f. {{(pid=91863) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 15 16:06:00 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-936e7c1a-9d4a-462d-82c6-47b91b9bb49b tempest-TestMinimumBasicScenario-876912226 None] Acquiring lock "cinder-a103c420-2fb1-4630-b304-5d982d5eac39-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:06:00 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-936e7c1a-9d4a-462d-82c6-47b91b9bb49b tempest-TestMinimumBasicScenario-876912226 None] Lock "cinder-a103c420-2fb1-4630-b304-5d982d5eac39-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:06:00 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-936e7c1a-9d4a-462d-82c6-47b91b9bb49b tempest-TestMinimumBasicScenario-876912226 None] Acquiring lock "cinder-quobyte-a103c420-2fb1-4630-b304-5d982d5eac39" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:06:00 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-936e7c1a-9d4a-462d-82c6-47b91b9bb49b tempest-TestMinimumBasicScenario-876912226 None] Lock "cinder-quobyte-a103c420-2fb1-4630-b304-5d982d5eac39" acquired by "delete_volume" :: waited 0.016s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:06:01 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e240adc0-9aa0-4950-bc8f-7ae9c37ae426]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:06:01 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-936e7c1a-9d4a-462d-82c6-47b91b9bb49b tempest-TestMinimumBasicScenario-876912226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a103c420-2fb1-4630-b304-5d982d5eac39 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:06:01 devstack sudo[107600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a103c420-2fb1-4630-b304-5d982d5eac39
Jun 15 16:06:01 devstack sudo[107600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:06:01 devstack sudo[107600]: pam_unix(sudo:session): session closed for user root
Jun 15 16:06:01 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-936e7c1a-9d4a-462d-82c6-47b91b9bb49b tempest-TestMinimumBasicScenario-876912226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a103c420-2fb1-4630-b304-5d982d5eac39" returned: 0 in 0.727s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:06:01 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-936e7c1a-9d4a-462d-82c6-47b91b9bb49b tempest-TestMinimumBasicScenario-876912226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a103c420-2fb1-4630-b304-5d982d5eac39 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:06:01 devstack sudo[107605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a103c420-2fb1-4630-b304-5d982d5eac39
Jun 15 16:06:01 devstack sudo[107605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:06:02 devstack sudo[107605]: pam_unix(sudo:session): session closed for user root
Jun 15 16:06:02 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-936e7c1a-9d4a-462d-82c6-47b91b9bb49b tempest-TestMinimumBasicScenario-876912226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a103c420-2fb1-4630-b304-5d982d5eac39" returned: 0 in 0.610s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:06:02 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-936e7c1a-9d4a-462d-82c6-47b91b9bb49b tempest-TestMinimumBasicScenario-876912226 None] Lock "cinder-quobyte-a103c420-2fb1-4630-b304-5d982d5eac39" released by "delete_volume" :: held 1.376s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:06:02 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-936e7c1a-9d4a-462d-82c6-47b91b9bb49b tempest-TestMinimumBasicScenario-876912226 None] Created reservations ['abb7d2b5-d0d2-4930-82c1-861daf5b7c5e', 'c4b542d5-6001-408e-9d68-132d7435c796', '4c07e1d5-a058-4caa-8950-24b9ba5c9169', '9a7b9db9-d67e-40d4-a4f6-4bc268a4a879'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 16:06:02 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-936e7c1a-9d4a-462d-82c6-47b91b9bb49b tempest-TestMinimumBasicScenario-876912226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:06:02 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-936e7c1a-9d4a-462d-82c6-47b91b9bb49b tempest-TestMinimumBasicScenario-876912226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:06:02 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-936e7c1a-9d4a-462d-82c6-47b91b9bb49b tempest-TestMinimumBasicScenario-876912226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:06:02 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-936e7c1a-9d4a-462d-82c6-47b91b9bb49b tempest-TestMinimumBasicScenario-876912226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:06:02 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-936e7c1a-9d4a-462d-82c6-47b91b9bb49b tempest-TestMinimumBasicScenario-876912226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:06:02 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-936e7c1a-9d4a-462d-82c6-47b91b9bb49b tempest-TestMinimumBasicScenario-876912226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:06:02 devstack sudo[107608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 16:06:02 devstack sudo[107608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:06:03 devstack sudo[107608]: pam_unix(sudo:session): session closed for user root
Jun 15 16:06:03 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-936e7c1a-9d4a-462d-82c6-47b91b9bb49b tempest-TestMinimumBasicScenario-876912226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.590s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:06:03 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-936e7c1a-9d4a-462d-82c6-47b91b9bb49b tempest-TestMinimumBasicScenario-876912226 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 16:06:03 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-936e7c1a-9d4a-462d-82c6-47b91b9bb49b tempest-TestMinimumBasicScenario-876912226 None] Deleted volume successfully.
Jun 15 16:06:03 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-936e7c1a-9d4a-462d-82c6-47b91b9bb49b tempest-TestMinimumBasicScenario-876912226 None] Lock "cinder-a103c420-2fb1-4630-b304-5d982d5eac39-delete_volume" released by "delete_volume" :: held 2.198s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:06:12 devstack cinder-volume[91863]: DEBUG dbcounter [-] [91863] Writing DB stats cinder:SELECT=5,cinder:INSERT=2,cinder:UPDATE=8 {{(pid=91863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 16:06:13 devstack cinder-volume[91863]: DEBUG dbcounter [-] [91863] Writing DB stats cinder:SELECT=7,cinder:UPDATE=8,cinder:INSERT=2,cinder:DELETE=1 {{(pid=91863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 16:06:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [req-e7c88580-9dba-4eab-9a53-fbf8dc46f47a req-5ec23434-9354-494b-a5f4-cdef1939b837 tempest-TestInstancesWithCinderVolumes-211740280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:06:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [req-e7c88580-9dba-4eab-9a53-fbf8dc46f47a req-5ec23434-9354-494b-a5f4-cdef1939b837 tempest-TestInstancesWithCinderVolumes-211740280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:06:13 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[43619a02-68eb-482b-9650-29b891c69371]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:06:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-e7c88580-9dba-4eab-9a53-fbf8dc46f47a req-5ec23434-9354-494b-a5f4-cdef1939b837 tempest-TestInstancesWithCinderVolumes-211740280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4c5de600-d287-4a3c-b077-8362728f574f {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:06:13 devstack sudo[107667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4c5de600-d287-4a3c-b077-8362728f574f
Jun 15 16:06:13 devstack sudo[107667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:06:14 devstack sudo[107667]: pam_unix(sudo:session): session closed for user root
Jun 15 16:06:14 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-e7c88580-9dba-4eab-9a53-fbf8dc46f47a req-5ec23434-9354-494b-a5f4-cdef1939b837 tempest-TestInstancesWithCinderVolumes-211740280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4c5de600-d287-4a3c-b077-8362728f574f" returned: 0 in 0.777s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:06:14 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [req-e7c88580-9dba-4eab-9a53-fbf8dc46f47a req-5ec23434-9354-494b-a5f4-cdef1939b837 tempest-TestInstancesWithCinderVolumes-211740280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.800s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:06:14 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [req-e7c88580-9dba-4eab-9a53-fbf8dc46f47a req-5ec23434-9354-494b-a5f4-cdef1939b837 tempest-TestInstancesWithCinderVolumes-211740280 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc', 'name': 'volume-4c5de600-d287-4a3c-b077-8362728f574f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2c9b3d43-067f-4fad-846f-5e1cca20bfc1', 'enforce_multipath': True} {{(pid=91863) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 15 16:06:14 devstack cinder-volume[91863]: INFO cinder.volume.manager [req-e7c88580-9dba-4eab-9a53-fbf8dc46f47a req-5ec23434-9354-494b-a5f4-cdef1939b837 tempest-TestInstancesWithCinderVolumes-211740280 None] attachment_update completed successfully.
Jun 15 16:06:22 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [req-e26d474f-bfa5-4103-8617-03d7f7d9ca59 req-56351e35-8ec1-4fd2-b022-ebf072307b31 tempest-TestInstancesWithCinderVolumes-211740280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:06:22 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [req-e26d474f-bfa5-4103-8617-03d7f7d9ca59 req-56351e35-8ec1-4fd2-b022-ebf072307b31 tempest-TestInstancesWithCinderVolumes-211740280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:06:22 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[96378e1c-662e-43d2-939f-a31516043e1f]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:06:22 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-e26d474f-bfa5-4103-8617-03d7f7d9ca59 req-56351e35-8ec1-4fd2-b022-ebf072307b31 tempest-TestInstancesWithCinderVolumes-211740280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-190befd4-76c0-4378-b6ec-77dfe718fd18 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:06:22 devstack sudo[107695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-190befd4-76c0-4378-b6ec-77dfe718fd18
Jun 15 16:06:22 devstack sudo[107695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:06:22 devstack sudo[107695]: pam_unix(sudo:session): session closed for user root
Jun 15 16:06:22 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-e26d474f-bfa5-4103-8617-03d7f7d9ca59 req-56351e35-8ec1-4fd2-b022-ebf072307b31 tempest-TestInstancesWithCinderVolumes-211740280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-190befd4-76c0-4378-b6ec-77dfe718fd18" returned: 0 in 0.758s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:06:22 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [req-e26d474f-bfa5-4103-8617-03d7f7d9ca59 req-56351e35-8ec1-4fd2-b022-ebf072307b31 tempest-TestInstancesWithCinderVolumes-211740280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.780s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:06:22 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [req-e26d474f-bfa5-4103-8617-03d7f7d9ca59 req-56351e35-8ec1-4fd2-b022-ebf072307b31 tempest-TestInstancesWithCinderVolumes-211740280 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc', 'name': 'volume-190befd4-76c0-4378-b6ec-77dfe718fd18', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '754b8615-92f2-45d9-9e80-e0750779b6b5', 'enforce_multipath': True} {{(pid=91863) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 15 16:06:23 devstack cinder-volume[91863]: INFO cinder.volume.manager [req-e26d474f-bfa5-4103-8617-03d7f7d9ca59 req-56351e35-8ec1-4fd2-b022-ebf072307b31 tempest-TestInstancesWithCinderVolumes-211740280 None] attachment_update completed successfully.
Jun 15 16:06:31 devstack cinder-volume[91863]: DEBUG oslo_service.periodic_task [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 16:06:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:06:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:06:31 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:06:31 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:06:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:06:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:06:31 devstack sudo[107739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 16:06:31 devstack sudo[107739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:06:31 devstack sudo[107739]: pam_unix(sudo:session): session closed for user root
Jun 15 16:06:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.618s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:06:31 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 16:06:31 devstack cinder-volume[91863]: DEBUG oslo_service.periodic_task [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Running periodic task VolumeManager._thread_info {{(pid=91863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 16:06:31 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] thread count: 28 {{(pid=91863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 15 16:06:31 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] thread info: [<_MainThread(MainThread, started 131088232640640)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131088122704576)>, <Thread(Thread-3 (stat_writer), started daemon 131088123058112)>, <Thread(Rabbit-heartbeat, started daemon 131088121268864)>, <Thread(Thread-5 (_runner), started daemon 131088121904192)>, <Thread(Thread-7 (_runner), started daemon 131088122037248)>, <Thread(fd_logger, started daemon 131088119630784)>, <Thread(privsep_reader, started daemon 131088119781440)>, <Thread(tpool_thread_0, started daemon 131088111617728)>, <Thread(tpool_thread_1, started daemon 131088103225024)>, <Thread(tpool_thread_2, started daemon 131088094832320)>, <Thread(tpool_thread_3, started daemon 131088086439616)>, <Thread(tpool_thread_4, started daemon 131088078046912)>, <Thread(tpool_thread_5, started daemon 131088069654208)>, <Thread(tpool_thread_6, started daemon 131088061261504)>, <Thread(tpool_thread_7, started daemon 131088052868800)>, <Thread(tpool_thread_8, started daemon 131088044476096)>, <Thread(tpool_thread_9, started daemon 131088036083392)>, <Thread(tpool_thread_10, started daemon 131088027690688)>, <Thread(tpool_thread_11, started daemon 131088019297984)>, <Thread(tpool_thread_12, started daemon 131088010905280)>, <Thread(tpool_thread_13, started daemon 131088002512576)>, <Thread(tpool_thread_14, started daemon 131087994119872)>, <Thread(tpool_thread_15, started daemon 131087985727168)>, <Thread(tpool_thread_16, started daemon 131087977334464)>, <Thread(tpool_thread_17, started daemon 131087968941760)>, <Thread(tpool_thread_18, started daemon 131087960549056)>, <Thread(tpool_thread_19, started daemon 131087952156352)>] {{(pid=91863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 15 16:06:32 devstack cinder-volume[91863]: INFO cinder.volume.manager [req-de5e3c91-af22-4438-baaf-ae9248218adf req-7cca9ce5-5b94-4b48-8426-72db7a023345 tempest-TestInstancesWithCinderVolumes-211740280 None] Terminate volume connection completed successfully.
Jun 15 16:06:32 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [req-de5e3c91-af22-4438-baaf-ae9248218adf req-7cca9ce5-5b94-4b48-8426-72db7a023345 tempest-TestInstancesWithCinderVolumes-211740280 None] Deleting attachment 2c9b3d43-067f-4fad-846f-5e1cca20bfc1. {{(pid=91863) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 15 16:06:33 devstack cinder-volume[91863]: DEBUG dbcounter [-] [91863] Writing DB stats cinder:SELECT=13,cinder:UPDATE=1 {{(pid=91863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 16:06:34 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-ed6b32fe-cb89-4478-bdd5-684859d15d36 tempest-TestInstancesWithCinderVolumes-211740280 None] Acquiring lock "cinder-4c5de600-d287-4a3c-b077-8362728f574f-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:06:34 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-ed6b32fe-cb89-4478-bdd5-684859d15d36 tempest-TestInstancesWithCinderVolumes-211740280 None] Lock "cinder-4c5de600-d287-4a3c-b077-8362728f574f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:06:34 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-ed6b32fe-cb89-4478-bdd5-684859d15d36 tempest-TestInstancesWithCinderVolumes-211740280 None] Acquiring lock "cinder-quobyte-4c5de600-d287-4a3c-b077-8362728f574f" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:06:34 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-ed6b32fe-cb89-4478-bdd5-684859d15d36 tempest-TestInstancesWithCinderVolumes-211740280 None] Lock "cinder-quobyte-4c5de600-d287-4a3c-b077-8362728f574f" acquired by "delete_volume" :: waited 0.021s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:06:34 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[764b257d-7a57-463b-ac9f-30983c6ebbf5]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:06:34 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ed6b32fe-cb89-4478-bdd5-684859d15d36 tempest-TestInstancesWithCinderVolumes-211740280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4c5de600-d287-4a3c-b077-8362728f574f {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:06:34 devstack sudo[107748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4c5de600-d287-4a3c-b077-8362728f574f
Jun 15 16:06:34 devstack sudo[107748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:06:35 devstack sudo[107748]: pam_unix(sudo:session): session closed for user root
Jun 15 16:06:35 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ed6b32fe-cb89-4478-bdd5-684859d15d36 tempest-TestInstancesWithCinderVolumes-211740280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4c5de600-d287-4a3c-b077-8362728f574f" returned: 0 in 0.877s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:06:35 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ed6b32fe-cb89-4478-bdd5-684859d15d36 tempest-TestInstancesWithCinderVolumes-211740280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4c5de600-d287-4a3c-b077-8362728f574f {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:06:35 devstack sudo[107754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4c5de600-d287-4a3c-b077-8362728f574f
Jun 15 16:06:35 devstack sudo[107754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:06:35 devstack sudo[107754]: pam_unix(sudo:session): session closed for user root
Jun 15 16:06:35 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ed6b32fe-cb89-4478-bdd5-684859d15d36 tempest-TestInstancesWithCinderVolumes-211740280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-4c5de600-d287-4a3c-b077-8362728f574f" returned: 0 in 0.748s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:06:35 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-ed6b32fe-cb89-4478-bdd5-684859d15d36 tempest-TestInstancesWithCinderVolumes-211740280 None] Lock "cinder-quobyte-4c5de600-d287-4a3c-b077-8362728f574f" released by "delete_volume" :: held 1.703s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:06:35 devstack cinder-volume[91863]: WARNING cinder.quota [None req-ed6b32fe-cb89-4478-bdd5-684859d15d36 tempest-TestInstancesWithCinderVolumes-211740280 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-379233119-1915617620 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-379233119-1915617620, it is now deprecated. Please use the default quota class for default quota.
Jun 15 16:06:35 devstack cinder-volume[91863]: WARNING cinder.quota [None req-ed6b32fe-cb89-4478-bdd5-684859d15d36 tempest-TestInstancesWithCinderVolumes-211740280 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-379233119-1915617620 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-379233119-1915617620, it is now deprecated. Please use the default quota class for default quota.
Jun 15 16:06:36 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-ed6b32fe-cb89-4478-bdd5-684859d15d36 tempest-TestInstancesWithCinderVolumes-211740280 None] Created reservations ['2889e583-12d0-47e3-b850-fa7e90dd83e9', '53bd9648-d432-429b-8366-235331de6071', '2380dc04-6c0d-4b63-93aa-42b7c02523de', '6b2b3e0f-bb6c-476f-be75-a8f8d014f45c'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 16:06:36 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-ed6b32fe-cb89-4478-bdd5-684859d15d36 tempest-TestInstancesWithCinderVolumes-211740280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:06:36 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-ed6b32fe-cb89-4478-bdd5-684859d15d36 tempest-TestInstancesWithCinderVolumes-211740280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:06:36 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-ed6b32fe-cb89-4478-bdd5-684859d15d36 tempest-TestInstancesWithCinderVolumes-211740280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:06:36 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-ed6b32fe-cb89-4478-bdd5-684859d15d36 tempest-TestInstancesWithCinderVolumes-211740280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:06:36 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-ed6b32fe-cb89-4478-bdd5-684859d15d36 tempest-TestInstancesWithCinderVolumes-211740280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:06:36 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ed6b32fe-cb89-4478-bdd5-684859d15d36 tempest-TestInstancesWithCinderVolumes-211740280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:06:36 devstack sudo[107757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 16:06:36 devstack sudo[107757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:06:36 devstack sudo[107757]: pam_unix(sudo:session): session closed for user root
Jun 15 16:06:36 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ed6b32fe-cb89-4478-bdd5-684859d15d36 tempest-TestInstancesWithCinderVolumes-211740280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.723s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:06:36 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-ed6b32fe-cb89-4478-bdd5-684859d15d36 tempest-TestInstancesWithCinderVolumes-211740280 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 16:06:36 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-ed6b32fe-cb89-4478-bdd5-684859d15d36 tempest-TestInstancesWithCinderVolumes-211740280 None] Deleted volume successfully.
Jun 15 16:06:36 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-ed6b32fe-cb89-4478-bdd5-684859d15d36 tempest-TestInstancesWithCinderVolumes-211740280 None] Lock "cinder-4c5de600-d287-4a3c-b077-8362728f574f-delete_volume" released by "delete_volume" :: held 2.777s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:06:39 devstack cinder-volume[91863]: INFO cinder.volume.manager [req-01f355e8-4fa4-4ddf-9f8e-3e6482854b2d req-700cad18-aa68-43b3-9c47-5e2c010cbcf8 tempest-TestInstancesWithCinderVolumes-211740280 None] Terminate volume connection completed successfully.
Jun 15 16:06:39 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [req-01f355e8-4fa4-4ddf-9f8e-3e6482854b2d req-700cad18-aa68-43b3-9c47-5e2c010cbcf8 tempest-TestInstancesWithCinderVolumes-211740280 None] Deleting attachment 754b8615-92f2-45d9-9e80-e0750779b6b5. {{(pid=91863) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 15 16:06:41 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-18072f57-aa3d-49a3-b460-e96c81679cb1 tempest-TestShelveInstance-909131245 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 16:06:41 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-18072f57-aa3d-49a3-b460-e96c81679cb1 tempest-TestShelveInstance-909131245 None] Flow 'volume_create_manager' (a3408a89-a124-479a-a9f7-8dcd794fd555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:06:41 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-18072f57-aa3d-49a3-b460-e96c81679cb1 tempest-TestShelveInstance-909131245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7dfee6e-70c5-452c-8c96-2ee5557ddbd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:06:41 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-18072f57-aa3d-49a3-b460-e96c81679cb1 tempest-TestShelveInstance-909131245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7dfee6e-70c5-452c-8c96-2ee5557ddbd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:06:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1070370109',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73a8e838-8955-4e2e-91d5-a6468f82781c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d59dd5ac7ab6428ea3b15bf0f56416f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:06:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:06:41Z,use_quota=True,user_id='1d916822458b471c896badaa453d8a8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:06:41 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-18072f57-aa3d-49a3-b460-e96c81679cb1 tempest-TestShelveInstance-909131245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (520f6b56-7241-4a66-9c95-919e15d83188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:06:41 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-18072f57-aa3d-49a3-b460-e96c81679cb1 tempest-TestShelveInstance-909131245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (520f6b56-7241-4a66-9c95-919e15d83188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:06:41 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-18072f57-aa3d-49a3-b460-e96c81679cb1 tempest-TestShelveInstance-909131245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25806c2a-e30c-4483-b9ed-d4c7e44ec43a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:06:41 devstack cinder-volume[91863]: DEBUG cinder.image.glance [None req-18072f57-aa3d-49a3-b460-e96c81679cb1 tempest-TestShelveInstance-909131245 None] Creating Keystone auth plugin from conf {{(pid=91863) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 15 16:06:41 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-18072f57-aa3d-49a3-b460-e96c81679cb1 tempest-TestShelveInstance-909131245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25806c2a-e30c-4483-b9ed-d4c7e44ec43a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '73a8e838-8955-4e2e-91d5-a6468f82781c', 'volume_name': 'volume-73a8e838-8955-4e2e-91d5-a6468f82781c', 'volume_size': 1, 'image_id': '43adaed4-5eec-483a-aa2b-0818266a94f1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/43adaed4-5eec-483a-aa2b-0818266a94f1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '601536f092c54cdc9ee754c7b1abc241', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '43adaed4-5eec-483a-aa2b-0818266a94f1', 'created_at': datetime.datetime(2026, 6, 15, 13, 42, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 13, 42, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/43adaed4-5eec-483a-aa2b-0818266a94f1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x773954ed3980>}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:06:41 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-18072f57-aa3d-49a3-b460-e96c81679cb1 tempest-TestShelveInstance-909131245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7f30702-4155-4d50-a1e3-ebb1d6e68dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:06:41 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-18072f57-aa3d-49a3-b460-e96c81679cb1 tempest-TestShelveInstance-909131245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7f30702-4155-4d50-a1e3-ebb1d6e68dc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:06:41 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-18072f57-aa3d-49a3-b460-e96c81679cb1 tempest-TestShelveInstance-909131245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8e1a92f-7160-420b-b312-7139a1138a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:06:41 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-18072f57-aa3d-49a3-b460-e96c81679cb1 tempest-TestShelveInstance-909131245 None] Volume 73a8e838-8955-4e2e-91d5-a6468f82781c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-73a8e838-8955-4e2e-91d5-a6468f82781c', 'volume_size': 1, 'image_id': '43adaed4-5eec-483a-aa2b-0818266a94f1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/43adaed4-5eec-483a-aa2b-0818266a94f1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '601536f092c54cdc9ee754c7b1abc241', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '43adaed4-5eec-483a-aa2b-0818266a94f1', 'created_at': datetime.datetime(2026, 6, 15, 13, 42, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 13, 42, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/43adaed4-5eec-483a-aa2b-0818266a94f1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x773954ed3980>}
Jun 15 16:06:41 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-18072f57-aa3d-49a3-b460-e96c81679cb1 tempest-TestShelveInstance-909131245 None] Trying to clone 73a8e838-8955-4e2e-91d5-a6468f82781c from image 43adaed4-5eec-483a-aa2b-0818266a94f1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/43adaed4-5eec-483a-aa2b-0818266a94f1', 'metadata': {}}]). {{(pid=91863) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jun 15 16:06:41 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-6c69f914-41bf-49fe-9b93-5352b5fb79f7 tempest-TestInstancesWithCinderVolumes-211740280 None] Acquiring lock "cinder-190befd4-76c0-4378-b6ec-77dfe718fd18-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:06:41 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-6c69f914-41bf-49fe-9b93-5352b5fb79f7 tempest-TestInstancesWithCinderVolumes-211740280 None] Lock "cinder-190befd4-76c0-4378-b6ec-77dfe718fd18-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:06:41 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-6c69f914-41bf-49fe-9b93-5352b5fb79f7 tempest-TestInstancesWithCinderVolumes-211740280 None] Acquiring lock "cinder-quobyte-190befd4-76c0-4378-b6ec-77dfe718fd18" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:06:41 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-6c69f914-41bf-49fe-9b93-5352b5fb79f7 tempest-TestInstancesWithCinderVolumes-211740280 None] Lock "cinder-quobyte-190befd4-76c0-4378-b6ec-77dfe718fd18" acquired by "delete_volume" :: waited 0.018s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:06:41 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[95851f9e-7eba-4796-9a94-912b261432d4]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:06:41 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6c69f914-41bf-49fe-9b93-5352b5fb79f7 tempest-TestInstancesWithCinderVolumes-211740280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-190befd4-76c0-4378-b6ec-77dfe718fd18 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:06:41 devstack sudo[107819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-190befd4-76c0-4378-b6ec-77dfe718fd18
Jun 15 16:06:41 devstack sudo[107819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:06:42 devstack cinder-volume[91863]: DEBUG cinder.image.image_utils [None req-18072f57-aa3d-49a3-b460-e96c81679cb1 tempest-TestShelveInstance-909131245 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_43adaed4-5eec-483a-aa2b-0818266a94f1_sxt9p201devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=91863) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 15 16:06:42 devstack cinder-volume[91863]: INFO cinder.image.image_utils [None req-18072f57-aa3d-49a3-b460-e96c81679cb1 tempest-TestShelveInstance-909131245 None] Image download 20.69 MB at 20.69 MB/s
Jun 15 16:06:42 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab1d7ea-fcab-4571-8d43-c0ebfc3ddd98]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:06:42 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-18072f57-aa3d-49a3-b460-e96c81679cb1 tempest-TestShelveInstance-909131245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_43adaed4-5eec-483a-aa2b-0818266a94f1_sxt9p201devstack@QuobyteHD {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:06:42 devstack sudo[107822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_43adaed4-5eec-483a-aa2b-0818266a94f1_sxt9p201devstack@QuobyteHD
Jun 15 16:06:42 devstack sudo[107822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:06:42 devstack sudo[107819]: pam_unix(sudo:session): session closed for user root
Jun 15 16:06:42 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6c69f914-41bf-49fe-9b93-5352b5fb79f7 tempest-TestInstancesWithCinderVolumes-211740280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-190befd4-76c0-4378-b6ec-77dfe718fd18" returned: 0 in 0.812s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:06:42 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6c69f914-41bf-49fe-9b93-5352b5fb79f7 tempest-TestInstancesWithCinderVolumes-211740280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-190befd4-76c0-4378-b6ec-77dfe718fd18 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:06:42 devstack sudo[107827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-190befd4-76c0-4378-b6ec-77dfe718fd18
Jun 15 16:06:42 devstack sudo[107827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:06:42 devstack sudo[107822]: pam_unix(sudo:session): session closed for user root
Jun 15 16:06:42 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-18072f57-aa3d-49a3-b460-e96c81679cb1 tempest-TestShelveInstance-909131245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_43adaed4-5eec-483a-aa2b-0818266a94f1_sxt9p201devstack@QuobyteHD" returned: 0 in 0.772s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:06:42 devstack cinder-volume[91863]: DEBUG cinder.image.image_utils [None req-18072f57-aa3d-49a3-b460-e96c81679cb1 tempest-TestShelveInstance-909131245 None] Temporary image 43adaed4-5eec-483a-aa2b-0818266a94f1 is fetched for user 1d916822458b471c896badaa453d8a8e. {{(pid=91863) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 15 16:06:43 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[db159bc1-d202-482c-b4d0-c26892545d80]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:06:43 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-18072f57-aa3d-49a3-b460-e96c81679cb1 tempest-TestShelveInstance-909131245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_43adaed4-5eec-483a-aa2b-0818266a94f1_sxt9p201devstack@QuobyteHD {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:06:43 devstack sudo[107833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_43adaed4-5eec-483a-aa2b-0818266a94f1_sxt9p201devstack@QuobyteHD
Jun 15 16:06:43 devstack sudo[107833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:06:43 devstack sudo[107827]: pam_unix(sudo:session): session closed for user root
Jun 15 16:06:43 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6c69f914-41bf-49fe-9b93-5352b5fb79f7 tempest-TestInstancesWithCinderVolumes-211740280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-190befd4-76c0-4378-b6ec-77dfe718fd18" returned: 0 in 0.690s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:06:43 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-6c69f914-41bf-49fe-9b93-5352b5fb79f7 tempest-TestInstancesWithCinderVolumes-211740280 None] Lock "cinder-quobyte-190befd4-76c0-4378-b6ec-77dfe718fd18" released by "delete_volume" :: held 1.560s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:06:43 devstack cinder-volume[91863]: WARNING cinder.quota [None req-6c69f914-41bf-49fe-9b93-5352b5fb79f7 tempest-TestInstancesWithCinderVolumes-211740280 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-875658006-1700162527 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-875658006-1700162527, it is now deprecated. Please use the default quota class for default quota.
Jun 15 16:06:43 devstack cinder-volume[91863]: WARNING cinder.quota [None req-6c69f914-41bf-49fe-9b93-5352b5fb79f7 tempest-TestInstancesWithCinderVolumes-211740280 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-875658006-1700162527 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-875658006-1700162527, it is now deprecated. Please use the default quota class for default quota.
Jun 15 16:06:43 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-6c69f914-41bf-49fe-9b93-5352b5fb79f7 tempest-TestInstancesWithCinderVolumes-211740280 None] Created reservations ['08b71932-9554-471f-b859-0e142b9acf9d', '68ce762c-26f2-4c51-96f1-599b518f11af', '5985c3d8-dde4-42a4-b5d1-474dc052d94b', '95936666-d07b-4517-a6fb-0a5955db7a19'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 16:06:43 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6c69f914-41bf-49fe-9b93-5352b5fb79f7 tempest-TestInstancesWithCinderVolumes-211740280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:06:43 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6c69f914-41bf-49fe-9b93-5352b5fb79f7 tempest-TestInstancesWithCinderVolumes-211740280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:06:43 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6c69f914-41bf-49fe-9b93-5352b5fb79f7 tempest-TestInstancesWithCinderVolumes-211740280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:06:43 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6c69f914-41bf-49fe-9b93-5352b5fb79f7 tempest-TestInstancesWithCinderVolumes-211740280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:06:43 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6c69f914-41bf-49fe-9b93-5352b5fb79f7 tempest-TestInstancesWithCinderVolumes-211740280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:06:43 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6c69f914-41bf-49fe-9b93-5352b5fb79f7 tempest-TestInstancesWithCinderVolumes-211740280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:06:43 devstack sudo[107836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 16:06:43 devstack sudo[107836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:06:43 devstack sudo[107833]: pam_unix(sudo:session): session closed for user root
Jun 15 16:06:43 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-18072f57-aa3d-49a3-b460-e96c81679cb1 tempest-TestShelveInstance-909131245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_43adaed4-5eec-483a-aa2b-0818266a94f1_sxt9p201devstack@QuobyteHD" returned: 0 in 0.843s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:06:43 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-18072f57-aa3d-49a3-b460-e96c81679cb1 tempest-TestShelveInstance-909131245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:06:43 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-18072f57-aa3d-49a3-b460-e96c81679cb1 tempest-TestShelveInstance-909131245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:06:43 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-18072f57-aa3d-49a3-b460-e96c81679cb1 tempest-TestShelveInstance-909131245 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:06:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1070370109',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73a8e838-8955-4e2e-91d5-a6468f82781c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d59dd5ac7ab6428ea3b15bf0f56416f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:06:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:06:41Z,use_quota=True,user_id='1d916822458b471c896badaa453d8a8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 16:06:43 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-18072f57-aa3d-49a3-b460-e96c81679cb1 tempest-TestShelveInstance-909131245 None] Creating volume 73a8e838-8955-4e2e-91d5-a6468f82781c {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 16:06:43 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-18072f57-aa3d-49a3-b460-e96c81679cb1 tempest-TestShelveInstance-909131245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:06:43 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-18072f57-aa3d-49a3-b460-e96c81679cb1 tempest-TestShelveInstance-909131245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:06:43 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-18072f57-aa3d-49a3-b460-e96c81679cb1 tempest-TestShelveInstance-909131245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:06:43 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-18072f57-aa3d-49a3-b460-e96c81679cb1 tempest-TestShelveInstance-909131245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:06:43 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-18072f57-aa3d-49a3-b460-e96c81679cb1 tempest-TestShelveInstance-909131245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:06:43 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-18072f57-aa3d-49a3-b460-e96c81679cb1 tempest-TestShelveInstance-909131245 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 16:06:43 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-18072f57-aa3d-49a3-b460-e96c81679cb1 tempest-TestShelveInstance-909131245 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 16:06:43 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-18072f57-aa3d-49a3-b460-e96c81679cb1 tempest-TestShelveInstance-909131245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-73a8e838-8955-4e2e-91d5-a6468f82781c 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:06:43 devstack sudo[107842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-73a8e838-8955-4e2e-91d5-a6468f82781c 1073741824
Jun 15 16:06:43 devstack sudo[107842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:06:44 devstack sudo[107836]: pam_unix(sudo:session): session closed for user root
Jun 15 16:06:44 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6c69f914-41bf-49fe-9b93-5352b5fb79f7 tempest-TestInstancesWithCinderVolumes-211740280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.783s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:06:44 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-6c69f914-41bf-49fe-9b93-5352b5fb79f7 tempest-TestInstancesWithCinderVolumes-211740280 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 16:06:44 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-6c69f914-41bf-49fe-9b93-5352b5fb79f7 tempest-TestInstancesWithCinderVolumes-211740280 None] Deleted volume successfully.
Jun 15 16:06:44 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-6c69f914-41bf-49fe-9b93-5352b5fb79f7 tempest-TestInstancesWithCinderVolumes-211740280 None] Lock "cinder-190befd4-76c0-4378-b6ec-77dfe718fd18-delete_volume" released by "delete_volume" :: held 2.613s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:06:44 devstack sudo[107842]: pam_unix(sudo:session): session closed for user root
Jun 15 16:06:44 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-18072f57-aa3d-49a3-b460-e96c81679cb1 tempest-TestShelveInstance-909131245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-73a8e838-8955-4e2e-91d5-a6468f82781c 1073741824" returned: 0 in 1.004s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:06:44 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-18072f57-aa3d-49a3-b460-e96c81679cb1 tempest-TestShelveInstance-909131245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-73a8e838-8955-4e2e-91d5-a6468f82781c {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:06:44 devstack sudo[107852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-73a8e838-8955-4e2e-91d5-a6468f82781c
Jun 15 16:06:44 devstack sudo[107852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:06:45 devstack sudo[107852]: pam_unix(sudo:session): session closed for user root
Jun 15 16:06:45 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-18072f57-aa3d-49a3-b460-e96c81679cb1 tempest-TestShelveInstance-909131245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-73a8e838-8955-4e2e-91d5-a6468f82781c" returned: 0 in 0.727s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:06:45 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-18072f57-aa3d-49a3-b460-e96c81679cb1 tempest-TestShelveInstance-909131245 None] <== create_volume: return (1778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 16:06:45 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-18072f57-aa3d-49a3-b460-e96c81679cb1 tempest-TestShelveInstance-909131245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.781s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:06:45 devstack cinder-volume[91863]: DEBUG cinder.volume.volume_utils [None req-18072f57-aa3d-49a3-b460-e96c81679cb1 tempest-TestShelveInstance-909131245 None] Attempting download of 43adaed4-5eec-483a-aa2b-0818266a94f1 ((None, [{'url': 'file:///opt/stack/data/glance/images/43adaed4-5eec-483a-aa2b-0818266a94f1', 'metadata': {}}])) to volume 73a8e838-8955-4e2e-91d5-a6468f82781c. {{(pid=91863) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 15 16:06:45 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3bf5583-3add-4e33-abc2-760499e6756d]: (4, 'raw') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:06:45 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-18072f57-aa3d-49a3-b460-e96c81679cb1 tempest-TestShelveInstance-909131245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_43adaed4-5eec-483a-aa2b-0818266a94f1_fssdvmu_ {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:06:45 devstack sudo[107891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_43adaed4-5eec-483a-aa2b-0818266a94f1_fssdvmu_
Jun 15 16:06:45 devstack sudo[107891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:06:46 devstack sudo[107891]: pam_unix(sudo:session): session closed for user root
Jun 15 16:06:46 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-18072f57-aa3d-49a3-b460-e96c81679cb1 tempest-TestShelveInstance-909131245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_43adaed4-5eec-483a-aa2b-0818266a94f1_fssdvmu_" returned: 0 in 0.770s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:06:46 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-18072f57-aa3d-49a3-b460-e96c81679cb1 tempest-TestShelveInstance-909131245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_43adaed4-5eec-483a-aa2b-0818266a94f1_fssdvmu_ {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:06:46 devstack sudo[107898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_43adaed4-5eec-483a-aa2b-0818266a94f1_fssdvmu_
Jun 15 16:06:46 devstack sudo[107898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:06:47 devstack sudo[107898]: pam_unix(sudo:session): session closed for user root
Jun 15 16:06:47 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-18072f57-aa3d-49a3-b460-e96c81679cb1 tempest-TestShelveInstance-909131245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_43adaed4-5eec-483a-aa2b-0818266a94f1_fssdvmu_" returned: 1 in 0.663s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:06:47 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-18072f57-aa3d-49a3-b460-e96c81679cb1 tempest-TestShelveInstance-909131245 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_43adaed4-5eec-483a-aa2b-0818266a94f1_fssdvmu_' failed. Not Retrying. {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 15 16:06:47 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e8f09ae-0f31-4d7f-92e5-552905251c32]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:06:47 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-18072f57-aa3d-49a3-b460-e96c81679cb1 tempest-TestShelveInstance-909131245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_43adaed4-5eec-483a-aa2b-0818266a94f1_sxt9p201devstack@QuobyteHD {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:06:47 devstack sudo[107902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_43adaed4-5eec-483a-aa2b-0818266a94f1_sxt9p201devstack@QuobyteHD
Jun 15 16:06:47 devstack sudo[107902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:06:47 devstack sudo[107902]: pam_unix(sudo:session): session closed for user root
Jun 15 16:06:47 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-18072f57-aa3d-49a3-b460-e96c81679cb1 tempest-TestShelveInstance-909131245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_43adaed4-5eec-483a-aa2b-0818266a94f1_sxt9p201devstack@QuobyteHD" returned: 0 in 0.700s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:06:47 devstack cinder-volume[91863]: DEBUG cinder.image.image_utils [None req-18072f57-aa3d-49a3-b460-e96c81679cb1 tempest-TestShelveInstance-909131245 None] 43adaed4-5eec-483a-aa2b-0818266a94f1 was qcow2, converting to raw {{(pid=91863) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 15 16:06:47 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-18072f57-aa3d-49a3-b460-e96c81679cb1 tempest-TestShelveInstance-909131245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_43adaed4-5eec-483a-aa2b-0818266a94f1_sxt9p201devstack@QuobyteHD /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-73a8e838-8955-4e2e-91d5-a6468f82781c {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:06:47 devstack sudo[107908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_43adaed4-5eec-483a-aa2b-0818266a94f1_sxt9p201devstack@QuobyteHD /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-73a8e838-8955-4e2e-91d5-a6468f82781c
Jun 15 16:06:47 devstack sudo[107908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:06:48 devstack cinder-volume[91863]: INFO cinder.volume.manager [req-afe7c880-01a3-46a0-8e62-91cc80548dbd req-fb749a39-9c03-40a2-a0d5-9de2641ddf9a tempest-TestInstancesWithCinderVolumes-211740280 None] Terminate volume connection completed successfully.
Jun 15 16:06:48 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [req-afe7c880-01a3-46a0-8e62-91cc80548dbd req-fb749a39-9c03-40a2-a0d5-9de2641ddf9a tempest-TestInstancesWithCinderVolumes-211740280 None] Deleting attachment c7d707c7-b0fc-4409-9235-e026a0175729. {{(pid=91863) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 15 16:06:49 devstack sudo[107908]: pam_unix(sudo:session): session closed for user root
Jun 15 16:06:49 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-18072f57-aa3d-49a3-b460-e96c81679cb1 tempest-TestShelveInstance-909131245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_43adaed4-5eec-483a-aa2b-0818266a94f1_sxt9p201devstack@QuobyteHD /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-73a8e838-8955-4e2e-91d5-a6468f82781c" returned: 0 in 1.734s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:06:49 devstack cinder-volume[91863]: DEBUG cinder.image.image_utils [None req-18072f57-aa3d-49a3-b460-e96c81679cb1 tempest-TestShelveInstance-909131245 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_43adaed4-5eec-483a-aa2b-0818266a94f1_sxt9p201devstack@QuobyteHD, size 112.00 MB, duration 1.74 sec, destination /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-73a8e838-8955-4e2e-91d5-a6468f82781c {{(pid=91863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 15 16:06:49 devstack cinder-volume[91863]: INFO cinder.image.image_utils [None req-18072f57-aa3d-49a3-b460-e96c81679cb1 tempest-TestShelveInstance-909131245 None] Converted 112.00 MB image at 64.54 MB/s
Jun 15 16:06:49 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-18072f57-aa3d-49a3-b460-e96c81679cb1 tempest-TestShelveInstance-909131245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-73a8e838-8955-4e2e-91d5-a6468f82781c 1G {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:06:49 devstack sudo[107920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-73a8e838-8955-4e2e-91d5-a6468f82781c 1G
Jun 15 16:06:49 devstack sudo[107920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:06:50 devstack sudo[107920]: pam_unix(sudo:session): session closed for user root
Jun 15 16:06:50 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-18072f57-aa3d-49a3-b460-e96c81679cb1 tempest-TestShelveInstance-909131245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-73a8e838-8955-4e2e-91d5-a6468f82781c 1G" returned: 0 in 0.631s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:06:50 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e92014f7-5305-466d-91c2-794b0a735b49]: (4, 'raw') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:06:50 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-18072f57-aa3d-49a3-b460-e96c81679cb1 tempest-TestShelveInstance-909131245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-73a8e838-8955-4e2e-91d5-a6468f82781c {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:06:50 devstack sudo[107925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-73a8e838-8955-4e2e-91d5-a6468f82781c
Jun 15 16:06:50 devstack sudo[107925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:06:51 devstack sudo[107925]: pam_unix(sudo:session): session closed for user root
Jun 15 16:06:51 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-18072f57-aa3d-49a3-b460-e96c81679cb1 tempest-TestShelveInstance-909131245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-73a8e838-8955-4e2e-91d5-a6468f82781c" returned: 0 in 0.709s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:06:51 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-18072f57-aa3d-49a3-b460-e96c81679cb1 tempest-TestShelveInstance-909131245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-73a8e838-8955-4e2e-91d5-a6468f82781c {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:06:51 devstack sudo[107930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-73a8e838-8955-4e2e-91d5-a6468f82781c
Jun 15 16:06:51 devstack sudo[107930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:06:51 devstack sudo[107930]: pam_unix(sudo:session): session closed for user root
Jun 15 16:06:51 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-18072f57-aa3d-49a3-b460-e96c81679cb1 tempest-TestShelveInstance-909131245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-73a8e838-8955-4e2e-91d5-a6468f82781c" returned: 1 in 0.702s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:06:51 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-18072f57-aa3d-49a3-b460-e96c81679cb1 tempest-TestShelveInstance-909131245 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-73a8e838-8955-4e2e-91d5-a6468f82781c' failed. Not Retrying. {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 15 16:06:51 devstack cinder-volume[91863]: DEBUG cinder.volume.volume_utils [None req-18072f57-aa3d-49a3-b460-e96c81679cb1 tempest-TestShelveInstance-909131245 None] Downloaded image 43adaed4-5eec-483a-aa2b-0818266a94f1 ((None, [{'url': 'file:///opt/stack/data/glance/images/43adaed4-5eec-483a-aa2b-0818266a94f1', 'metadata': {}}])) to volume 73a8e838-8955-4e2e-91d5-a6468f82781c successfully. {{(pid=91863) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 15 16:06:51 devstack cinder-volume[91863]: DEBUG cinder.image.image_utils [None req-18072f57-aa3d-49a3-b460-e96c81679cb1 tempest-TestShelveInstance-909131245 None] Temporary image 43adaed4-5eec-483a-aa2b-0818266a94f1 for user 1d916822458b471c896badaa453d8a8e is deleted. {{(pid=91863) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 15 16:06:51 devstack cinder-volume[91863]: DEBUG cinder.volume.volume_utils [None req-18072f57-aa3d-49a3-b460-e96c81679cb1 tempest-TestShelveInstance-909131245 None] Marking volume 73a8e838-8955-4e2e-91d5-a6468f82781c as bootable. {{(pid=91863) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 15 16:06:51 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-18072f57-aa3d-49a3-b460-e96c81679cb1 tempest-TestShelveInstance-909131245 None] Copying metadata from image 43adaed4-5eec-483a-aa2b-0818266a94f1 to 73a8e838-8955-4e2e-91d5-a6468f82781c. {{(pid=91863) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 15 16:06:51 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-18072f57-aa3d-49a3-b460-e96c81679cb1 tempest-TestShelveInstance-909131245 None] Creating volume glance metadata for volume 73a8e838-8955-4e2e-91d5-a6468f82781c backed by image 43adaed4-5eec-483a-aa2b-0818266a94f1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '43adaed4-5eec-483a-aa2b-0818266a94f1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=91863) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 15 16:06:51 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-18072f57-aa3d-49a3-b460-e96c81679cb1 tempest-TestShelveInstance-909131245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8e1a92f-7160-420b-b312-7139a1138a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73a8e838-8955-4e2e-91d5-a6468f82781c', 'volume_size': 1, 'image_id': '43adaed4-5eec-483a-aa2b-0818266a94f1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/43adaed4-5eec-483a-aa2b-0818266a94f1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '601536f092c54cdc9ee754c7b1abc241', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '43adaed4-5eec-483a-aa2b-0818266a94f1', 'created_at': datetime.datetime(2026, 6, 15, 13, 42, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 13, 42, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/43adaed4-5eec-483a-aa2b-0818266a94f1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x773954ed3980>}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:06:51 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-18072f57-aa3d-49a3-b460-e96c81679cb1 tempest-TestShelveInstance-909131245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0be7e97a-709d-4f1a-8040-ce651334b0c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:06:51 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-18072f57-aa3d-49a3-b460-e96c81679cb1 tempest-TestShelveInstance-909131245 None] Volume volume-73a8e838-8955-4e2e-91d5-a6468f82781c (73a8e838-8955-4e2e-91d5-a6468f82781c): created successfully
Jun 15 16:06:51 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-18072f57-aa3d-49a3-b460-e96c81679cb1 tempest-TestShelveInstance-909131245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0be7e97a-709d-4f1a-8040-ce651334b0c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:06:51 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-18072f57-aa3d-49a3-b460-e96c81679cb1 tempest-TestShelveInstance-909131245 None] Flow 'volume_create_manager' (a3408a89-a124-479a-a9f7-8dcd794fd555) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:06:51 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-18072f57-aa3d-49a3-b460-e96c81679cb1 tempest-TestShelveInstance-909131245 None] Created volume successfully.
Jun 15 16:06:52 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-3dd27e52-13e6-4907-b4fc-98140d8f754b tempest-TestInstancesWithCinderVolumes-211740280 None] Acquiring lock "cinder-97b34023-e498-4fd2-9ce1-2fb380bfb652-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:06:52 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-3dd27e52-13e6-4907-b4fc-98140d8f754b tempest-TestInstancesWithCinderVolumes-211740280 None] Lock "cinder-97b34023-e498-4fd2-9ce1-2fb380bfb652-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:06:52 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-3dd27e52-13e6-4907-b4fc-98140d8f754b tempest-TestInstancesWithCinderVolumes-211740280 None] Acquiring lock "cinder-quobyte-97b34023-e498-4fd2-9ce1-2fb380bfb652" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:06:52 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-3dd27e52-13e6-4907-b4fc-98140d8f754b tempest-TestInstancesWithCinderVolumes-211740280 None] Lock "cinder-quobyte-97b34023-e498-4fd2-9ce1-2fb380bfb652" acquired by "delete_volume" :: waited 0.017s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:06:52 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3440c2b0-a0e5-4479-b757-daca9abbf19d]: (4, 'raw') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:06:52 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3dd27e52-13e6-4907-b4fc-98140d8f754b tempest-TestInstancesWithCinderVolumes-211740280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-97b34023-e498-4fd2-9ce1-2fb380bfb652 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:06:52 devstack sudo[107936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-97b34023-e498-4fd2-9ce1-2fb380bfb652
Jun 15 16:06:52 devstack sudo[107936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:06:52 devstack sudo[107936]: pam_unix(sudo:session): session closed for user root
Jun 15 16:06:52 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3dd27e52-13e6-4907-b4fc-98140d8f754b tempest-TestInstancesWithCinderVolumes-211740280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-97b34023-e498-4fd2-9ce1-2fb380bfb652" returned: 0 in 0.704s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:06:52 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3dd27e52-13e6-4907-b4fc-98140d8f754b tempest-TestInstancesWithCinderVolumes-211740280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-97b34023-e498-4fd2-9ce1-2fb380bfb652 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:06:52 devstack sudo[107940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-97b34023-e498-4fd2-9ce1-2fb380bfb652
Jun 15 16:06:52 devstack sudo[107940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:06:53 devstack sudo[107940]: pam_unix(sudo:session): session closed for user root
Jun 15 16:06:53 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3dd27e52-13e6-4907-b4fc-98140d8f754b tempest-TestInstancesWithCinderVolumes-211740280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-97b34023-e498-4fd2-9ce1-2fb380bfb652" returned: 1 in 0.729s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:06:53 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3dd27e52-13e6-4907-b4fc-98140d8f754b tempest-TestInstancesWithCinderVolumes-211740280 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-97b34023-e498-4fd2-9ce1-2fb380bfb652' failed. Not Retrying. {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 15 16:06:53 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3dd27e52-13e6-4907-b4fc-98140d8f754b tempest-TestInstancesWithCinderVolumes-211740280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-97b34023-e498-4fd2-9ce1-2fb380bfb652 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:06:53 devstack sudo[107947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-97b34023-e498-4fd2-9ce1-2fb380bfb652
Jun 15 16:06:53 devstack sudo[107947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:06:54 devstack sudo[107947]: pam_unix(sudo:session): session closed for user root
Jun 15 16:06:54 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3dd27e52-13e6-4907-b4fc-98140d8f754b tempest-TestInstancesWithCinderVolumes-211740280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-97b34023-e498-4fd2-9ce1-2fb380bfb652" returned: 0 in 0.594s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:06:54 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-3dd27e52-13e6-4907-b4fc-98140d8f754b tempest-TestInstancesWithCinderVolumes-211740280 None] Lock "cinder-quobyte-97b34023-e498-4fd2-9ce1-2fb380bfb652" released by "delete_volume" :: held 2.105s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:06:54 devstack cinder-volume[91863]: WARNING cinder.quota [None req-3dd27e52-13e6-4907-b4fc-98140d8f754b tempest-TestInstancesWithCinderVolumes-211740280 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-921525987-608977607 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-921525987-608977607, it is now deprecated. Please use the default quota class for default quota.
Jun 15 16:06:54 devstack cinder-volume[91863]: WARNING cinder.quota [None req-3dd27e52-13e6-4907-b4fc-98140d8f754b tempest-TestInstancesWithCinderVolumes-211740280 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-921525987-608977607 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-921525987-608977607, it is now deprecated. Please use the default quota class for default quota.
Jun 15 16:06:54 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-3dd27e52-13e6-4907-b4fc-98140d8f754b tempest-TestInstancesWithCinderVolumes-211740280 None] Created reservations ['fe8b1353-7c33-4827-8034-65c2c19536af', 'eca8cb94-7340-47c3-a8d2-0694bedf20f3', '5f8f0516-79b6-4aad-a769-9dac2f0191d0', '682c828e-c249-477c-aa5f-1729bc48758b'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 16:06:54 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-3dd27e52-13e6-4907-b4fc-98140d8f754b tempest-TestInstancesWithCinderVolumes-211740280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:06:54 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-3dd27e52-13e6-4907-b4fc-98140d8f754b tempest-TestInstancesWithCinderVolumes-211740280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:06:54 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-3dd27e52-13e6-4907-b4fc-98140d8f754b tempest-TestInstancesWithCinderVolumes-211740280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:06:54 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-3dd27e52-13e6-4907-b4fc-98140d8f754b tempest-TestInstancesWithCinderVolumes-211740280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:06:54 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-3dd27e52-13e6-4907-b4fc-98140d8f754b tempest-TestInstancesWithCinderVolumes-211740280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:06:54 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3dd27e52-13e6-4907-b4fc-98140d8f754b tempest-TestInstancesWithCinderVolumes-211740280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:06:54 devstack sudo[107951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 16:06:54 devstack sudo[107951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:06:54 devstack sudo[107951]: pam_unix(sudo:session): session closed for user root
Jun 15 16:06:54 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3dd27e52-13e6-4907-b4fc-98140d8f754b tempest-TestInstancesWithCinderVolumes-211740280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.622s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:06:54 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-3dd27e52-13e6-4907-b4fc-98140d8f754b tempest-TestInstancesWithCinderVolumes-211740280 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 16:06:54 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-3dd27e52-13e6-4907-b4fc-98140d8f754b tempest-TestInstancesWithCinderVolumes-211740280 None] Deleted volume successfully.
Jun 15 16:06:54 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-3dd27e52-13e6-4907-b4fc-98140d8f754b tempest-TestInstancesWithCinderVolumes-211740280 None] Lock "cinder-97b34023-e498-4fd2-9ce1-2fb380bfb652-delete_volume" released by "delete_volume" :: held 2.973s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:06:59 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [req-940fc0f6-a39b-414c-80b6-76aa493a535a req-52162d40-7aec-424a-9cf7-b52104ea63e7 tempest-TestShelveInstance-909131245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:06:59 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [req-940fc0f6-a39b-414c-80b6-76aa493a535a req-52162d40-7aec-424a-9cf7-b52104ea63e7 tempest-TestShelveInstance-909131245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:06:59 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[41bfe6cb-2336-4a86-bb56-43dbae0293be]: (4, 'raw') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:06:59 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-940fc0f6-a39b-414c-80b6-76aa493a535a req-52162d40-7aec-424a-9cf7-b52104ea63e7 tempest-TestShelveInstance-909131245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-73a8e838-8955-4e2e-91d5-a6468f82781c {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:06:59 devstack sudo[107964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-73a8e838-8955-4e2e-91d5-a6468f82781c
Jun 15 16:06:59 devstack sudo[107964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:07:00 devstack sudo[107964]: pam_unix(sudo:session): session closed for user root
Jun 15 16:07:00 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-940fc0f6-a39b-414c-80b6-76aa493a535a req-52162d40-7aec-424a-9cf7-b52104ea63e7 tempest-TestShelveInstance-909131245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-73a8e838-8955-4e2e-91d5-a6468f82781c" returned: 0 in 0.792s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:07:00 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-940fc0f6-a39b-414c-80b6-76aa493a535a req-52162d40-7aec-424a-9cf7-b52104ea63e7 tempest-TestShelveInstance-909131245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-73a8e838-8955-4e2e-91d5-a6468f82781c {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:07:00 devstack sudo[107970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-73a8e838-8955-4e2e-91d5-a6468f82781c
Jun 15 16:07:00 devstack sudo[107970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:07:00 devstack sudo[107970]: pam_unix(sudo:session): session closed for user root
Jun 15 16:07:00 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-940fc0f6-a39b-414c-80b6-76aa493a535a req-52162d40-7aec-424a-9cf7-b52104ea63e7 tempest-TestShelveInstance-909131245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-73a8e838-8955-4e2e-91d5-a6468f82781c" returned: 1 in 0.735s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:07:00 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-940fc0f6-a39b-414c-80b6-76aa493a535a req-52162d40-7aec-424a-9cf7-b52104ea63e7 tempest-TestShelveInstance-909131245 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-73a8e838-8955-4e2e-91d5-a6468f82781c' failed. Not Retrying. {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 15 16:07:00 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [req-940fc0f6-a39b-414c-80b6-76aa493a535a req-52162d40-7aec-424a-9cf7-b52104ea63e7 tempest-TestShelveInstance-909131245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.580s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:07:00 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [req-940fc0f6-a39b-414c-80b6-76aa493a535a req-52162d40-7aec-424a-9cf7-b52104ea63e7 tempest-TestShelveInstance-909131245 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc', 'name': 'volume-73a8e838-8955-4e2e-91d5-a6468f82781c', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8ad0653f-346f-4fa8-92f4-5e2f6bf51a57', 'enforce_multipath': True} {{(pid=91863) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 15 16:07:00 devstack cinder-volume[91863]: INFO cinder.volume.manager [req-940fc0f6-a39b-414c-80b6-76aa493a535a req-52162d40-7aec-424a-9cf7-b52104ea63e7 tempest-TestShelveInstance-909131245 None] attachment_update completed successfully.
Jun 15 16:07:10 devstack cinder-volume[91863]: DEBUG dbcounter [-] [91863] Writing DB stats cinder:SELECT=34,cinder:UPDATE=36,cinder:INSERT=15,cinder:DELETE=2 {{(pid=91863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 16:07:10 devstack cinder-volume[91863]: DEBUG dbcounter [-] [91863] Writing DB stats cinder:SELECT=42,cinder:UPDATE=30,cinder:INSERT=11,cinder:DELETE=2 {{(pid=91863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 16:07:30 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-227607b2-b59e-43f7-b85f-5875040363da tempest-TestServerVolumeAttachmentScenario-578095458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 16:07:30 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-227607b2-b59e-43f7-b85f-5875040363da tempest-TestServerVolumeAttachmentScenario-578095458 None] Flow 'volume_create_manager' (d94eb804-2853-4468-a884-bfe41d70f1a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:07:30 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-227607b2-b59e-43f7-b85f-5875040363da tempest-TestServerVolumeAttachmentScenario-578095458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2de2d1bf-7be1-44c4-943a-fbec576fce73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:07:30 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-227607b2-b59e-43f7-b85f-5875040363da tempest-TestServerVolumeAttachmentScenario-578095458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2de2d1bf-7be1-44c4-943a-fbec576fce73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:07:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-732778231',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdef80e5-cc3d-418e-b469-0c092e043c92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83303685ecd5495582deae72d637ec29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:07:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:07:30Z,use_quota=True,user_id='022d804dabfa4e3f84c8e6afedb73a9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:07:30 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-227607b2-b59e-43f7-b85f-5875040363da tempest-TestServerVolumeAttachmentScenario-578095458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff8a72bb-617b-46ed-88dd-39c486bc0cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:07:30 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-227607b2-b59e-43f7-b85f-5875040363da tempest-TestServerVolumeAttachmentScenario-578095458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff8a72bb-617b-46ed-88dd-39c486bc0cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:07:30 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-227607b2-b59e-43f7-b85f-5875040363da tempest-TestServerVolumeAttachmentScenario-578095458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (197a69a6-7da7-4f4b-9123-124c99af435d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:07:30 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-227607b2-b59e-43f7-b85f-5875040363da tempest-TestServerVolumeAttachmentScenario-578095458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (197a69a6-7da7-4f4b-9123-124c99af435d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdef80e5-cc3d-418e-b469-0c092e043c92', 'volume_name': 'volume-fdef80e5-cc3d-418e-b469-0c092e043c92', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:07:30 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-227607b2-b59e-43f7-b85f-5875040363da tempest-TestServerVolumeAttachmentScenario-578095458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74295aa7-bcfc-432f-8877-919669df5083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:07:30 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-227607b2-b59e-43f7-b85f-5875040363da tempest-TestServerVolumeAttachmentScenario-578095458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74295aa7-bcfc-432f-8877-919669df5083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:07:30 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-227607b2-b59e-43f7-b85f-5875040363da tempest-TestServerVolumeAttachmentScenario-578095458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4beda56f-c88e-4349-bac8-78771b88e910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:07:30 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-227607b2-b59e-43f7-b85f-5875040363da tempest-TestServerVolumeAttachmentScenario-578095458 None] Volume fdef80e5-cc3d-418e-b469-0c092e043c92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdef80e5-cc3d-418e-b469-0c092e043c92', 'volume_size': 1}
Jun 15 16:07:30 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-227607b2-b59e-43f7-b85f-5875040363da tempest-TestServerVolumeAttachmentScenario-578095458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:07:30 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-227607b2-b59e-43f7-b85f-5875040363da tempest-TestServerVolumeAttachmentScenario-578095458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:07:30 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-227607b2-b59e-43f7-b85f-5875040363da tempest-TestServerVolumeAttachmentScenario-578095458 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:07:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-732778231',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdef80e5-cc3d-418e-b469-0c092e043c92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83303685ecd5495582deae72d637ec29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:07:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:07:30Z,use_quota=True,user_id='022d804dabfa4e3f84c8e6afedb73a9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 16:07:30 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-227607b2-b59e-43f7-b85f-5875040363da tempest-TestServerVolumeAttachmentScenario-578095458 None] Creating volume fdef80e5-cc3d-418e-b469-0c092e043c92 {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 16:07:30 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-227607b2-b59e-43f7-b85f-5875040363da tempest-TestServerVolumeAttachmentScenario-578095458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:07:30 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-227607b2-b59e-43f7-b85f-5875040363da tempest-TestServerVolumeAttachmentScenario-578095458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:07:30 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-227607b2-b59e-43f7-b85f-5875040363da tempest-TestServerVolumeAttachmentScenario-578095458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:07:30 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-227607b2-b59e-43f7-b85f-5875040363da tempest-TestServerVolumeAttachmentScenario-578095458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:07:30 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-227607b2-b59e-43f7-b85f-5875040363da tempest-TestServerVolumeAttachmentScenario-578095458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:07:30 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-227607b2-b59e-43f7-b85f-5875040363da tempest-TestServerVolumeAttachmentScenario-578095458 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 16:07:30 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-227607b2-b59e-43f7-b85f-5875040363da tempest-TestServerVolumeAttachmentScenario-578095458 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 16:07:30 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-227607b2-b59e-43f7-b85f-5875040363da tempest-TestServerVolumeAttachmentScenario-578095458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fdef80e5-cc3d-418e-b469-0c092e043c92 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:07:30 devstack sudo[108552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fdef80e5-cc3d-418e-b469-0c092e043c92 1073741824
Jun 15 16:07:30 devstack sudo[108552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:07:30 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-68c0b0a7-ca80-4793-82c2-8b09ecf61c8e tempest-TestServerVolumeAttachmentScenario-578095458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 16:07:30 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-68c0b0a7-ca80-4793-82c2-8b09ecf61c8e tempest-TestServerVolumeAttachmentScenario-578095458 None] Flow 'volume_create_manager' (833f57ad-3a41-48e4-99fe-9420c06edeab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:07:30 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-68c0b0a7-ca80-4793-82c2-8b09ecf61c8e tempest-TestServerVolumeAttachmentScenario-578095458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90f01f7d-f4e5-49bf-8ddf-79660be932dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:07:30 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-68c0b0a7-ca80-4793-82c2-8b09ecf61c8e tempest-TestServerVolumeAttachmentScenario-578095458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90f01f7d-f4e5-49bf-8ddf-79660be932dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:07:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1674813308',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9d82fda-f7f8-4e7b-9e38-b6c73577754a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83303685ecd5495582deae72d637ec29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:07:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:07:31Z,use_quota=True,user_id='022d804dabfa4e3f84c8e6afedb73a9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:07:30 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-68c0b0a7-ca80-4793-82c2-8b09ecf61c8e tempest-TestServerVolumeAttachmentScenario-578095458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb0c07c9-59f2-47e4-b7fc-fef78d7f7c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:07:30 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-68c0b0a7-ca80-4793-82c2-8b09ecf61c8e tempest-TestServerVolumeAttachmentScenario-578095458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb0c07c9-59f2-47e4-b7fc-fef78d7f7c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:07:30 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-68c0b0a7-ca80-4793-82c2-8b09ecf61c8e tempest-TestServerVolumeAttachmentScenario-578095458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d4ca46c-d58c-434a-86fe-00e07b18a631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:07:30 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-68c0b0a7-ca80-4793-82c2-8b09ecf61c8e tempest-TestServerVolumeAttachmentScenario-578095458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d4ca46c-d58c-434a-86fe-00e07b18a631) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9d82fda-f7f8-4e7b-9e38-b6c73577754a', 'volume_name': 'volume-f9d82fda-f7f8-4e7b-9e38-b6c73577754a', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:07:30 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-68c0b0a7-ca80-4793-82c2-8b09ecf61c8e tempest-TestServerVolumeAttachmentScenario-578095458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc9cb191-e34a-4cdf-a3e5-d5ea83c421b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:07:30 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-68c0b0a7-ca80-4793-82c2-8b09ecf61c8e tempest-TestServerVolumeAttachmentScenario-578095458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc9cb191-e34a-4cdf-a3e5-d5ea83c421b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:07:30 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-68c0b0a7-ca80-4793-82c2-8b09ecf61c8e tempest-TestServerVolumeAttachmentScenario-578095458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42944d35-faf5-4a8e-a2e2-83c0de22571b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:07:30 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-68c0b0a7-ca80-4793-82c2-8b09ecf61c8e tempest-TestServerVolumeAttachmentScenario-578095458 None] Volume f9d82fda-f7f8-4e7b-9e38-b6c73577754a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9d82fda-f7f8-4e7b-9e38-b6c73577754a', 'volume_size': 1}
Jun 15 16:07:30 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-68c0b0a7-ca80-4793-82c2-8b09ecf61c8e tempest-TestServerVolumeAttachmentScenario-578095458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:07:31 devstack cinder-volume[91863]: DEBUG oslo_service.periodic_task [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 16:07:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:07:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:07:31 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:07:31 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:07:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:07:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:07:31 devstack sudo[108557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 16:07:31 devstack sudo[108557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:07:31 devstack sudo[108552]: pam_unix(sudo:session): session closed for user root
Jun 15 16:07:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-227607b2-b59e-43f7-b85f-5875040363da tempest-TestServerVolumeAttachmentScenario-578095458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fdef80e5-cc3d-418e-b469-0c092e043c92 1073741824" returned: 0 in 0.985s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:07:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-227607b2-b59e-43f7-b85f-5875040363da tempest-TestServerVolumeAttachmentScenario-578095458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fdef80e5-cc3d-418e-b469-0c092e043c92 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:07:31 devstack sudo[108560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fdef80e5-cc3d-418e-b469-0c092e043c92
Jun 15 16:07:31 devstack sudo[108560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:07:31 devstack sudo[108557]: pam_unix(sudo:session): session closed for user root
Jun 15 16:07:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.715s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:07:31 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 16:07:31 devstack cinder-volume[91863]: DEBUG oslo_service.periodic_task [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Running periodic task VolumeManager._thread_info {{(pid=91863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 16:07:31 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] thread count: 28 {{(pid=91863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 15 16:07:31 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] thread info: [<_MainThread(MainThread, started 131088232640640)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131088122704576)>, <Thread(Thread-3 (stat_writer), started daemon 131088123058112)>, <Thread(Rabbit-heartbeat, started daemon 131088121268864)>, <Thread(Thread-5 (_runner), started daemon 131088121904192)>, <Thread(Thread-7 (_runner), started daemon 131088122037248)>, <Thread(fd_logger, started daemon 131088119630784)>, <Thread(privsep_reader, started daemon 131088119781440)>, <Thread(tpool_thread_0, started daemon 131088111617728)>, <Thread(tpool_thread_1, started daemon 131088103225024)>, <Thread(tpool_thread_2, started daemon 131088094832320)>, <Thread(tpool_thread_3, started daemon 131088086439616)>, <Thread(tpool_thread_4, started daemon 131088078046912)>, <Thread(tpool_thread_5, started daemon 131088069654208)>, <Thread(tpool_thread_6, started daemon 131088061261504)>, <Thread(tpool_thread_7, started daemon 131088052868800)>, <Thread(tpool_thread_8, started daemon 131088044476096)>, <Thread(tpool_thread_9, started daemon 131088036083392)>, <Thread(tpool_thread_10, started daemon 131088027690688)>, <Thread(tpool_thread_11, started daemon 131088019297984)>, <Thread(tpool_thread_12, started daemon 131088010905280)>, <Thread(tpool_thread_13, started daemon 131088002512576)>, <Thread(tpool_thread_14, started daemon 131087994119872)>, <Thread(tpool_thread_15, started daemon 131087985727168)>, <Thread(tpool_thread_16, started daemon 131087977334464)>, <Thread(tpool_thread_17, started daemon 131087968941760)>, <Thread(tpool_thread_18, started daemon 131087960549056)>, <Thread(tpool_thread_19, started daemon 131087952156352)>] {{(pid=91863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 15 16:07:32 devstack sudo[108560]: pam_unix(sudo:session): session closed for user root
Jun 15 16:07:32 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-227607b2-b59e-43f7-b85f-5875040363da tempest-TestServerVolumeAttachmentScenario-578095458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fdef80e5-cc3d-418e-b469-0c092e043c92" returned: 0 in 0.718s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:07:32 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-227607b2-b59e-43f7-b85f-5875040363da tempest-TestServerVolumeAttachmentScenario-578095458 None] <== create_volume: return (1761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 16:07:32 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-227607b2-b59e-43f7-b85f-5875040363da tempest-TestServerVolumeAttachmentScenario-578095458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.763s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:07:32 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-68c0b0a7-ca80-4793-82c2-8b09ecf61c8e tempest-TestServerVolumeAttachmentScenario-578095458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.395s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:07:32 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-68c0b0a7-ca80-4793-82c2-8b09ecf61c8e tempest-TestServerVolumeAttachmentScenario-578095458 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:07:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1674813308',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9d82fda-f7f8-4e7b-9e38-b6c73577754a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83303685ecd5495582deae72d637ec29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:07:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:07:31Z,use_quota=True,user_id='022d804dabfa4e3f84c8e6afedb73a9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 16:07:32 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-68c0b0a7-ca80-4793-82c2-8b09ecf61c8e tempest-TestServerVolumeAttachmentScenario-578095458 None] Creating volume f9d82fda-f7f8-4e7b-9e38-b6c73577754a {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 16:07:32 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-68c0b0a7-ca80-4793-82c2-8b09ecf61c8e tempest-TestServerVolumeAttachmentScenario-578095458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:07:32 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-68c0b0a7-ca80-4793-82c2-8b09ecf61c8e tempest-TestServerVolumeAttachmentScenario-578095458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:07:32 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-68c0b0a7-ca80-4793-82c2-8b09ecf61c8e tempest-TestServerVolumeAttachmentScenario-578095458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:07:32 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-68c0b0a7-ca80-4793-82c2-8b09ecf61c8e tempest-TestServerVolumeAttachmentScenario-578095458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:07:32 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-68c0b0a7-ca80-4793-82c2-8b09ecf61c8e tempest-TestServerVolumeAttachmentScenario-578095458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:07:32 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-68c0b0a7-ca80-4793-82c2-8b09ecf61c8e tempest-TestServerVolumeAttachmentScenario-578095458 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 16:07:32 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-68c0b0a7-ca80-4793-82c2-8b09ecf61c8e tempest-TestServerVolumeAttachmentScenario-578095458 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 16:07:32 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-68c0b0a7-ca80-4793-82c2-8b09ecf61c8e tempest-TestServerVolumeAttachmentScenario-578095458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-f9d82fda-f7f8-4e7b-9e38-b6c73577754a 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:07:32 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-227607b2-b59e-43f7-b85f-5875040363da tempest-TestServerVolumeAttachmentScenario-578095458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4beda56f-c88e-4349-bac8-78771b88e910) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdef80e5-cc3d-418e-b469-0c092e043c92', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:07:32 devstack sudo[108564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-f9d82fda-f7f8-4e7b-9e38-b6c73577754a 1073741824
Jun 15 16:07:32 devstack sudo[108564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:07:32 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-227607b2-b59e-43f7-b85f-5875040363da tempest-TestServerVolumeAttachmentScenario-578095458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f66affad-cbfd-4eab-96bc-4880299f3d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:07:32 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-227607b2-b59e-43f7-b85f-5875040363da tempest-TestServerVolumeAttachmentScenario-578095458 None] Volume volume-fdef80e5-cc3d-418e-b469-0c092e043c92 (fdef80e5-cc3d-418e-b469-0c092e043c92): created successfully
Jun 15 16:07:32 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-227607b2-b59e-43f7-b85f-5875040363da tempest-TestServerVolumeAttachmentScenario-578095458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f66affad-cbfd-4eab-96bc-4880299f3d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:07:32 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-227607b2-b59e-43f7-b85f-5875040363da tempest-TestServerVolumeAttachmentScenario-578095458 None] Flow 'volume_create_manager' (d94eb804-2853-4468-a884-bfe41d70f1a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:07:32 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-227607b2-b59e-43f7-b85f-5875040363da tempest-TestServerVolumeAttachmentScenario-578095458 None] Created volume successfully.
Jun 15 16:07:33 devstack sudo[108564]: pam_unix(sudo:session): session closed for user root
Jun 15 16:07:33 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-68c0b0a7-ca80-4793-82c2-8b09ecf61c8e tempest-TestServerVolumeAttachmentScenario-578095458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-f9d82fda-f7f8-4e7b-9e38-b6c73577754a 1073741824" returned: 0 in 0.873s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:07:33 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-68c0b0a7-ca80-4793-82c2-8b09ecf61c8e tempest-TestServerVolumeAttachmentScenario-578095458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-f9d82fda-f7f8-4e7b-9e38-b6c73577754a {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:07:33 devstack sudo[108576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-f9d82fda-f7f8-4e7b-9e38-b6c73577754a
Jun 15 16:07:33 devstack sudo[108576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:07:33 devstack sudo[108576]: pam_unix(sudo:session): session closed for user root
Jun 15 16:07:33 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-68c0b0a7-ca80-4793-82c2-8b09ecf61c8e tempest-TestServerVolumeAttachmentScenario-578095458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-f9d82fda-f7f8-4e7b-9e38-b6c73577754a" returned: 0 in 0.640s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:07:33 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-68c0b0a7-ca80-4793-82c2-8b09ecf61c8e tempest-TestServerVolumeAttachmentScenario-578095458 None] <== create_volume: return (1564ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 16:07:33 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-68c0b0a7-ca80-4793-82c2-8b09ecf61c8e tempest-TestServerVolumeAttachmentScenario-578095458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.569s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:07:33 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-68c0b0a7-ca80-4793-82c2-8b09ecf61c8e tempest-TestServerVolumeAttachmentScenario-578095458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42944d35-faf5-4a8e-a2e2-83c0de22571b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9d82fda-f7f8-4e7b-9e38-b6c73577754a', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:07:33 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-68c0b0a7-ca80-4793-82c2-8b09ecf61c8e tempest-TestServerVolumeAttachmentScenario-578095458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e936a8ab-719b-4f60-b752-4ca5b3988ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:07:33 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-68c0b0a7-ca80-4793-82c2-8b09ecf61c8e tempest-TestServerVolumeAttachmentScenario-578095458 None] Volume volume-f9d82fda-f7f8-4e7b-9e38-b6c73577754a (f9d82fda-f7f8-4e7b-9e38-b6c73577754a): created successfully
Jun 15 16:07:33 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-68c0b0a7-ca80-4793-82c2-8b09ecf61c8e tempest-TestServerVolumeAttachmentScenario-578095458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e936a8ab-719b-4f60-b752-4ca5b3988ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:07:33 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-68c0b0a7-ca80-4793-82c2-8b09ecf61c8e tempest-TestServerVolumeAttachmentScenario-578095458 None] Flow 'volume_create_manager' (833f57ad-3a41-48e4-99fe-9420c06edeab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:07:33 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-68c0b0a7-ca80-4793-82c2-8b09ecf61c8e tempest-TestServerVolumeAttachmentScenario-578095458 None] Created volume successfully.
Jun 15 16:07:39 devstack cinder-volume[91863]: INFO cinder.volume.manager [req-2b86ab52-9ded-4e93-8b22-1699dcbea7e7 req-c6ca495f-80f3-4d77-9410-880fcf3016b9 tempest-TestShelveInstance-909131245 None] Terminate volume connection completed successfully.
Jun 15 16:07:39 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [req-2b86ab52-9ded-4e93-8b22-1699dcbea7e7 req-c6ca495f-80f3-4d77-9410-880fcf3016b9 tempest-TestShelveInstance-909131245 None] Deleting attachment 8ad0653f-346f-4fa8-92f4-5e2f6bf51a57. {{(pid=91863) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 15 16:07:44 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [req-4c918893-8826-492e-a891-a2df8d3a74b5 req-406da348-c2ad-486a-820d-b388a0403d49 tempest-TestShelveInstance-909131245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:07:44 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [req-4c918893-8826-492e-a891-a2df8d3a74b5 req-406da348-c2ad-486a-820d-b388a0403d49 tempest-TestShelveInstance-909131245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:07:44 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[30496c4a-d386-4630-ac1d-9fc224300f94]: (4, 'raw') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:07:44 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-4c918893-8826-492e-a891-a2df8d3a74b5 req-406da348-c2ad-486a-820d-b388a0403d49 tempest-TestShelveInstance-909131245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-73a8e838-8955-4e2e-91d5-a6468f82781c {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:07:44 devstack sudo[108690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-73a8e838-8955-4e2e-91d5-a6468f82781c
Jun 15 16:07:44 devstack sudo[108690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:07:45 devstack sudo[108690]: pam_unix(sudo:session): session closed for user root
Jun 15 16:07:45 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-4c918893-8826-492e-a891-a2df8d3a74b5 req-406da348-c2ad-486a-820d-b388a0403d49 tempest-TestShelveInstance-909131245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-73a8e838-8955-4e2e-91d5-a6468f82781c" returned: 0 in 0.749s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:07:45 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-4c918893-8826-492e-a891-a2df8d3a74b5 req-406da348-c2ad-486a-820d-b388a0403d49 tempest-TestShelveInstance-909131245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-73a8e838-8955-4e2e-91d5-a6468f82781c {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:07:45 devstack sudo[108695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-73a8e838-8955-4e2e-91d5-a6468f82781c
Jun 15 16:07:45 devstack sudo[108695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:07:46 devstack sudo[108695]: pam_unix(sudo:session): session closed for user root
Jun 15 16:07:46 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-4c918893-8826-492e-a891-a2df8d3a74b5 req-406da348-c2ad-486a-820d-b388a0403d49 tempest-TestShelveInstance-909131245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-73a8e838-8955-4e2e-91d5-a6468f82781c" returned: 1 in 1.146s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:07:46 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-4c918893-8826-492e-a891-a2df8d3a74b5 req-406da348-c2ad-486a-820d-b388a0403d49 tempest-TestShelveInstance-909131245 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-73a8e838-8955-4e2e-91d5-a6468f82781c' failed. Not Retrying. {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 15 16:07:46 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [req-4c918893-8826-492e-a891-a2df8d3a74b5 req-406da348-c2ad-486a-820d-b388a0403d49 tempest-TestShelveInstance-909131245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.932s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:07:46 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [req-4c918893-8826-492e-a891-a2df8d3a74b5 req-406da348-c2ad-486a-820d-b388a0403d49 tempest-TestShelveInstance-909131245 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc', 'name': 'volume-73a8e838-8955-4e2e-91d5-a6468f82781c', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '306eb01f-ca7e-41bf-b6c1-c139854ff6f0', 'enforce_multipath': True} {{(pid=91863) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 15 16:07:46 devstack cinder-volume[91863]: INFO cinder.volume.manager [req-4c918893-8826-492e-a891-a2df8d3a74b5 req-406da348-c2ad-486a-820d-b388a0403d49 tempest-TestShelveInstance-909131245 None] attachment_update completed successfully.
Jun 15 16:07:56 devstack cinder-volume[91863]: DEBUG dbcounter [-] [91863] Writing DB stats cinder:SELECT=12,cinder:UPDATE=9,cinder:DELETE=1 {{(pid=91863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 16:07:56 devstack cinder-volume[91863]: DEBUG dbcounter [-] [91863] Writing DB stats cinder:SELECT=9,cinder:INSERT=2,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=91863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 16:08:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [req-3d7d8ff8-ec95-4119-bf30-6126c97d5c43 req-99b6eefc-f96f-4d4c-9641-91353c6ffffb tempest-TestServerVolumeAttachmentScenario-578095458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:08:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [req-3d7d8ff8-ec95-4119-bf30-6126c97d5c43 req-99b6eefc-f96f-4d4c-9641-91353c6ffffb tempest-TestServerVolumeAttachmentScenario-578095458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:08:13 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e54ec7-f923-490a-b56c-2b2f0042e0fb]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:08:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-3d7d8ff8-ec95-4119-bf30-6126c97d5c43 req-99b6eefc-f96f-4d4c-9641-91353c6ffffb tempest-TestServerVolumeAttachmentScenario-578095458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fdef80e5-cc3d-418e-b469-0c092e043c92 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:08:13 devstack sudo[109274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fdef80e5-cc3d-418e-b469-0c092e043c92
Jun 15 16:08:13 devstack sudo[109274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:08:14 devstack sudo[109274]: pam_unix(sudo:session): session closed for user root
Jun 15 16:08:14 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-3d7d8ff8-ec95-4119-bf30-6126c97d5c43 req-99b6eefc-f96f-4d4c-9641-91353c6ffffb tempest-TestServerVolumeAttachmentScenario-578095458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fdef80e5-cc3d-418e-b469-0c092e043c92" returned: 0 in 0.727s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:08:14 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [req-3d7d8ff8-ec95-4119-bf30-6126c97d5c43 req-99b6eefc-f96f-4d4c-9641-91353c6ffffb tempest-TestServerVolumeAttachmentScenario-578095458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.745s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:08:14 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [req-3d7d8ff8-ec95-4119-bf30-6126c97d5c43 req-99b6eefc-f96f-4d4c-9641-91353c6ffffb tempest-TestServerVolumeAttachmentScenario-578095458 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc', 'name': 'volume-fdef80e5-cc3d-418e-b469-0c092e043c92', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b0bc1d65-0263-4cd1-b25c-6e7825823fae', 'enforce_multipath': True} {{(pid=91863) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 15 16:08:14 devstack cinder-volume[91863]: INFO cinder.volume.manager [req-3d7d8ff8-ec95-4119-bf30-6126c97d5c43 req-99b6eefc-f96f-4d4c-9641-91353c6ffffb tempest-TestServerVolumeAttachmentScenario-578095458 None] attachment_update completed successfully.
Jun 15 16:08:24 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [req-91327b80-f4c5-4871-a49d-7d836cedd280 req-7127e509-f546-4c5d-af0d-29784094cefd tempest-TestServerVolumeAttachmentScenario-578095458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:08:24 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [req-91327b80-f4c5-4871-a49d-7d836cedd280 req-7127e509-f546-4c5d-af0d-29784094cefd tempest-TestServerVolumeAttachmentScenario-578095458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:08:24 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4091f0f6-fe74-4a0e-95c9-21b9f02031b6]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:08:24 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-91327b80-f4c5-4871-a49d-7d836cedd280 req-7127e509-f546-4c5d-af0d-29784094cefd tempest-TestServerVolumeAttachmentScenario-578095458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-f9d82fda-f7f8-4e7b-9e38-b6c73577754a {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:08:24 devstack sudo[109321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-f9d82fda-f7f8-4e7b-9e38-b6c73577754a
Jun 15 16:08:24 devstack sudo[109321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:08:24 devstack cinder-volume[91863]: DEBUG dbcounter [-] [91863] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=91863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 16:08:24 devstack sudo[109321]: pam_unix(sudo:session): session closed for user root
Jun 15 16:08:24 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-91327b80-f4c5-4871-a49d-7d836cedd280 req-7127e509-f546-4c5d-af0d-29784094cefd tempest-TestServerVolumeAttachmentScenario-578095458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-f9d82fda-f7f8-4e7b-9e38-b6c73577754a" returned: 0 in 0.739s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:08:24 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [req-91327b80-f4c5-4871-a49d-7d836cedd280 req-7127e509-f546-4c5d-af0d-29784094cefd tempest-TestServerVolumeAttachmentScenario-578095458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.756s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:08:24 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [req-91327b80-f4c5-4871-a49d-7d836cedd280 req-7127e509-f546-4c5d-af0d-29784094cefd tempest-TestServerVolumeAttachmentScenario-578095458 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc', 'name': 'volume-f9d82fda-f7f8-4e7b-9e38-b6c73577754a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8304c730-16bb-40c5-b186-216cc738e09a', 'enforce_multipath': True} {{(pid=91863) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 15 16:08:24 devstack cinder-volume[91863]: INFO cinder.volume.manager [req-91327b80-f4c5-4871-a49d-7d836cedd280 req-7127e509-f546-4c5d-af0d-29784094cefd tempest-TestServerVolumeAttachmentScenario-578095458 None] attachment_update completed successfully.
Jun 15 16:08:30 devstack cinder-volume[91863]: INFO cinder.volume.manager [req-201a287f-4e37-49b0-b19f-6c51c73398f5 req-da3d4ee1-d691-486a-8cdb-5d0fd8509cf2 tempest-TestServerVolumeAttachmentScenario-578095458 None] Terminate volume connection completed successfully.
Jun 15 16:08:30 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [req-201a287f-4e37-49b0-b19f-6c51c73398f5 req-da3d4ee1-d691-486a-8cdb-5d0fd8509cf2 tempest-TestServerVolumeAttachmentScenario-578095458 None] Deleting attachment 8304c730-16bb-40c5-b186-216cc738e09a. {{(pid=91863) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 15 16:08:31 devstack cinder-volume[91863]: DEBUG oslo_service.periodic_task [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 16:08:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:08:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:08:31 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:08:31 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:08:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:08:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:08:31 devstack sudo[109331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 16:08:31 devstack sudo[109331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:08:31 devstack sudo[109331]: pam_unix(sudo:session): session closed for user root
Jun 15 16:08:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.611s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:08:31 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 16:08:31 devstack cinder-volume[91863]: DEBUG oslo_service.periodic_task [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Running periodic task VolumeManager._thread_info {{(pid=91863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 16:08:31 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] thread count: 28 {{(pid=91863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 15 16:08:31 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] thread info: [<_MainThread(MainThread, started 131088232640640)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131088122704576)>, <Thread(Thread-3 (stat_writer), started daemon 131088123058112)>, <Thread(Rabbit-heartbeat, started daemon 131088121268864)>, <Thread(Thread-5 (_runner), started daemon 131088121904192)>, <Thread(Thread-7 (_runner), started daemon 131088122037248)>, <Thread(fd_logger, started daemon 131088119630784)>, <Thread(privsep_reader, started daemon 131088119781440)>, <Thread(tpool_thread_0, started daemon 131088111617728)>, <Thread(tpool_thread_1, started daemon 131088103225024)>, <Thread(tpool_thread_2, started daemon 131088094832320)>, <Thread(tpool_thread_3, started daemon 131088086439616)>, <Thread(tpool_thread_4, started daemon 131088078046912)>, <Thread(tpool_thread_5, started daemon 131088069654208)>, <Thread(tpool_thread_6, started daemon 131088061261504)>, <Thread(tpool_thread_7, started daemon 131088052868800)>, <Thread(tpool_thread_8, started daemon 131088044476096)>, <Thread(tpool_thread_9, started daemon 131088036083392)>, <Thread(tpool_thread_10, started daemon 131088027690688)>, <Thread(tpool_thread_11, started daemon 131088019297984)>, <Thread(tpool_thread_12, started daemon 131088010905280)>, <Thread(tpool_thread_13, started daemon 131088002512576)>, <Thread(tpool_thread_14, started daemon 131087994119872)>, <Thread(tpool_thread_15, started daemon 131087985727168)>, <Thread(tpool_thread_16, started daemon 131087977334464)>, <Thread(tpool_thread_17, started daemon 131087968941760)>, <Thread(tpool_thread_18, started daemon 131087960549056)>, <Thread(tpool_thread_19, started daemon 131087952156352)>] {{(pid=91863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 15 16:08:34 devstack cinder-volume[91863]: INFO cinder.volume.manager [req-f155b34e-7c03-419d-ad40-235d2729c0ea req-50b1f7dd-393b-4184-a120-009a77b20267 tempest-TestServerVolumeAttachmentScenario-578095458 None] Terminate volume connection completed successfully.
Jun 15 16:08:34 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [req-f155b34e-7c03-419d-ad40-235d2729c0ea req-50b1f7dd-393b-4184-a120-009a77b20267 tempest-TestServerVolumeAttachmentScenario-578095458 None] Deleting attachment b0bc1d65-0263-4cd1-b25c-6e7825823fae. {{(pid=91863) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 15 16:08:40 devstack cinder-volume[91863]: INFO cinder.volume.manager [req-b92314a0-4797-4278-83b7-5fa2b196f9cd req-20b46cb7-7867-48f2-a99b-6fb174d7df6b tempest-TestShelveInstance-909131245 None] Terminate volume connection completed successfully.
Jun 15 16:08:40 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [req-b92314a0-4797-4278-83b7-5fa2b196f9cd req-20b46cb7-7867-48f2-a99b-6fb174d7df6b tempest-TestShelveInstance-909131245 None] Deleting attachment 306eb01f-ca7e-41bf-b6c1-c139854ff6f0. {{(pid=91863) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 15 16:08:40 devstack cinder-volume[91863]: DEBUG cinder.coordination [req-b92314a0-4797-4278-83b7-5fa2b196f9cd req-2d61f180-938f-43e2-a527-56ab0bb77515 tempest-TestShelveInstance-909131245 None] Acquiring lock "cinder-73a8e838-8955-4e2e-91d5-a6468f82781c-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:08:40 devstack cinder-volume[91863]: DEBUG cinder.coordination [req-b92314a0-4797-4278-83b7-5fa2b196f9cd req-2d61f180-938f-43e2-a527-56ab0bb77515 tempest-TestShelveInstance-909131245 None] Lock "cinder-73a8e838-8955-4e2e-91d5-a6468f82781c-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:08:40 devstack cinder-volume[91863]: DEBUG cinder.coordination [req-b92314a0-4797-4278-83b7-5fa2b196f9cd req-2d61f180-938f-43e2-a527-56ab0bb77515 tempest-TestShelveInstance-909131245 None] Acquiring lock "cinder-quobyte-73a8e838-8955-4e2e-91d5-a6468f82781c" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:08:40 devstack cinder-volume[91863]: DEBUG cinder.coordination [req-b92314a0-4797-4278-83b7-5fa2b196f9cd req-2d61f180-938f-43e2-a527-56ab0bb77515 tempest-TestShelveInstance-909131245 None] Lock "cinder-quobyte-73a8e838-8955-4e2e-91d5-a6468f82781c" acquired by "delete_volume" :: waited 0.013s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:08:40 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f52c06f-473c-45fe-9a7f-31be98e306f1]: (4, 'raw') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:08:40 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-b92314a0-4797-4278-83b7-5fa2b196f9cd req-2d61f180-938f-43e2-a527-56ab0bb77515 tempest-TestShelveInstance-909131245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-73a8e838-8955-4e2e-91d5-a6468f82781c {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:08:40 devstack sudo[109474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-73a8e838-8955-4e2e-91d5-a6468f82781c
Jun 15 16:08:40 devstack sudo[109474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:08:41 devstack sudo[109474]: pam_unix(sudo:session): session closed for user root
Jun 15 16:08:41 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-b92314a0-4797-4278-83b7-5fa2b196f9cd req-2d61f180-938f-43e2-a527-56ab0bb77515 tempest-TestShelveInstance-909131245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-73a8e838-8955-4e2e-91d5-a6468f82781c" returned: 0 in 0.693s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:08:41 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-b92314a0-4797-4278-83b7-5fa2b196f9cd req-2d61f180-938f-43e2-a527-56ab0bb77515 tempest-TestShelveInstance-909131245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-73a8e838-8955-4e2e-91d5-a6468f82781c {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:08:41 devstack sudo[109478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-73a8e838-8955-4e2e-91d5-a6468f82781c
Jun 15 16:08:41 devstack sudo[109478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:08:42 devstack sudo[109478]: pam_unix(sudo:session): session closed for user root
Jun 15 16:08:42 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-b92314a0-4797-4278-83b7-5fa2b196f9cd req-2d61f180-938f-43e2-a527-56ab0bb77515 tempest-TestShelveInstance-909131245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-73a8e838-8955-4e2e-91d5-a6468f82781c" returned: 1 in 0.660s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:08:42 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-b92314a0-4797-4278-83b7-5fa2b196f9cd req-2d61f180-938f-43e2-a527-56ab0bb77515 tempest-TestShelveInstance-909131245 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-73a8e838-8955-4e2e-91d5-a6468f82781c' failed. Not Retrying. {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 15 16:08:42 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-b92314a0-4797-4278-83b7-5fa2b196f9cd req-2d61f180-938f-43e2-a527-56ab0bb77515 tempest-TestShelveInstance-909131245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-73a8e838-8955-4e2e-91d5-a6468f82781c {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:08:42 devstack sudo[109483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-73a8e838-8955-4e2e-91d5-a6468f82781c
Jun 15 16:08:42 devstack sudo[109483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:08:42 devstack sudo[109483]: pam_unix(sudo:session): session closed for user root
Jun 15 16:08:42 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-b92314a0-4797-4278-83b7-5fa2b196f9cd req-2d61f180-938f-43e2-a527-56ab0bb77515 tempest-TestShelveInstance-909131245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-73a8e838-8955-4e2e-91d5-a6468f82781c" returned: 0 in 0.609s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:08:42 devstack cinder-volume[91863]: DEBUG cinder.coordination [req-b92314a0-4797-4278-83b7-5fa2b196f9cd req-2d61f180-938f-43e2-a527-56ab0bb77515 tempest-TestShelveInstance-909131245 None] Lock "cinder-quobyte-73a8e838-8955-4e2e-91d5-a6468f82781c" released by "delete_volume" :: held 2.027s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:08:42 devstack cinder-volume[91863]: DEBUG cinder.quota [req-b92314a0-4797-4278-83b7-5fa2b196f9cd req-2d61f180-938f-43e2-a527-56ab0bb77515 tempest-TestShelveInstance-909131245 None] Created reservations ['9118776e-3abd-4ff3-9f68-338806e1a0f1', 'bba0d8e5-819d-4733-9baa-351bd5971bb4', '8483812c-2da3-4093-abf3-0c3537c212e0', 'a1c3b780-0c3a-44af-ad4a-45333a69eefd'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 16:08:42 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [req-b92314a0-4797-4278-83b7-5fa2b196f9cd req-2d61f180-938f-43e2-a527-56ab0bb77515 tempest-TestShelveInstance-909131245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:08:42 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [req-b92314a0-4797-4278-83b7-5fa2b196f9cd req-2d61f180-938f-43e2-a527-56ab0bb77515 tempest-TestShelveInstance-909131245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:08:42 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [req-b92314a0-4797-4278-83b7-5fa2b196f9cd req-2d61f180-938f-43e2-a527-56ab0bb77515 tempest-TestShelveInstance-909131245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:08:42 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [req-b92314a0-4797-4278-83b7-5fa2b196f9cd req-2d61f180-938f-43e2-a527-56ab0bb77515 tempest-TestShelveInstance-909131245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:08:42 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [req-b92314a0-4797-4278-83b7-5fa2b196f9cd req-2d61f180-938f-43e2-a527-56ab0bb77515 tempest-TestShelveInstance-909131245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:08:42 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-b92314a0-4797-4278-83b7-5fa2b196f9cd req-2d61f180-938f-43e2-a527-56ab0bb77515 tempest-TestShelveInstance-909131245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:08:43 devstack sudo[109486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 16:08:43 devstack sudo[109486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:08:43 devstack sudo[109486]: pam_unix(sudo:session): session closed for user root
Jun 15 16:08:43 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-b92314a0-4797-4278-83b7-5fa2b196f9cd req-2d61f180-938f-43e2-a527-56ab0bb77515 tempest-TestShelveInstance-909131245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.583s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:08:43 devstack cinder-volume[91863]: DEBUG cinder.manager [req-b92314a0-4797-4278-83b7-5fa2b196f9cd req-2d61f180-938f-43e2-a527-56ab0bb77515 tempest-TestShelveInstance-909131245 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 16:08:43 devstack cinder-volume[91863]: INFO cinder.volume.manager [req-b92314a0-4797-4278-83b7-5fa2b196f9cd req-2d61f180-938f-43e2-a527-56ab0bb77515 tempest-TestShelveInstance-909131245 None] Deleted volume successfully.
Jun 15 16:08:43 devstack cinder-volume[91863]: DEBUG cinder.coordination [req-b92314a0-4797-4278-83b7-5fa2b196f9cd req-2d61f180-938f-43e2-a527-56ab0bb77515 tempest-TestShelveInstance-909131245 None] Lock "cinder-73a8e838-8955-4e2e-91d5-a6468f82781c-delete_volume" released by "delete_volume" :: held 2.816s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:08:46 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-4a03bde3-934d-42ba-9b7c-68a36d709248 tempest-TestServerVolumeAttachmentScenario-578095458 None] Acquiring lock "cinder-f9d82fda-f7f8-4e7b-9e38-b6c73577754a-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:08:46 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-4a03bde3-934d-42ba-9b7c-68a36d709248 tempest-TestServerVolumeAttachmentScenario-578095458 None] Lock "cinder-f9d82fda-f7f8-4e7b-9e38-b6c73577754a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:08:46 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-4a03bde3-934d-42ba-9b7c-68a36d709248 tempest-TestServerVolumeAttachmentScenario-578095458 None] Acquiring lock "cinder-quobyte-f9d82fda-f7f8-4e7b-9e38-b6c73577754a" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:08:46 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-4a03bde3-934d-42ba-9b7c-68a36d709248 tempest-TestServerVolumeAttachmentScenario-578095458 None] Lock "cinder-quobyte-f9d82fda-f7f8-4e7b-9e38-b6c73577754a" acquired by "delete_volume" :: waited 0.021s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:08:46 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b1ded3-a60a-4ec6-a0c5-1c0aaf6924d3]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:08:46 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-4a03bde3-934d-42ba-9b7c-68a36d709248 tempest-TestServerVolumeAttachmentScenario-578095458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-f9d82fda-f7f8-4e7b-9e38-b6c73577754a {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:08:46 devstack sudo[109491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-f9d82fda-f7f8-4e7b-9e38-b6c73577754a
Jun 15 16:08:46 devstack sudo[109491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:08:46 devstack sudo[109491]: pam_unix(sudo:session): session closed for user root
Jun 15 16:08:46 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-4a03bde3-934d-42ba-9b7c-68a36d709248 tempest-TestServerVolumeAttachmentScenario-578095458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-f9d82fda-f7f8-4e7b-9e38-b6c73577754a" returned: 0 in 0.823s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:08:46 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-4a03bde3-934d-42ba-9b7c-68a36d709248 tempest-TestServerVolumeAttachmentScenario-578095458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-f9d82fda-f7f8-4e7b-9e38-b6c73577754a {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:08:47 devstack sudo[109496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-f9d82fda-f7f8-4e7b-9e38-b6c73577754a
Jun 15 16:08:47 devstack sudo[109496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:08:47 devstack sudo[109496]: pam_unix(sudo:session): session closed for user root
Jun 15 16:08:47 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-4a03bde3-934d-42ba-9b7c-68a36d709248 tempest-TestServerVolumeAttachmentScenario-578095458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-f9d82fda-f7f8-4e7b-9e38-b6c73577754a" returned: 0 in 0.619s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:08:47 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-4a03bde3-934d-42ba-9b7c-68a36d709248 tempest-TestServerVolumeAttachmentScenario-578095458 None] Lock "cinder-quobyte-f9d82fda-f7f8-4e7b-9e38-b6c73577754a" released by "delete_volume" :: held 1.497s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:08:47 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-4a03bde3-934d-42ba-9b7c-68a36d709248 tempest-TestServerVolumeAttachmentScenario-578095458 None] Created reservations ['6c58a23f-be99-4dbc-b228-6820f855cf7f', '84a34510-f372-4b07-a026-098bf112b58a', '76347f16-12cb-48ba-9924-51cbb24270cf', '9e03619f-7c90-4b76-847c-cc6b3e885779'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 16:08:47 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-4a03bde3-934d-42ba-9b7c-68a36d709248 tempest-TestServerVolumeAttachmentScenario-578095458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:08:47 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-4a03bde3-934d-42ba-9b7c-68a36d709248 tempest-TestServerVolumeAttachmentScenario-578095458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:08:47 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-4a03bde3-934d-42ba-9b7c-68a36d709248 tempest-TestServerVolumeAttachmentScenario-578095458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:08:47 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-4a03bde3-934d-42ba-9b7c-68a36d709248 tempest-TestServerVolumeAttachmentScenario-578095458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:08:47 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-4a03bde3-934d-42ba-9b7c-68a36d709248 tempest-TestServerVolumeAttachmentScenario-578095458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:08:47 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-4a03bde3-934d-42ba-9b7c-68a36d709248 tempest-TestServerVolumeAttachmentScenario-578095458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:08:47 devstack sudo[109500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 16:08:47 devstack sudo[109500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:08:48 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-87556693-5b33-4b6a-9103-c6817ea1003d tempest-TestServerVolumeAttachmentScenario-578095458 None] Acquiring lock "cinder-fdef80e5-cc3d-418e-b469-0c092e043c92-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:08:48 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-87556693-5b33-4b6a-9103-c6817ea1003d tempest-TestServerVolumeAttachmentScenario-578095458 None] Lock "cinder-fdef80e5-cc3d-418e-b469-0c092e043c92-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:08:48 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-87556693-5b33-4b6a-9103-c6817ea1003d tempest-TestServerVolumeAttachmentScenario-578095458 None] Acquiring lock "cinder-quobyte-fdef80e5-cc3d-418e-b469-0c092e043c92" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:08:48 devstack sudo[109500]: pam_unix(sudo:session): session closed for user root
Jun 15 16:08:48 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-4a03bde3-934d-42ba-9b7c-68a36d709248 tempest-TestServerVolumeAttachmentScenario-578095458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.636s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:08:48 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-4a03bde3-934d-42ba-9b7c-68a36d709248 tempest-TestServerVolumeAttachmentScenario-578095458 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 16:08:48 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-4a03bde3-934d-42ba-9b7c-68a36d709248 tempest-TestServerVolumeAttachmentScenario-578095458 None] Deleted volume successfully.
Jun 15 16:08:48 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-87556693-5b33-4b6a-9103-c6817ea1003d tempest-TestServerVolumeAttachmentScenario-578095458 None] Lock "cinder-quobyte-fdef80e5-cc3d-418e-b469-0c092e043c92" acquired by "delete_volume" :: waited 0.038s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:08:48 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-4a03bde3-934d-42ba-9b7c-68a36d709248 tempest-TestServerVolumeAttachmentScenario-578095458 None] Lock "cinder-f9d82fda-f7f8-4e7b-9e38-b6c73577754a-delete_volume" released by "delete_volume" :: held 2.392s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:08:48 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc7c4a86-96a1-4608-abea-ba1d9f9aebda]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:08:48 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-87556693-5b33-4b6a-9103-c6817ea1003d tempest-TestServerVolumeAttachmentScenario-578095458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fdef80e5-cc3d-418e-b469-0c092e043c92 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:08:48 devstack sudo[109504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fdef80e5-cc3d-418e-b469-0c092e043c92
Jun 15 16:08:48 devstack sudo[109504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:08:49 devstack sudo[109504]: pam_unix(sudo:session): session closed for user root
Jun 15 16:08:49 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-87556693-5b33-4b6a-9103-c6817ea1003d tempest-TestServerVolumeAttachmentScenario-578095458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fdef80e5-cc3d-418e-b469-0c092e043c92" returned: 0 in 0.729s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:08:49 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-87556693-5b33-4b6a-9103-c6817ea1003d tempest-TestServerVolumeAttachmentScenario-578095458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fdef80e5-cc3d-418e-b469-0c092e043c92 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:08:49 devstack sudo[109510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fdef80e5-cc3d-418e-b469-0c092e043c92
Jun 15 16:08:49 devstack sudo[109510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:08:49 devstack sudo[109510]: pam_unix(sudo:session): session closed for user root
Jun 15 16:08:49 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-87556693-5b33-4b6a-9103-c6817ea1003d tempest-TestServerVolumeAttachmentScenario-578095458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fdef80e5-cc3d-418e-b469-0c092e043c92" returned: 0 in 0.572s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:08:49 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-87556693-5b33-4b6a-9103-c6817ea1003d tempest-TestServerVolumeAttachmentScenario-578095458 None] Lock "cinder-quobyte-fdef80e5-cc3d-418e-b469-0c092e043c92" released by "delete_volume" :: held 1.348s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:08:49 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-87556693-5b33-4b6a-9103-c6817ea1003d tempest-TestServerVolumeAttachmentScenario-578095458 None] Created reservations ['23db2a4a-5a5a-4883-8161-0c7ab12ff242', '7caeafa8-1883-418d-a21e-2e8129578848', '7132cda6-92b7-4576-b88c-6a28af6483da', 'd8f2142b-f39f-4048-9593-8e0af2faa9ef'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 16:08:49 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-87556693-5b33-4b6a-9103-c6817ea1003d tempest-TestServerVolumeAttachmentScenario-578095458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:08:49 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-87556693-5b33-4b6a-9103-c6817ea1003d tempest-TestServerVolumeAttachmentScenario-578095458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:08:49 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-87556693-5b33-4b6a-9103-c6817ea1003d tempest-TestServerVolumeAttachmentScenario-578095458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:08:49 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-87556693-5b33-4b6a-9103-c6817ea1003d tempest-TestServerVolumeAttachmentScenario-578095458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:08:49 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-87556693-5b33-4b6a-9103-c6817ea1003d tempest-TestServerVolumeAttachmentScenario-578095458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:08:49 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-87556693-5b33-4b6a-9103-c6817ea1003d tempest-TestServerVolumeAttachmentScenario-578095458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:08:49 devstack sudo[109513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 16:08:49 devstack sudo[109513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:08:50 devstack sudo[109513]: pam_unix(sudo:session): session closed for user root
Jun 15 16:08:50 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-87556693-5b33-4b6a-9103-c6817ea1003d tempest-TestServerVolumeAttachmentScenario-578095458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.634s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:08:50 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-87556693-5b33-4b6a-9103-c6817ea1003d tempest-TestServerVolumeAttachmentScenario-578095458 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 16:08:50 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-87556693-5b33-4b6a-9103-c6817ea1003d tempest-TestServerVolumeAttachmentScenario-578095458 None] Deleted volume successfully.
Jun 15 16:08:50 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-87556693-5b33-4b6a-9103-c6817ea1003d tempest-TestServerVolumeAttachmentScenario-578095458 None] Lock "cinder-fdef80e5-cc3d-418e-b469-0c092e043c92-delete_volume" released by "delete_volume" :: held 2.262s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:08:54 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d8f35a4-a15c-4f12-bc16-2d5fb8e12b01 tempest-VolumeDependencyTests-1916085394 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 16:08:54 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8d8f35a4-a15c-4f12-bc16-2d5fb8e12b01 tempest-VolumeDependencyTests-1916085394 None] Flow 'volume_create_manager' (951f97e2-75db-4117-a1ca-67ab698148d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:08:54 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8d8f35a4-a15c-4f12-bc16-2d5fb8e12b01 tempest-VolumeDependencyTests-1916085394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f27eebcd-d9ac-477b-a5c8-ec9f5957c6f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:08:54 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8d8f35a4-a15c-4f12-bc16-2d5fb8e12b01 tempest-VolumeDependencyTests-1916085394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f27eebcd-d9ac-477b-a5c8-ec9f5957c6f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:08:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-378998481',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6f7959f-5a22-4827-93a7-7ec80e2cad7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='845d43ed77504f0d97024507285d3f33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:08:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:08:55Z,use_quota=True,user_id='a41cd250d4d54777bfad898c1d079fb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:08:54 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8d8f35a4-a15c-4f12-bc16-2d5fb8e12b01 tempest-VolumeDependencyTests-1916085394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9e47f9b-a993-4b7f-8bd5-59943bca22a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:08:54 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8d8f35a4-a15c-4f12-bc16-2d5fb8e12b01 tempest-VolumeDependencyTests-1916085394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9e47f9b-a993-4b7f-8bd5-59943bca22a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:08:54 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8d8f35a4-a15c-4f12-bc16-2d5fb8e12b01 tempest-VolumeDependencyTests-1916085394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d6e5b5a-91f9-4cb9-a466-9c5b71114861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:08:54 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8d8f35a4-a15c-4f12-bc16-2d5fb8e12b01 tempest-VolumeDependencyTests-1916085394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d6e5b5a-91f9-4cb9-a466-9c5b71114861) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6f7959f-5a22-4827-93a7-7ec80e2cad7b', 'volume_name': 'volume-a6f7959f-5a22-4827-93a7-7ec80e2cad7b', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:08:54 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8d8f35a4-a15c-4f12-bc16-2d5fb8e12b01 tempest-VolumeDependencyTests-1916085394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21a83260-c582-406f-ad08-bd01008e9af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:08:54 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8d8f35a4-a15c-4f12-bc16-2d5fb8e12b01 tempest-VolumeDependencyTests-1916085394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21a83260-c582-406f-ad08-bd01008e9af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:08:54 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8d8f35a4-a15c-4f12-bc16-2d5fb8e12b01 tempest-VolumeDependencyTests-1916085394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc7c322f-a676-4301-a579-ec3539788c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:08:54 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-8d8f35a4-a15c-4f12-bc16-2d5fb8e12b01 tempest-VolumeDependencyTests-1916085394 None] Volume a6f7959f-5a22-4827-93a7-7ec80e2cad7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6f7959f-5a22-4827-93a7-7ec80e2cad7b', 'volume_size': 1}
Jun 15 16:08:54 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-8d8f35a4-a15c-4f12-bc16-2d5fb8e12b01 tempest-VolumeDependencyTests-1916085394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:08:54 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-8d8f35a4-a15c-4f12-bc16-2d5fb8e12b01 tempest-VolumeDependencyTests-1916085394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:08:54 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-8d8f35a4-a15c-4f12-bc16-2d5fb8e12b01 tempest-VolumeDependencyTests-1916085394 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:08:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-378998481',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6f7959f-5a22-4827-93a7-7ec80e2cad7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='845d43ed77504f0d97024507285d3f33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:08:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:08:55Z,use_quota=True,user_id='a41cd250d4d54777bfad898c1d079fb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 16:08:54 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-8d8f35a4-a15c-4f12-bc16-2d5fb8e12b01 tempest-VolumeDependencyTests-1916085394 None] Creating volume a6f7959f-5a22-4827-93a7-7ec80e2cad7b {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 16:08:54 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-8d8f35a4-a15c-4f12-bc16-2d5fb8e12b01 tempest-VolumeDependencyTests-1916085394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:08:54 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-8d8f35a4-a15c-4f12-bc16-2d5fb8e12b01 tempest-VolumeDependencyTests-1916085394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:08:54 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-8d8f35a4-a15c-4f12-bc16-2d5fb8e12b01 tempest-VolumeDependencyTests-1916085394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:08:54 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-8d8f35a4-a15c-4f12-bc16-2d5fb8e12b01 tempest-VolumeDependencyTests-1916085394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:08:54 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-8d8f35a4-a15c-4f12-bc16-2d5fb8e12b01 tempest-VolumeDependencyTests-1916085394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:08:54 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-8d8f35a4-a15c-4f12-bc16-2d5fb8e12b01 tempest-VolumeDependencyTests-1916085394 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 16:08:54 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-8d8f35a4-a15c-4f12-bc16-2d5fb8e12b01 tempest-VolumeDependencyTests-1916085394 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 16:08:54 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-8d8f35a4-a15c-4f12-bc16-2d5fb8e12b01 tempest-VolumeDependencyTests-1916085394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a6f7959f-5a22-4827-93a7-7ec80e2cad7b 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:08:54 devstack sudo[109521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a6f7959f-5a22-4827-93a7-7ec80e2cad7b 1073741824
Jun 15 16:08:54 devstack sudo[109521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:08:55 devstack sudo[109521]: pam_unix(sudo:session): session closed for user root
Jun 15 16:08:55 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-8d8f35a4-a15c-4f12-bc16-2d5fb8e12b01 tempest-VolumeDependencyTests-1916085394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a6f7959f-5a22-4827-93a7-7ec80e2cad7b 1073741824" returned: 0 in 0.808s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:08:55 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-8d8f35a4-a15c-4f12-bc16-2d5fb8e12b01 tempest-VolumeDependencyTests-1916085394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a6f7959f-5a22-4827-93a7-7ec80e2cad7b {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:08:55 devstack sudo[109529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a6f7959f-5a22-4827-93a7-7ec80e2cad7b
Jun 15 16:08:55 devstack sudo[109529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:08:56 devstack sudo[109529]: pam_unix(sudo:session): session closed for user root
Jun 15 16:08:56 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-8d8f35a4-a15c-4f12-bc16-2d5fb8e12b01 tempest-VolumeDependencyTests-1916085394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a6f7959f-5a22-4827-93a7-7ec80e2cad7b" returned: 0 in 0.633s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:08:56 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-8d8f35a4-a15c-4f12-bc16-2d5fb8e12b01 tempest-VolumeDependencyTests-1916085394 None] <== create_volume: return (1483ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 16:08:56 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-8d8f35a4-a15c-4f12-bc16-2d5fb8e12b01 tempest-VolumeDependencyTests-1916085394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.485s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:08:56 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8d8f35a4-a15c-4f12-bc16-2d5fb8e12b01 tempest-VolumeDependencyTests-1916085394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc7c322f-a676-4301-a579-ec3539788c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6f7959f-5a22-4827-93a7-7ec80e2cad7b', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:08:56 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8d8f35a4-a15c-4f12-bc16-2d5fb8e12b01 tempest-VolumeDependencyTests-1916085394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a129b34c-6ba0-4d8f-90f7-bcdfea984a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:08:56 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-8d8f35a4-a15c-4f12-bc16-2d5fb8e12b01 tempest-VolumeDependencyTests-1916085394 None] Volume volume-a6f7959f-5a22-4827-93a7-7ec80e2cad7b (a6f7959f-5a22-4827-93a7-7ec80e2cad7b): created successfully
Jun 15 16:08:56 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8d8f35a4-a15c-4f12-bc16-2d5fb8e12b01 tempest-VolumeDependencyTests-1916085394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a129b34c-6ba0-4d8f-90f7-bcdfea984a68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:08:56 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8d8f35a4-a15c-4f12-bc16-2d5fb8e12b01 tempest-VolumeDependencyTests-1916085394 None] Flow 'volume_create_manager' (951f97e2-75db-4117-a1ca-67ab698148d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:08:56 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-8d8f35a4-a15c-4f12-bc16-2d5fb8e12b01 tempest-VolumeDependencyTests-1916085394 None] Created volume successfully.
Jun 15 16:08:57 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-5cc464f2-a64d-4bfa-8874-babb2857fc41 tempest-VolumeDependencyTests-1916085394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:08:57 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-5cc464f2-a64d-4bfa-8874-babb2857fc41 tempest-VolumeDependencyTests-1916085394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:08:57 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-5cc464f2-a64d-4bfa-8874-babb2857fc41 tempest-VolumeDependencyTests-1916085394 None] Creating offline snapshot e1fab8ac-f029-4d26-b936-3dc45bcaeee6 of volume a6f7959f-5a22-4827-93a7-7ec80e2cad7b {{(pid=91863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 15 16:08:57 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8889e726-3fe8-4eeb-8146-15b58a12735b]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:08:57 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5cc464f2-a64d-4bfa-8874-babb2857fc41 tempest-VolumeDependencyTests-1916085394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a6f7959f-5a22-4827-93a7-7ec80e2cad7b {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:08:57 devstack sudo[109533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a6f7959f-5a22-4827-93a7-7ec80e2cad7b
Jun 15 16:08:57 devstack sudo[109533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:08:57 devstack sudo[109533]: pam_unix(sudo:session): session closed for user root
Jun 15 16:08:57 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5cc464f2-a64d-4bfa-8874-babb2857fc41 tempest-VolumeDependencyTests-1916085394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a6f7959f-5a22-4827-93a7-7ec80e2cad7b" returned: 0 in 0.823s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:08:57 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5cc464f2-a64d-4bfa-8874-babb2857fc41 tempest-VolumeDependencyTests-1916085394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a6f7959f-5a22-4827-93a7-7ec80e2cad7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a6f7959f-5a22-4827-93a7-7ec80e2cad7b.e1fab8ac-f029-4d26-b936-3dc45bcaeee6 1G {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:08:57 devstack sudo[109539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a6f7959f-5a22-4827-93a7-7ec80e2cad7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a6f7959f-5a22-4827-93a7-7ec80e2cad7b.e1fab8ac-f029-4d26-b936-3dc45bcaeee6 1G
Jun 15 16:08:57 devstack sudo[109539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:08:58 devstack sudo[109539]: pam_unix(sudo:session): session closed for user root
Jun 15 16:08:58 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5cc464f2-a64d-4bfa-8874-babb2857fc41 tempest-VolumeDependencyTests-1916085394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a6f7959f-5a22-4827-93a7-7ec80e2cad7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a6f7959f-5a22-4827-93a7-7ec80e2cad7b.e1fab8ac-f029-4d26-b936-3dc45bcaeee6 1G" returned: 0 in 0.811s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:08:58 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5cc464f2-a64d-4bfa-8874-babb2857fc41 tempest-VolumeDependencyTests-1916085394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6f7959f-5a22-4827-93a7-7ec80e2cad7b -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a6f7959f-5a22-4827-93a7-7ec80e2cad7b.e1fab8ac-f029-4d26-b936-3dc45bcaeee6 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:08:58 devstack sudo[109546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6f7959f-5a22-4827-93a7-7ec80e2cad7b -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a6f7959f-5a22-4827-93a7-7ec80e2cad7b.e1fab8ac-f029-4d26-b936-3dc45bcaeee6
Jun 15 16:08:58 devstack sudo[109546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:08:59 devstack sudo[109546]: pam_unix(sudo:session): session closed for user root
Jun 15 16:08:59 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5cc464f2-a64d-4bfa-8874-babb2857fc41 tempest-VolumeDependencyTests-1916085394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6f7959f-5a22-4827-93a7-7ec80e2cad7b -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a6f7959f-5a22-4827-93a7-7ec80e2cad7b.e1fab8ac-f029-4d26-b936-3dc45bcaeee6" returned: 0 in 0.655s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:08:59 devstack cinder-volume[91863]: WARNING cinder.volume.drivers.remotefs [None req-5cc464f2-a64d-4bfa-8874-babb2857fc41 tempest-VolumeDependencyTests-1916085394 None] /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a6f7959f-5a22-4827-93a7-7ec80e2cad7b.e1fab8ac-f029-4d26-b936-3dc45bcaeee6 is being set with open permissions: ugo+rw
Jun 15 16:08:59 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5cc464f2-a64d-4bfa-8874-babb2857fc41 tempest-VolumeDependencyTests-1916085394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a6f7959f-5a22-4827-93a7-7ec80e2cad7b.e1fab8ac-f029-4d26-b936-3dc45bcaeee6 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:08:59 devstack sudo[109552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a6f7959f-5a22-4827-93a7-7ec80e2cad7b.e1fab8ac-f029-4d26-b936-3dc45bcaeee6
Jun 15 16:08:59 devstack sudo[109552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:08:59 devstack sudo[109552]: pam_unix(sudo:session): session closed for user root
Jun 15 16:08:59 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5cc464f2-a64d-4bfa-8874-babb2857fc41 tempest-VolumeDependencyTests-1916085394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a6f7959f-5a22-4827-93a7-7ec80e2cad7b.e1fab8ac-f029-4d26-b936-3dc45bcaeee6" returned: 0 in 0.590s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:08:59 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5cc464f2-a64d-4bfa-8874-babb2857fc41 tempest-VolumeDependencyTests-1916085394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a6f7959f-5a22-4827-93a7-7ec80e2cad7b.info {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:09:00 devstack sudo[109555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a6f7959f-5a22-4827-93a7-7ec80e2cad7b.info
Jun 15 16:09:00 devstack sudo[109555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:09:00 devstack sudo[109555]: pam_unix(sudo:session): session closed for user root
Jun 15 16:09:00 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5cc464f2-a64d-4bfa-8874-babb2857fc41 tempest-VolumeDependencyTests-1916085394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a6f7959f-5a22-4827-93a7-7ec80e2cad7b.info" returned: 0 in 0.649s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:09:00 devstack cinder-volume[91863]: WARNING cinder.volume.drivers.remotefs [None req-5cc464f2-a64d-4bfa-8874-babb2857fc41 tempest-VolumeDependencyTests-1916085394 None] /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a6f7959f-5a22-4827-93a7-7ec80e2cad7b.info is being set with open permissions: ugo+rw
Jun 15 16:09:00 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5cc464f2-a64d-4bfa-8874-babb2857fc41 tempest-VolumeDependencyTests-1916085394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a6f7959f-5a22-4827-93a7-7ec80e2cad7b.info {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:09:00 devstack sudo[109558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a6f7959f-5a22-4827-93a7-7ec80e2cad7b.info
Jun 15 16:09:00 devstack sudo[109558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:09:01 devstack sudo[109558]: pam_unix(sudo:session): session closed for user root
Jun 15 16:09:01 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5cc464f2-a64d-4bfa-8874-babb2857fc41 tempest-VolumeDependencyTests-1916085394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a6f7959f-5a22-4827-93a7-7ec80e2cad7b.info" returned: 0 in 0.694s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:09:01 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-5cc464f2-a64d-4bfa-8874-babb2857fc41 tempest-VolumeDependencyTests-1916085394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.316s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:09:01 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-5cc464f2-a64d-4bfa-8874-babb2857fc41 tempest-VolumeDependencyTests-1916085394 None] Create snapshot completed successfully
Jun 15 16:09:02 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d4c4a63-0cc3-4403-b40f-b810aa62b467 tempest-VolumeDependencyTests-1916085394 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 16:09:02 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6d4c4a63-0cc3-4403-b40f-b810aa62b467 tempest-VolumeDependencyTests-1916085394 None] Flow 'volume_create_manager' (f744c804-ebd5-4e1e-8241-73138076e97d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:09:02 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6d4c4a63-0cc3-4403-b40f-b810aa62b467 tempest-VolumeDependencyTests-1916085394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9a25c05-bc31-4ebc-b5d2-66f99ad3df6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:09:02 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6d4c4a63-0cc3-4403-b40f-b810aa62b467 tempest-VolumeDependencyTests-1916085394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9a25c05-bc31-4ebc-b5d2-66f99ad3df6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:09:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1312442676',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=038e903d-7b2b-4d3d-9077-ce1ddfe71cb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='845d43ed77504f0d97024507285d3f33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:09:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e1fab8ac-f029-4d26-b936-3dc45bcaeee6,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:09:03Z,use_quota=True,user_id='a41cd250d4d54777bfad898c1d079fb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:09:02 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6d4c4a63-0cc3-4403-b40f-b810aa62b467 tempest-VolumeDependencyTests-1916085394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98af7aa7-b680-4a81-bf7b-accdafac48ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:09:02 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6d4c4a63-0cc3-4403-b40f-b810aa62b467 tempest-VolumeDependencyTests-1916085394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98af7aa7-b680-4a81-bf7b-accdafac48ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:09:02 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6d4c4a63-0cc3-4403-b40f-b810aa62b467 tempest-VolumeDependencyTests-1916085394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5f2caaa-af54-4801-b9b2-8ebbbc5f663b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:09:02 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6d4c4a63-0cc3-4403-b40f-b810aa62b467 tempest-VolumeDependencyTests-1916085394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5f2caaa-af54-4801-b9b2-8ebbbc5f663b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '038e903d-7b2b-4d3d-9077-ce1ddfe71cb9', 'volume_name': 'volume-038e903d-7b2b-4d3d-9077-ce1ddfe71cb9', 'volume_size': 1, 'snapshot_id': 'e1fab8ac-f029-4d26-b936-3dc45bcaeee6'}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:09:02 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6d4c4a63-0cc3-4403-b40f-b810aa62b467 tempest-VolumeDependencyTests-1916085394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50da0e28-5cd0-4434-b6af-8b50677b6e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:09:02 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6d4c4a63-0cc3-4403-b40f-b810aa62b467 tempest-VolumeDependencyTests-1916085394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50da0e28-5cd0-4434-b6af-8b50677b6e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:09:02 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6d4c4a63-0cc3-4403-b40f-b810aa62b467 tempest-VolumeDependencyTests-1916085394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (694632db-dd92-41e8-85d8-2e71ad8c9082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:09:02 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-6d4c4a63-0cc3-4403-b40f-b810aa62b467 tempest-VolumeDependencyTests-1916085394 None] Volume 038e903d-7b2b-4d3d-9077-ce1ddfe71cb9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-038e903d-7b2b-4d3d-9077-ce1ddfe71cb9', 'volume_size': 1, 'snapshot_id': 'e1fab8ac-f029-4d26-b936-3dc45bcaeee6'}
Jun 15 16:09:02 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6d4c4a63-0cc3-4403-b40f-b810aa62b467 tempest-VolumeDependencyTests-1916085394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:09:02 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6d4c4a63-0cc3-4403-b40f-b810aa62b467 tempest-VolumeDependencyTests-1916085394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:09:02 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-6d4c4a63-0cc3-4403-b40f-b810aa62b467 tempest-VolumeDependencyTests-1916085394 None] Acquiring lock "cinder-quobyte-e1fab8ac-f029-4d26-b936-3dc45bcaeee6-038e903d-7b2b-4d3d-9077-ce1ddfe71cb9" by "_create_volume_from_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:09:02 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-6d4c4a63-0cc3-4403-b40f-b810aa62b467 tempest-VolumeDependencyTests-1916085394 None] Lock "cinder-quobyte-e1fab8ac-f029-4d26-b936-3dc45bcaeee6-038e903d-7b2b-4d3d-9077-ce1ddfe71cb9" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:09:02 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6d4c4a63-0cc3-4403-b40f-b810aa62b467 tempest-VolumeDependencyTests-1916085394 None] Creating volume 038e903d-7b2b-4d3d-9077-ce1ddfe71cb9 from snapshot e1fab8ac-f029-4d26-b936-3dc45bcaeee6 {{(pid=91863) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 15 16:09:02 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6d4c4a63-0cc3-4403-b40f-b810aa62b467 tempest-VolumeDependencyTests-1916085394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:09:02 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6d4c4a63-0cc3-4403-b40f-b810aa62b467 tempest-VolumeDependencyTests-1916085394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:09:02 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6d4c4a63-0cc3-4403-b40f-b810aa62b467 tempest-VolumeDependencyTests-1916085394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:09:02 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6d4c4a63-0cc3-4403-b40f-b810aa62b467 tempest-VolumeDependencyTests-1916085394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:09:02 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6d4c4a63-0cc3-4403-b40f-b810aa62b467 tempest-VolumeDependencyTests-1916085394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:09:02 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6d4c4a63-0cc3-4403-b40f-b810aa62b467 tempest-VolumeDependencyTests-1916085394 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 16:09:02 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-6d4c4a63-0cc3-4403-b40f-b810aa62b467 tempest-VolumeDependencyTests-1916085394 None] Acquiring lock "cinder-quobyte-038e903d-7b2b-4d3d-9077-ce1ddfe71cb9" by "_copy_volume_from_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:09:02 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-6d4c4a63-0cc3-4403-b40f-b810aa62b467 tempest-VolumeDependencyTests-1916085394 None] Lock "cinder-quobyte-038e903d-7b2b-4d3d-9077-ce1ddfe71cb9" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:09:02 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6d4c4a63-0cc3-4403-b40f-b810aa62b467 tempest-VolumeDependencyTests-1916085394 None] snapshot: e1fab8ac-f029-4d26-b936-3dc45bcaeee6, volume: 038e903d-7b2b-4d3d-9077-ce1ddfe71cb9,  {{(pid=91863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 15 16:09:02 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6d4c4a63-0cc3-4403-b40f-b810aa62b467 tempest-VolumeDependencyTests-1916085394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:09:02 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6d4c4a63-0cc3-4403-b40f-b810aa62b467 tempest-VolumeDependencyTests-1916085394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:09:02 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6d4c4a63-0cc3-4403-b40f-b810aa62b467 tempest-VolumeDependencyTests-1916085394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:09:02 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6d4c4a63-0cc3-4403-b40f-b810aa62b467 tempest-VolumeDependencyTests-1916085394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:09:02 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6d4c4a63-0cc3-4403-b40f-b810aa62b467 tempest-VolumeDependencyTests-1916085394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:09:02 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[18367f03-d9bf-4684-8e8a-800d58533e3f]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:09:02 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6d4c4a63-0cc3-4403-b40f-b810aa62b467 tempest-VolumeDependencyTests-1916085394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a6f7959f-5a22-4827-93a7-7ec80e2cad7b.e1fab8ac-f029-4d26-b936-3dc45bcaeee6 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:09:03 devstack sudo[109561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a6f7959f-5a22-4827-93a7-7ec80e2cad7b.e1fab8ac-f029-4d26-b936-3dc45bcaeee6
Jun 15 16:09:03 devstack sudo[109561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:09:03 devstack sudo[109561]: pam_unix(sudo:session): session closed for user root
Jun 15 16:09:03 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6d4c4a63-0cc3-4403-b40f-b810aa62b467 tempest-VolumeDependencyTests-1916085394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a6f7959f-5a22-4827-93a7-7ec80e2cad7b.e1fab8ac-f029-4d26-b936-3dc45bcaeee6" returned: 0 in 0.741s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:09:03 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-6d4c4a63-0cc3-4403-b40f-b810aa62b467 tempest-VolumeDependencyTests-1916085394 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a6f7959f-5a22-4827-93a7-7ec80e2cad7b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 16:09:03 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6d4c4a63-0cc3-4403-b40f-b810aa62b467 tempest-VolumeDependencyTests-1916085394 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a6f7959f-5a22-4827-93a7-7ec80e2cad7b {{(pid=91863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 15 16:09:03 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6d4c4a63-0cc3-4403-b40f-b810aa62b467 tempest-VolumeDependencyTests-1916085394 None] Creating direct copy from snapshot {{(pid=91863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 15 16:09:03 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a20474e-d9f9-428c-8b51-54fff8759bc5]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:09:03 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6d4c4a63-0cc3-4403-b40f-b810aa62b467 tempest-VolumeDependencyTests-1916085394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a6f7959f-5a22-4827-93a7-7ec80e2cad7b {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:09:03 devstack sudo[109566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a6f7959f-5a22-4827-93a7-7ec80e2cad7b
Jun 15 16:09:03 devstack sudo[109566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:09:04 devstack sudo[109566]: pam_unix(sudo:session): session closed for user root
Jun 15 16:09:04 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6d4c4a63-0cc3-4403-b40f-b810aa62b467 tempest-VolumeDependencyTests-1916085394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a6f7959f-5a22-4827-93a7-7ec80e2cad7b" returned: 0 in 0.777s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:09:04 devstack cinder-volume[91863]: DEBUG cinder.utils [None req-6d4c4a63-0cc3-4403-b40f-b810aa62b467 tempest-VolumeDependencyTests-1916085394 None] Path /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-038e903d-7b2b-4d3d-9077-ce1ddfe71cb9 not found in is_blk_device check {{(pid=91863) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 15 16:09:04 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6d4c4a63-0cc3-4403-b40f-b810aa62b467 tempest-VolumeDependencyTests-1916085394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a6f7959f-5a22-4827-93a7-7ec80e2cad7b /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-038e903d-7b2b-4d3d-9077-ce1ddfe71cb9 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:09:04 devstack sudo[109571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a6f7959f-5a22-4827-93a7-7ec80e2cad7b /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-038e903d-7b2b-4d3d-9077-ce1ddfe71cb9
Jun 15 16:09:04 devstack sudo[109571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:09:09 devstack sudo[109571]: pam_unix(sudo:session): session closed for user root
Jun 15 16:09:09 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6d4c4a63-0cc3-4403-b40f-b810aa62b467 tempest-VolumeDependencyTests-1916085394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a6f7959f-5a22-4827-93a7-7ec80e2cad7b /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-038e903d-7b2b-4d3d-9077-ce1ddfe71cb9" returned: 0 in 5.209s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:09:09 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[260ecc8f-bb9b-416e-9b6b-bf2954d48d7b]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:09:09 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6d4c4a63-0cc3-4403-b40f-b810aa62b467 tempest-VolumeDependencyTests-1916085394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a6f7959f-5a22-4827-93a7-7ec80e2cad7b {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:09:09 devstack sudo[109585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a6f7959f-5a22-4827-93a7-7ec80e2cad7b
Jun 15 16:09:09 devstack sudo[109585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:09:10 devstack sudo[109585]: pam_unix(sudo:session): session closed for user root
Jun 15 16:09:10 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6d4c4a63-0cc3-4403-b40f-b810aa62b467 tempest-VolumeDependencyTests-1916085394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a6f7959f-5a22-4827-93a7-7ec80e2cad7b" returned: 0 in 0.976s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:09:10 devstack cinder-volume[91863]: DEBUG cinder.image.image_utils [None req-6d4c4a63-0cc3-4403-b40f-b810aa62b467 tempest-VolumeDependencyTests-1916085394 None] Image conversion details: src /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a6f7959f-5a22-4827-93a7-7ec80e2cad7b, size 1024.00 MB, duration 5.21 sec, destination /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-038e903d-7b2b-4d3d-9077-ce1ddfe71cb9 {{(pid=91863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 15 16:09:10 devstack cinder-volume[91863]: INFO cinder.image.image_utils [None req-6d4c4a63-0cc3-4403-b40f-b810aa62b467 tempest-VolumeDependencyTests-1916085394 None] Converted 1024.00 MB image at 196.56 MB/s
Jun 15 16:09:10 devstack cinder-volume[91863]: WARNING cinder.volume.drivers.remotefs [None req-6d4c4a63-0cc3-4403-b40f-b810aa62b467 tempest-VolumeDependencyTests-1916085394 None] /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-038e903d-7b2b-4d3d-9077-ce1ddfe71cb9 is being set with open permissions: ugo+rw
Jun 15 16:09:10 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6d4c4a63-0cc3-4403-b40f-b810aa62b467 tempest-VolumeDependencyTests-1916085394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-038e903d-7b2b-4d3d-9077-ce1ddfe71cb9 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:09:10 devstack sudo[109590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-038e903d-7b2b-4d3d-9077-ce1ddfe71cb9
Jun 15 16:09:10 devstack sudo[109590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:09:11 devstack sudo[109590]: pam_unix(sudo:session): session closed for user root
Jun 15 16:09:11 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6d4c4a63-0cc3-4403-b40f-b810aa62b467 tempest-VolumeDependencyTests-1916085394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-038e903d-7b2b-4d3d-9077-ce1ddfe71cb9" returned: 0 in 0.605s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:09:11 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-6d4c4a63-0cc3-4403-b40f-b810aa62b467 tempest-VolumeDependencyTests-1916085394 None] Lock "cinder-quobyte-038e903d-7b2b-4d3d-9077-ce1ddfe71cb9" released by "_copy_volume_from_snapshot" :: held 8.428s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:09:11 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-6d4c4a63-0cc3-4403-b40f-b810aa62b467 tempest-VolumeDependencyTests-1916085394 None] Lock "cinder-quobyte-e1fab8ac-f029-4d26-b936-3dc45bcaeee6-038e903d-7b2b-4d3d-9077-ce1ddfe71cb9" released by "_create_volume_from_snapshot" :: held 8.465s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:09:11 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6d4c4a63-0cc3-4403-b40f-b810aa62b467 tempest-VolumeDependencyTests-1916085394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.486s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:09:11 devstack cinder-volume[91863]: DEBUG dbcounter [-] [91863] Writing DB stats cinder:SELECT=39,cinder:UPDATE=37,cinder:INSERT=7,cinder:DELETE=2 {{(pid=91863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 16:09:11 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6d4c4a63-0cc3-4403-b40f-b810aa62b467 tempest-VolumeDependencyTests-1916085394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (694632db-dd92-41e8-85d8-2e71ad8c9082) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-038e903d-7b2b-4d3d-9077-ce1ddfe71cb9', 'volume_size': 1, 'snapshot_id': 'e1fab8ac-f029-4d26-b936-3dc45bcaeee6'}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:09:11 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6d4c4a63-0cc3-4403-b40f-b810aa62b467 tempest-VolumeDependencyTests-1916085394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82528831-23f6-4ef3-b1f7-93d28c630611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:09:11 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-6d4c4a63-0cc3-4403-b40f-b810aa62b467 tempest-VolumeDependencyTests-1916085394 None] Volume volume-038e903d-7b2b-4d3d-9077-ce1ddfe71cb9 (038e903d-7b2b-4d3d-9077-ce1ddfe71cb9): created successfully
Jun 15 16:09:11 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6d4c4a63-0cc3-4403-b40f-b810aa62b467 tempest-VolumeDependencyTests-1916085394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82528831-23f6-4ef3-b1f7-93d28c630611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:09:11 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6d4c4a63-0cc3-4403-b40f-b810aa62b467 tempest-VolumeDependencyTests-1916085394 None] Flow 'volume_create_manager' (f744c804-ebd5-4e1e-8241-73138076e97d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:09:11 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-6d4c4a63-0cc3-4403-b40f-b810aa62b467 tempest-VolumeDependencyTests-1916085394 None] Created volume successfully.
Jun 15 16:09:11 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-97ec35ac-51a2-4fd7-84ae-1a4f2afa9dfe tempest-VolumeDependencyTests-1916085394 None] Acquiring lock "cinder-e1fab8ac-f029-4d26-b936-3dc45bcaeee6-delete_snapshot" by "delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:09:11 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-97ec35ac-51a2-4fd7-84ae-1a4f2afa9dfe tempest-VolumeDependencyTests-1916085394 None] Lock "cinder-e1fab8ac-f029-4d26-b936-3dc45bcaeee6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:09:11 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-97ec35ac-51a2-4fd7-84ae-1a4f2afa9dfe tempest-VolumeDependencyTests-1916085394 None] Acquiring lock "cinder-quobyte-a6f7959f-5a22-4827-93a7-7ec80e2cad7b" by "delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:09:11 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-97ec35ac-51a2-4fd7-84ae-1a4f2afa9dfe tempest-VolumeDependencyTests-1916085394 None] Lock "cinder-quobyte-a6f7959f-5a22-4827-93a7-7ec80e2cad7b" acquired by "delete_snapshot" :: waited 0.023s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:09:11 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-97ec35ac-51a2-4fd7-84ae-1a4f2afa9dfe tempest-VolumeDependencyTests-1916085394 None] Acquiring lock "cinder-quobyte-e1fab8ac-f029-4d26-b936-3dc45bcaeee6" by "_delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:09:11 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-97ec35ac-51a2-4fd7-84ae-1a4f2afa9dfe tempest-VolumeDependencyTests-1916085394 None] Lock "cinder-quobyte-e1fab8ac-f029-4d26-b936-3dc45bcaeee6" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:09:11 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-97ec35ac-51a2-4fd7-84ae-1a4f2afa9dfe tempest-VolumeDependencyTests-1916085394 None] Deleting offline snapshot e1fab8ac-f029-4d26-b936-3dc45bcaeee6 of volume a6f7959f-5a22-4827-93a7-7ec80e2cad7b {{(pid=91863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 15 16:09:11 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-97ec35ac-51a2-4fd7-84ae-1a4f2afa9dfe tempest-VolumeDependencyTests-1916085394 None] snapshot_file for this snap is: volume-a6f7959f-5a22-4827-93a7-7ec80e2cad7b.e1fab8ac-f029-4d26-b936-3dc45bcaeee6 {{(pid=91863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 15 16:09:11 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e3bc85-2161-4a88-992f-1f86af3d8338]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:09:11 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-97ec35ac-51a2-4fd7-84ae-1a4f2afa9dfe tempest-VolumeDependencyTests-1916085394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a6f7959f-5a22-4827-93a7-7ec80e2cad7b.e1fab8ac-f029-4d26-b936-3dc45bcaeee6 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:09:11 devstack sudo[109593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a6f7959f-5a22-4827-93a7-7ec80e2cad7b.e1fab8ac-f029-4d26-b936-3dc45bcaeee6
Jun 15 16:09:11 devstack sudo[109593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:09:12 devstack sudo[109593]: pam_unix(sudo:session): session closed for user root
Jun 15 16:09:12 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-97ec35ac-51a2-4fd7-84ae-1a4f2afa9dfe tempest-VolumeDependencyTests-1916085394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a6f7959f-5a22-4827-93a7-7ec80e2cad7b.e1fab8ac-f029-4d26-b936-3dc45bcaeee6" returned: 0 in 0.814s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:09:12 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-97ec35ac-51a2-4fd7-84ae-1a4f2afa9dfe tempest-VolumeDependencyTests-1916085394 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a6f7959f-5a22-4827-93a7-7ec80e2cad7b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 16:09:12 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[149dcdf4-c99e-484c-ad18-94a0bf9938ca]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:09:12 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-97ec35ac-51a2-4fd7-84ae-1a4f2afa9dfe tempest-VolumeDependencyTests-1916085394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a6f7959f-5a22-4827-93a7-7ec80e2cad7b {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:09:12 devstack sudo[109599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a6f7959f-5a22-4827-93a7-7ec80e2cad7b
Jun 15 16:09:12 devstack sudo[109599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:09:13 devstack sudo[109599]: pam_unix(sudo:session): session closed for user root
Jun 15 16:09:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-97ec35ac-51a2-4fd7-84ae-1a4f2afa9dfe tempest-VolumeDependencyTests-1916085394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a6f7959f-5a22-4827-93a7-7ec80e2cad7b" returned: 0 in 0.897s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:09:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-97ec35ac-51a2-4fd7-84ae-1a4f2afa9dfe tempest-VolumeDependencyTests-1916085394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a6f7959f-5a22-4827-93a7-7ec80e2cad7b.e1fab8ac-f029-4d26-b936-3dc45bcaeee6 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:09:13 devstack sudo[109606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a6f7959f-5a22-4827-93a7-7ec80e2cad7b.e1fab8ac-f029-4d26-b936-3dc45bcaeee6
Jun 15 16:09:13 devstack sudo[109606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:09:14 devstack sudo[109606]: pam_unix(sudo:session): session closed for user root
Jun 15 16:09:14 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-97ec35ac-51a2-4fd7-84ae-1a4f2afa9dfe tempest-VolumeDependencyTests-1916085394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a6f7959f-5a22-4827-93a7-7ec80e2cad7b.e1fab8ac-f029-4d26-b936-3dc45bcaeee6" returned: 0 in 0.743s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:09:14 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-97ec35ac-51a2-4fd7-84ae-1a4f2afa9dfe tempest-VolumeDependencyTests-1916085394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a6f7959f-5a22-4827-93a7-7ec80e2cad7b.e1fab8ac-f029-4d26-b936-3dc45bcaeee6 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:09:14 devstack sudo[109613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a6f7959f-5a22-4827-93a7-7ec80e2cad7b.e1fab8ac-f029-4d26-b936-3dc45bcaeee6
Jun 15 16:09:14 devstack sudo[109613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:09:14 devstack sudo[109613]: pam_unix(sudo:session): session closed for user root
Jun 15 16:09:14 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-97ec35ac-51a2-4fd7-84ae-1a4f2afa9dfe tempest-VolumeDependencyTests-1916085394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a6f7959f-5a22-4827-93a7-7ec80e2cad7b.e1fab8ac-f029-4d26-b936-3dc45bcaeee6" returned: 0 in 0.634s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:09:14 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-97ec35ac-51a2-4fd7-84ae-1a4f2afa9dfe tempest-VolumeDependencyTests-1916085394 None] Lock "cinder-quobyte-e1fab8ac-f029-4d26-b936-3dc45bcaeee6" released by "_delete_snapshot" :: held 3.219s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:09:14 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-97ec35ac-51a2-4fd7-84ae-1a4f2afa9dfe tempest-VolumeDependencyTests-1916085394 None] Lock "cinder-quobyte-a6f7959f-5a22-4827-93a7-7ec80e2cad7b" released by "delete_snapshot" :: held 3.243s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:09:14 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-97ec35ac-51a2-4fd7-84ae-1a4f2afa9dfe tempest-VolumeDependencyTests-1916085394 None] Created reservations ['2bc7b299-b88b-4de6-8ab4-ad05046d1f1e', '327d7a5c-e2b3-476f-b1c0-485b04635c22', '37b9a139-e72e-4c9f-b131-6bfd273eaf1e', 'de622744-aafe-445c-befb-32b4ee5595f5'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 16:09:15 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-97ec35ac-51a2-4fd7-84ae-1a4f2afa9dfe tempest-VolumeDependencyTests-1916085394 None] Delete snapshot completed successfully.
Jun 15 16:09:15 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-97ec35ac-51a2-4fd7-84ae-1a4f2afa9dfe tempest-VolumeDependencyTests-1916085394 None] Lock "cinder-e1fab8ac-f029-4d26-b936-3dc45bcaeee6-delete_snapshot" released by "delete_snapshot" :: held 3.391s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:09:15 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-d085a0fc-5798-4603-ab1f-b8bdf4e4ad04 tempest-VolumeDependencyTests-1916085394 None] Acquiring lock "cinder-a6f7959f-5a22-4827-93a7-7ec80e2cad7b-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:09:15 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-d085a0fc-5798-4603-ab1f-b8bdf4e4ad04 tempest-VolumeDependencyTests-1916085394 None] Lock "cinder-a6f7959f-5a22-4827-93a7-7ec80e2cad7b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:09:15 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-d085a0fc-5798-4603-ab1f-b8bdf4e4ad04 tempest-VolumeDependencyTests-1916085394 None] Acquiring lock "cinder-quobyte-a6f7959f-5a22-4827-93a7-7ec80e2cad7b" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:09:15 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-d085a0fc-5798-4603-ab1f-b8bdf4e4ad04 tempest-VolumeDependencyTests-1916085394 None] Lock "cinder-quobyte-a6f7959f-5a22-4827-93a7-7ec80e2cad7b" acquired by "delete_volume" :: waited 0.018s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:09:16 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba332513-9d63-4485-96cf-1b444952a7d3]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:09:16 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-d085a0fc-5798-4603-ab1f-b8bdf4e4ad04 tempest-VolumeDependencyTests-1916085394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a6f7959f-5a22-4827-93a7-7ec80e2cad7b {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:09:16 devstack sudo[109617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a6f7959f-5a22-4827-93a7-7ec80e2cad7b
Jun 15 16:09:16 devstack sudo[109617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:09:16 devstack sudo[109617]: pam_unix(sudo:session): session closed for user root
Jun 15 16:09:16 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-d085a0fc-5798-4603-ab1f-b8bdf4e4ad04 tempest-VolumeDependencyTests-1916085394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a6f7959f-5a22-4827-93a7-7ec80e2cad7b" returned: 0 in 0.724s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:09:16 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-d085a0fc-5798-4603-ab1f-b8bdf4e4ad04 tempest-VolumeDependencyTests-1916085394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a6f7959f-5a22-4827-93a7-7ec80e2cad7b {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:09:16 devstack sudo[109622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a6f7959f-5a22-4827-93a7-7ec80e2cad7b
Jun 15 16:09:16 devstack sudo[109622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:09:17 devstack sudo[109622]: pam_unix(sudo:session): session closed for user root
Jun 15 16:09:17 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-d085a0fc-5798-4603-ab1f-b8bdf4e4ad04 tempest-VolumeDependencyTests-1916085394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-a6f7959f-5a22-4827-93a7-7ec80e2cad7b" returned: 0 in 0.676s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:09:17 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-d085a0fc-5798-4603-ab1f-b8bdf4e4ad04 tempest-VolumeDependencyTests-1916085394 None] Lock "cinder-quobyte-a6f7959f-5a22-4827-93a7-7ec80e2cad7b" released by "delete_volume" :: held 1.474s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:09:17 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-d085a0fc-5798-4603-ab1f-b8bdf4e4ad04 tempest-VolumeDependencyTests-1916085394 None] Created reservations ['ad092626-0e19-4479-a3e8-273404c553c1', 'bd7a4076-069d-4b81-8484-ca27ceaf5c68', '60d25f49-4567-4fd0-989a-723aabbf732b', '15bb2f0a-c21f-466b-bb36-b65caf50e419'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 16:09:17 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-d085a0fc-5798-4603-ab1f-b8bdf4e4ad04 tempest-VolumeDependencyTests-1916085394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:09:17 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-d085a0fc-5798-4603-ab1f-b8bdf4e4ad04 tempest-VolumeDependencyTests-1916085394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:09:17 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-d085a0fc-5798-4603-ab1f-b8bdf4e4ad04 tempest-VolumeDependencyTests-1916085394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:09:17 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-d085a0fc-5798-4603-ab1f-b8bdf4e4ad04 tempest-VolumeDependencyTests-1916085394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:09:17 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-d085a0fc-5798-4603-ab1f-b8bdf4e4ad04 tempest-VolumeDependencyTests-1916085394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:09:17 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-d085a0fc-5798-4603-ab1f-b8bdf4e4ad04 tempest-VolumeDependencyTests-1916085394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:09:17 devstack sudo[109625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 16:09:17 devstack sudo[109625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:09:18 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-339cf8b7-7f76-4a8f-8476-b1586aa30901 tempest-VolumeDependencyTests-1916085394 None] Acquiring lock "cinder-038e903d-7b2b-4d3d-9077-ce1ddfe71cb9-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:09:18 devstack sudo[109625]: pam_unix(sudo:session): session closed for user root
Jun 15 16:09:18 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-d085a0fc-5798-4603-ab1f-b8bdf4e4ad04 tempest-VolumeDependencyTests-1916085394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.625s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:09:18 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-339cf8b7-7f76-4a8f-8476-b1586aa30901 tempest-VolumeDependencyTests-1916085394 None] Lock "cinder-038e903d-7b2b-4d3d-9077-ce1ddfe71cb9-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:09:18 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-d085a0fc-5798-4603-ab1f-b8bdf4e4ad04 tempest-VolumeDependencyTests-1916085394 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 16:09:18 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-d085a0fc-5798-4603-ab1f-b8bdf4e4ad04 tempest-VolumeDependencyTests-1916085394 None] Deleted volume successfully.
Jun 15 16:09:18 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-d085a0fc-5798-4603-ab1f-b8bdf4e4ad04 tempest-VolumeDependencyTests-1916085394 None] Lock "cinder-a6f7959f-5a22-4827-93a7-7ec80e2cad7b-delete_volume" released by "delete_volume" :: held 2.355s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:09:18 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-339cf8b7-7f76-4a8f-8476-b1586aa30901 tempest-VolumeDependencyTests-1916085394 None] Acquiring lock "cinder-quobyte-038e903d-7b2b-4d3d-9077-ce1ddfe71cb9" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:09:18 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-339cf8b7-7f76-4a8f-8476-b1586aa30901 tempest-VolumeDependencyTests-1916085394 None] Lock "cinder-quobyte-038e903d-7b2b-4d3d-9077-ce1ddfe71cb9" acquired by "delete_volume" :: waited 0.021s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:09:18 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4675ac38-12df-4e5c-8025-3eb6b2b72634]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:09:18 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-339cf8b7-7f76-4a8f-8476-b1586aa30901 tempest-VolumeDependencyTests-1916085394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-038e903d-7b2b-4d3d-9077-ce1ddfe71cb9 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:09:18 devstack sudo[109628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-038e903d-7b2b-4d3d-9077-ce1ddfe71cb9
Jun 15 16:09:18 devstack sudo[109628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:09:19 devstack sudo[109628]: pam_unix(sudo:session): session closed for user root
Jun 15 16:09:19 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-339cf8b7-7f76-4a8f-8476-b1586aa30901 tempest-VolumeDependencyTests-1916085394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-038e903d-7b2b-4d3d-9077-ce1ddfe71cb9" returned: 0 in 0.799s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:09:19 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-339cf8b7-7f76-4a8f-8476-b1586aa30901 tempest-VolumeDependencyTests-1916085394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-038e903d-7b2b-4d3d-9077-ce1ddfe71cb9 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:09:19 devstack sudo[109633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-038e903d-7b2b-4d3d-9077-ce1ddfe71cb9
Jun 15 16:09:19 devstack sudo[109633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:09:19 devstack sudo[109633]: pam_unix(sudo:session): session closed for user root
Jun 15 16:09:19 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-339cf8b7-7f76-4a8f-8476-b1586aa30901 tempest-VolumeDependencyTests-1916085394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-038e903d-7b2b-4d3d-9077-ce1ddfe71cb9" returned: 0 in 0.633s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:09:19 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-339cf8b7-7f76-4a8f-8476-b1586aa30901 tempest-VolumeDependencyTests-1916085394 None] Lock "cinder-quobyte-038e903d-7b2b-4d3d-9077-ce1ddfe71cb9" released by "delete_volume" :: held 1.480s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:09:19 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-339cf8b7-7f76-4a8f-8476-b1586aa30901 tempest-VolumeDependencyTests-1916085394 None] Created reservations ['517e8f38-227e-460e-b519-672d1bd4da2d', 'd50a110d-a481-488d-a8f5-9b1804d47761', 'f3e177b8-acf4-4a43-b3d0-c76667a07265', '3d8b3d2c-9118-461a-98f7-4f8e42b6d790'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 16:09:19 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-339cf8b7-7f76-4a8f-8476-b1586aa30901 tempest-VolumeDependencyTests-1916085394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:09:19 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-339cf8b7-7f76-4a8f-8476-b1586aa30901 tempest-VolumeDependencyTests-1916085394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:09:19 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-339cf8b7-7f76-4a8f-8476-b1586aa30901 tempest-VolumeDependencyTests-1916085394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:09:19 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-339cf8b7-7f76-4a8f-8476-b1586aa30901 tempest-VolumeDependencyTests-1916085394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:09:19 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-339cf8b7-7f76-4a8f-8476-b1586aa30901 tempest-VolumeDependencyTests-1916085394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:09:19 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-339cf8b7-7f76-4a8f-8476-b1586aa30901 tempest-VolumeDependencyTests-1916085394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:09:19 devstack sudo[109636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 16:09:19 devstack sudo[109636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:09:20 devstack sudo[109636]: pam_unix(sudo:session): session closed for user root
Jun 15 16:09:20 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-339cf8b7-7f76-4a8f-8476-b1586aa30901 tempest-VolumeDependencyTests-1916085394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.580s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:09:20 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-339cf8b7-7f76-4a8f-8476-b1586aa30901 tempest-VolumeDependencyTests-1916085394 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 16:09:20 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-339cf8b7-7f76-4a8f-8476-b1586aa30901 tempest-VolumeDependencyTests-1916085394 None] Deleted volume successfully.
Jun 15 16:09:20 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-339cf8b7-7f76-4a8f-8476-b1586aa30901 tempest-VolumeDependencyTests-1916085394 None] Lock "cinder-038e903d-7b2b-4d3d-9077-ce1ddfe71cb9-delete_volume" released by "delete_volume" :: held 2.326s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:09:27 devstack cinder-volume[91863]: DEBUG dbcounter [-] [91863] Writing DB stats cinder:SELECT=46,cinder:UPDATE=48,cinder:INSERT=13,cinder:DELETE=3 {{(pid=91863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 16:09:27 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-f093fe2f-9cc1-485b-b32d-fae40a7c939c tempest-TestStampPattern-164519336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 16:09:27 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-f093fe2f-9cc1-485b-b32d-fae40a7c939c tempest-TestStampPattern-164519336 None] Flow 'volume_create_manager' (e0ba7841-1e50-45ab-8eb4-152772f7a8ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:09:27 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-f093fe2f-9cc1-485b-b32d-fae40a7c939c tempest-TestStampPattern-164519336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (376ccac2-87e1-46d6-9e7f-d1ec5c3159e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:09:27 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-f093fe2f-9cc1-485b-b32d-fae40a7c939c tempest-TestStampPattern-164519336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (376ccac2-87e1-46d6-9e7f-d1ec5c3159e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:09:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1939089872',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=920fa3b3-f87c-4d50-9634-84782c5fe5d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3104bb76191f4342ac12dabe7de33515',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:09:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:09:28Z,use_quota=True,user_id='736fa51cbe904b4b9de4865bd0144ad6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:09:27 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-f093fe2f-9cc1-485b-b32d-fae40a7c939c tempest-TestStampPattern-164519336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6dbbe5b-3356-4d4a-9ae5-5b8cb8cd593f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:09:27 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-f093fe2f-9cc1-485b-b32d-fae40a7c939c tempest-TestStampPattern-164519336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6dbbe5b-3356-4d4a-9ae5-5b8cb8cd593f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:09:27 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-f093fe2f-9cc1-485b-b32d-fae40a7c939c tempest-TestStampPattern-164519336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92249d22-3ca8-43dd-8e06-f8cf47a63e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:09:27 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-f093fe2f-9cc1-485b-b32d-fae40a7c939c tempest-TestStampPattern-164519336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92249d22-3ca8-43dd-8e06-f8cf47a63e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '920fa3b3-f87c-4d50-9634-84782c5fe5d7', 'volume_name': 'volume-920fa3b3-f87c-4d50-9634-84782c5fe5d7', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:09:27 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-f093fe2f-9cc1-485b-b32d-fae40a7c939c tempest-TestStampPattern-164519336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a51409af-413f-4f7a-8ffe-cf904fae3be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:09:27 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-f093fe2f-9cc1-485b-b32d-fae40a7c939c tempest-TestStampPattern-164519336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a51409af-413f-4f7a-8ffe-cf904fae3be2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:09:27 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-f093fe2f-9cc1-485b-b32d-fae40a7c939c tempest-TestStampPattern-164519336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fadb43e6-5400-40a9-9e4f-6e97cf8dfd1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:09:27 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-f093fe2f-9cc1-485b-b32d-fae40a7c939c tempest-TestStampPattern-164519336 None] Volume 920fa3b3-f87c-4d50-9634-84782c5fe5d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-920fa3b3-f87c-4d50-9634-84782c5fe5d7', 'volume_size': 1}
Jun 15 16:09:27 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-f093fe2f-9cc1-485b-b32d-fae40a7c939c tempest-TestStampPattern-164519336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:09:27 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-f093fe2f-9cc1-485b-b32d-fae40a7c939c tempest-TestStampPattern-164519336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:09:27 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-f093fe2f-9cc1-485b-b32d-fae40a7c939c tempest-TestStampPattern-164519336 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:09:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1939089872',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=920fa3b3-f87c-4d50-9634-84782c5fe5d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3104bb76191f4342ac12dabe7de33515',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:09:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:09:28Z,use_quota=True,user_id='736fa51cbe904b4b9de4865bd0144ad6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 16:09:27 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-f093fe2f-9cc1-485b-b32d-fae40a7c939c tempest-TestStampPattern-164519336 None] Creating volume 920fa3b3-f87c-4d50-9634-84782c5fe5d7 {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 16:09:27 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-f093fe2f-9cc1-485b-b32d-fae40a7c939c tempest-TestStampPattern-164519336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:09:27 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-f093fe2f-9cc1-485b-b32d-fae40a7c939c tempest-TestStampPattern-164519336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:09:27 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-f093fe2f-9cc1-485b-b32d-fae40a7c939c tempest-TestStampPattern-164519336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:09:27 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-f093fe2f-9cc1-485b-b32d-fae40a7c939c tempest-TestStampPattern-164519336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:09:27 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-f093fe2f-9cc1-485b-b32d-fae40a7c939c tempest-TestStampPattern-164519336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:09:27 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-f093fe2f-9cc1-485b-b32d-fae40a7c939c tempest-TestStampPattern-164519336 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 16:09:27 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-f093fe2f-9cc1-485b-b32d-fae40a7c939c tempest-TestStampPattern-164519336 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 16:09:27 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-f093fe2f-9cc1-485b-b32d-fae40a7c939c tempest-TestStampPattern-164519336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-920fa3b3-f87c-4d50-9634-84782c5fe5d7 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:09:27 devstack sudo[109647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-920fa3b3-f87c-4d50-9634-84782c5fe5d7 1073741824
Jun 15 16:09:27 devstack sudo[109647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:09:28 devstack sudo[109647]: pam_unix(sudo:session): session closed for user root
Jun 15 16:09:28 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-f093fe2f-9cc1-485b-b32d-fae40a7c939c tempest-TestStampPattern-164519336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-920fa3b3-f87c-4d50-9634-84782c5fe5d7 1073741824" returned: 0 in 0.803s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:09:28 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-f093fe2f-9cc1-485b-b32d-fae40a7c939c tempest-TestStampPattern-164519336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-920fa3b3-f87c-4d50-9634-84782c5fe5d7 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:09:28 devstack sudo[109655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-920fa3b3-f87c-4d50-9634-84782c5fe5d7
Jun 15 16:09:28 devstack sudo[109655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:09:29 devstack sudo[109655]: pam_unix(sudo:session): session closed for user root
Jun 15 16:09:29 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-f093fe2f-9cc1-485b-b32d-fae40a7c939c tempest-TestStampPattern-164519336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-920fa3b3-f87c-4d50-9634-84782c5fe5d7" returned: 0 in 0.601s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:09:29 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-f093fe2f-9cc1-485b-b32d-fae40a7c939c tempest-TestStampPattern-164519336 None] <== create_volume: return (1449ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 16:09:29 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-f093fe2f-9cc1-485b-b32d-fae40a7c939c tempest-TestStampPattern-164519336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.451s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:09:29 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-f093fe2f-9cc1-485b-b32d-fae40a7c939c tempest-TestStampPattern-164519336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fadb43e6-5400-40a9-9e4f-6e97cf8dfd1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-920fa3b3-f87c-4d50-9634-84782c5fe5d7', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:09:29 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-f093fe2f-9cc1-485b-b32d-fae40a7c939c tempest-TestStampPattern-164519336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86e80c90-4b7c-493b-a98d-715244322ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:09:29 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-f093fe2f-9cc1-485b-b32d-fae40a7c939c tempest-TestStampPattern-164519336 None] Volume volume-920fa3b3-f87c-4d50-9634-84782c5fe5d7 (920fa3b3-f87c-4d50-9634-84782c5fe5d7): created successfully
Jun 15 16:09:29 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-f093fe2f-9cc1-485b-b32d-fae40a7c939c tempest-TestStampPattern-164519336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86e80c90-4b7c-493b-a98d-715244322ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:09:29 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-f093fe2f-9cc1-485b-b32d-fae40a7c939c tempest-TestStampPattern-164519336 None] Flow 'volume_create_manager' (e0ba7841-1e50-45ab-8eb4-152772f7a8ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:09:29 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-f093fe2f-9cc1-485b-b32d-fae40a7c939c tempest-TestStampPattern-164519336 None] Created volume successfully.
Jun 15 16:09:31 devstack cinder-volume[91863]: DEBUG oslo_service.periodic_task [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 16:09:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:09:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:09:31 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:09:31 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:09:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:09:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:09:31 devstack sudo[109658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 16:09:31 devstack sudo[109658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:09:31 devstack sudo[109658]: pam_unix(sudo:session): session closed for user root
Jun 15 16:09:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.609s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:09:31 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 16:09:31 devstack cinder-volume[91863]: DEBUG oslo_service.periodic_task [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Running periodic task VolumeManager._thread_info {{(pid=91863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 16:09:31 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] thread count: 28 {{(pid=91863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 15 16:09:31 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] thread info: [<_MainThread(MainThread, started 131088232640640)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131088122704576)>, <Thread(Thread-3 (stat_writer), started daemon 131088123058112)>, <Thread(Rabbit-heartbeat, started daemon 131088121268864)>, <Thread(Thread-5 (_runner), started daemon 131088121904192)>, <Thread(Thread-7 (_runner), started daemon 131088122037248)>, <Thread(fd_logger, started daemon 131088119630784)>, <Thread(privsep_reader, started daemon 131088119781440)>, <Thread(tpool_thread_0, started daemon 131088111617728)>, <Thread(tpool_thread_1, started daemon 131088103225024)>, <Thread(tpool_thread_2, started daemon 131088094832320)>, <Thread(tpool_thread_3, started daemon 131088086439616)>, <Thread(tpool_thread_4, started daemon 131088078046912)>, <Thread(tpool_thread_5, started daemon 131088069654208)>, <Thread(tpool_thread_6, started daemon 131088061261504)>, <Thread(tpool_thread_7, started daemon 131088052868800)>, <Thread(tpool_thread_8, started daemon 131088044476096)>, <Thread(tpool_thread_9, started daemon 131088036083392)>, <Thread(tpool_thread_10, started daemon 131088027690688)>, <Thread(tpool_thread_11, started daemon 131088019297984)>, <Thread(tpool_thread_12, started daemon 131088010905280)>, <Thread(tpool_thread_13, started daemon 131088002512576)>, <Thread(tpool_thread_14, started daemon 131087994119872)>, <Thread(tpool_thread_15, started daemon 131087985727168)>, <Thread(tpool_thread_16, started daemon 131087977334464)>, <Thread(tpool_thread_17, started daemon 131087968941760)>, <Thread(tpool_thread_18, started daemon 131087960549056)>, <Thread(tpool_thread_19, started daemon 131087952156352)>] {{(pid=91863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 15 16:09:39 devstack cinder-volume[91863]: DEBUG dbcounter [-] [91863] Writing DB stats cinder:UPDATE=28,cinder:DELETE=3,cinder:SELECT=16,cinder:INSERT=6 {{(pid=91863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 16:09:39 devstack cinder-volume[91863]: DEBUG dbcounter [-] [91863] Writing DB stats cinder:UPDATE=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=91863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 16:10:08 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [req-ddf4a6ed-a17c-4d8e-87fe-412574bc53f6 req-bee074d3-a47d-4718-9db7-a0651ab25cde tempest-TestStampPattern-164519336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:10:08 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [req-ddf4a6ed-a17c-4d8e-87fe-412574bc53f6 req-bee074d3-a47d-4718-9db7-a0651ab25cde tempest-TestStampPattern-164519336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:10:08 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d75d0bc-0ff2-4bdf-b907-0fb414ba9b8d]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:10:08 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-ddf4a6ed-a17c-4d8e-87fe-412574bc53f6 req-bee074d3-a47d-4718-9db7-a0651ab25cde tempest-TestStampPattern-164519336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-920fa3b3-f87c-4d50-9634-84782c5fe5d7 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:10:08 devstack sudo[109818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-920fa3b3-f87c-4d50-9634-84782c5fe5d7
Jun 15 16:10:08 devstack sudo[109818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:10:09 devstack sudo[109818]: pam_unix(sudo:session): session closed for user root
Jun 15 16:10:09 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-ddf4a6ed-a17c-4d8e-87fe-412574bc53f6 req-bee074d3-a47d-4718-9db7-a0651ab25cde tempest-TestStampPattern-164519336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-920fa3b3-f87c-4d50-9634-84782c5fe5d7" returned: 0 in 0.682s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:10:09 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [req-ddf4a6ed-a17c-4d8e-87fe-412574bc53f6 req-bee074d3-a47d-4718-9db7-a0651ab25cde tempest-TestStampPattern-164519336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.699s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:10:09 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [req-ddf4a6ed-a17c-4d8e-87fe-412574bc53f6 req-bee074d3-a47d-4718-9db7-a0651ab25cde tempest-TestStampPattern-164519336 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc', 'name': 'volume-920fa3b3-f87c-4d50-9634-84782c5fe5d7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b9ae5843-4028-4827-b509-5912877034e9', 'enforce_multipath': True} {{(pid=91863) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 15 16:10:09 devstack cinder-volume[91863]: INFO cinder.volume.manager [req-ddf4a6ed-a17c-4d8e-87fe-412574bc53f6 req-bee074d3-a47d-4718-9db7-a0651ab25cde tempest-TestStampPattern-164519336 None] attachment_update completed successfully.
Jun 15 16:10:17 devstack cinder-volume[91863]: INFO cinder.volume.manager [req-814ed487-7485-4d41-b504-fe0148810c98 req-ec7e00b3-1953-4ce8-9811-d90e462f8e2e tempest-TestStampPattern-164519336 None] Terminate volume connection completed successfully.
Jun 15 16:10:17 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [req-814ed487-7485-4d41-b504-fe0148810c98 req-ec7e00b3-1953-4ce8-9811-d90e462f8e2e tempest-TestStampPattern-164519336 None] Deleting attachment b9ae5843-4028-4827-b509-5912877034e9. {{(pid=91863) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 15 16:10:19 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-3a83136f-935f-49a7-bc65-72022dff2075 tempest-TestStampPattern-164519336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:10:19 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-3a83136f-935f-49a7-bc65-72022dff2075 tempest-TestStampPattern-164519336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:10:19 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-3a83136f-935f-49a7-bc65-72022dff2075 tempest-TestStampPattern-164519336 None] Creating offline snapshot 5d075000-4060-4dc8-b92f-aa89ce07edf6 of volume 920fa3b3-f87c-4d50-9634-84782c5fe5d7 {{(pid=91863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 15 16:10:19 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[77029135-3f06-46ba-86a0-4615f83dc508]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:10:19 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3a83136f-935f-49a7-bc65-72022dff2075 tempest-TestStampPattern-164519336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-920fa3b3-f87c-4d50-9634-84782c5fe5d7 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:10:19 devstack sudo[110263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-920fa3b3-f87c-4d50-9634-84782c5fe5d7
Jun 15 16:10:19 devstack sudo[110263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:10:20 devstack sudo[110263]: pam_unix(sudo:session): session closed for user root
Jun 15 16:10:20 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3a83136f-935f-49a7-bc65-72022dff2075 tempest-TestStampPattern-164519336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-920fa3b3-f87c-4d50-9634-84782c5fe5d7" returned: 0 in 0.710s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:10:20 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3a83136f-935f-49a7-bc65-72022dff2075 tempest-TestStampPattern-164519336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-920fa3b3-f87c-4d50-9634-84782c5fe5d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-920fa3b3-f87c-4d50-9634-84782c5fe5d7.5d075000-4060-4dc8-b92f-aa89ce07edf6 1G {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:10:20 devstack sudo[110268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-920fa3b3-f87c-4d50-9634-84782c5fe5d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-920fa3b3-f87c-4d50-9634-84782c5fe5d7.5d075000-4060-4dc8-b92f-aa89ce07edf6 1G
Jun 15 16:10:20 devstack sudo[110268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:10:21 devstack sudo[110268]: pam_unix(sudo:session): session closed for user root
Jun 15 16:10:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3a83136f-935f-49a7-bc65-72022dff2075 tempest-TestStampPattern-164519336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-920fa3b3-f87c-4d50-9634-84782c5fe5d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-920fa3b3-f87c-4d50-9634-84782c5fe5d7.5d075000-4060-4dc8-b92f-aa89ce07edf6 1G" returned: 0 in 0.743s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:10:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3a83136f-935f-49a7-bc65-72022dff2075 tempest-TestStampPattern-164519336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-920fa3b3-f87c-4d50-9634-84782c5fe5d7 -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-920fa3b3-f87c-4d50-9634-84782c5fe5d7.5d075000-4060-4dc8-b92f-aa89ce07edf6 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:10:21 devstack sudo[110274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-920fa3b3-f87c-4d50-9634-84782c5fe5d7 -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-920fa3b3-f87c-4d50-9634-84782c5fe5d7.5d075000-4060-4dc8-b92f-aa89ce07edf6
Jun 15 16:10:21 devstack sudo[110274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:10:21 devstack sudo[110274]: pam_unix(sudo:session): session closed for user root
Jun 15 16:10:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3a83136f-935f-49a7-bc65-72022dff2075 tempest-TestStampPattern-164519336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-920fa3b3-f87c-4d50-9634-84782c5fe5d7 -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-920fa3b3-f87c-4d50-9634-84782c5fe5d7.5d075000-4060-4dc8-b92f-aa89ce07edf6" returned: 0 in 0.628s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:10:21 devstack cinder-volume[91863]: WARNING cinder.volume.drivers.remotefs [None req-3a83136f-935f-49a7-bc65-72022dff2075 tempest-TestStampPattern-164519336 None] /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-920fa3b3-f87c-4d50-9634-84782c5fe5d7.5d075000-4060-4dc8-b92f-aa89ce07edf6 is being set with open permissions: ugo+rw
Jun 15 16:10:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3a83136f-935f-49a7-bc65-72022dff2075 tempest-TestStampPattern-164519336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-920fa3b3-f87c-4d50-9634-84782c5fe5d7.5d075000-4060-4dc8-b92f-aa89ce07edf6 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:10:21 devstack sudo[110280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-920fa3b3-f87c-4d50-9634-84782c5fe5d7.5d075000-4060-4dc8-b92f-aa89ce07edf6
Jun 15 16:10:21 devstack sudo[110280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:10:22 devstack sudo[110280]: pam_unix(sudo:session): session closed for user root
Jun 15 16:10:22 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3a83136f-935f-49a7-bc65-72022dff2075 tempest-TestStampPattern-164519336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-920fa3b3-f87c-4d50-9634-84782c5fe5d7.5d075000-4060-4dc8-b92f-aa89ce07edf6" returned: 0 in 0.647s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:10:22 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3a83136f-935f-49a7-bc65-72022dff2075 tempest-TestStampPattern-164519336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-920fa3b3-f87c-4d50-9634-84782c5fe5d7.info {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:10:22 devstack sudo[110283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-920fa3b3-f87c-4d50-9634-84782c5fe5d7.info
Jun 15 16:10:22 devstack sudo[110283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:10:23 devstack sudo[110283]: pam_unix(sudo:session): session closed for user root
Jun 15 16:10:23 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3a83136f-935f-49a7-bc65-72022dff2075 tempest-TestStampPattern-164519336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-920fa3b3-f87c-4d50-9634-84782c5fe5d7.info" returned: 0 in 0.568s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:10:23 devstack cinder-volume[91863]: WARNING cinder.volume.drivers.remotefs [None req-3a83136f-935f-49a7-bc65-72022dff2075 tempest-TestStampPattern-164519336 None] /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-920fa3b3-f87c-4d50-9634-84782c5fe5d7.info is being set with open permissions: ugo+rw
Jun 15 16:10:23 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3a83136f-935f-49a7-bc65-72022dff2075 tempest-TestStampPattern-164519336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-920fa3b3-f87c-4d50-9634-84782c5fe5d7.info {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:10:23 devstack sudo[110286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-920fa3b3-f87c-4d50-9634-84782c5fe5d7.info
Jun 15 16:10:23 devstack sudo[110286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:10:23 devstack sudo[110286]: pam_unix(sudo:session): session closed for user root
Jun 15 16:10:23 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-3a83136f-935f-49a7-bc65-72022dff2075 tempest-TestStampPattern-164519336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-920fa3b3-f87c-4d50-9634-84782c5fe5d7.info" returned: 0 in 0.561s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:10:23 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-3a83136f-935f-49a7-bc65-72022dff2075 tempest-TestStampPattern-164519336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.934s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:10:23 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-3a83136f-935f-49a7-bc65-72022dff2075 tempest-TestStampPattern-164519336 None] Create snapshot completed successfully
Jun 15 16:10:31 devstack cinder-volume[91863]: DEBUG oslo_service.periodic_task [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 16:10:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:10:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:10:31 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:10:31 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:10:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:10:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:10:31 devstack sudo[110329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 16:10:31 devstack sudo[110329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:10:31 devstack sudo[110329]: pam_unix(sudo:session): session closed for user root
Jun 15 16:10:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.594s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:10:31 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 16:10:31 devstack cinder-volume[91863]: DEBUG oslo_service.periodic_task [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Running periodic task VolumeManager._thread_info {{(pid=91863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 16:10:31 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] thread count: 28 {{(pid=91863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 15 16:10:31 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] thread info: [<_MainThread(MainThread, started 131088232640640)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131088122704576)>, <Thread(Thread-3 (stat_writer), started daemon 131088123058112)>, <Thread(Rabbit-heartbeat, started daemon 131088121268864)>, <Thread(Thread-5 (_runner), started daemon 131088121904192)>, <Thread(Thread-7 (_runner), started daemon 131088122037248)>, <Thread(fd_logger, started daemon 131088119630784)>, <Thread(privsep_reader, started daemon 131088119781440)>, <Thread(tpool_thread_0, started daemon 131088111617728)>, <Thread(tpool_thread_1, started daemon 131088103225024)>, <Thread(tpool_thread_2, started daemon 131088094832320)>, <Thread(tpool_thread_3, started daemon 131088086439616)>, <Thread(tpool_thread_4, started daemon 131088078046912)>, <Thread(tpool_thread_5, started daemon 131088069654208)>, <Thread(tpool_thread_6, started daemon 131088061261504)>, <Thread(tpool_thread_7, started daemon 131088052868800)>, <Thread(tpool_thread_8, started daemon 131088044476096)>, <Thread(tpool_thread_9, started daemon 131088036083392)>, <Thread(tpool_thread_10, started daemon 131088027690688)>, <Thread(tpool_thread_11, started daemon 131088019297984)>, <Thread(tpool_thread_12, started daemon 131088010905280)>, <Thread(tpool_thread_13, started daemon 131088002512576)>, <Thread(tpool_thread_14, started daemon 131087994119872)>, <Thread(tpool_thread_15, started daemon 131087985727168)>, <Thread(tpool_thread_16, started daemon 131087977334464)>, <Thread(tpool_thread_17, started daemon 131087968941760)>, <Thread(tpool_thread_18, started daemon 131087960549056)>, <Thread(tpool_thread_19, started daemon 131087952156352)>] {{(pid=91863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 15 16:10:32 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3afd7fb-5308-4150-a2a1-667ea483d0bb tempest-TestStampPattern-164519336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 16:10:32 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-b3afd7fb-5308-4150-a2a1-667ea483d0bb tempest-TestStampPattern-164519336 None] Flow 'volume_create_manager' (a4e9ed3f-0e06-4c68-8c59-6848265cc7cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:10:32 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-b3afd7fb-5308-4150-a2a1-667ea483d0bb tempest-TestStampPattern-164519336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07da4a86-cc87-4eaf-b4d5-17c26f66ec89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:10:32 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-b3afd7fb-5308-4150-a2a1-667ea483d0bb tempest-TestStampPattern-164519336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07da4a86-cc87-4eaf-b4d5-17c26f66ec89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:10:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-233617472',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fab3ad09-594d-4239-986f-2bf7354a3658,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3104bb76191f4342ac12dabe7de33515',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:10:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5d075000-4060-4dc8-b92f-aa89ce07edf6,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:10:32Z,use_quota=True,user_id='736fa51cbe904b4b9de4865bd0144ad6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:10:32 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-b3afd7fb-5308-4150-a2a1-667ea483d0bb tempest-TestStampPattern-164519336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45071859-eb47-4858-a799-2974d3a3c21d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:10:32 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-b3afd7fb-5308-4150-a2a1-667ea483d0bb tempest-TestStampPattern-164519336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45071859-eb47-4858-a799-2974d3a3c21d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:10:32 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-b3afd7fb-5308-4150-a2a1-667ea483d0bb tempest-TestStampPattern-164519336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c4d16ab-66cc-48bf-918e-1c3ca4673772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:10:32 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-b3afd7fb-5308-4150-a2a1-667ea483d0bb tempest-TestStampPattern-164519336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c4d16ab-66cc-48bf-918e-1c3ca4673772) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fab3ad09-594d-4239-986f-2bf7354a3658', 'volume_name': 'volume-fab3ad09-594d-4239-986f-2bf7354a3658', 'volume_size': 1, 'snapshot_id': '5d075000-4060-4dc8-b92f-aa89ce07edf6'}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:10:32 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-b3afd7fb-5308-4150-a2a1-667ea483d0bb tempest-TestStampPattern-164519336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f80df4ab-327c-4157-ae82-5610884426e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:10:32 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-b3afd7fb-5308-4150-a2a1-667ea483d0bb tempest-TestStampPattern-164519336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f80df4ab-327c-4157-ae82-5610884426e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:10:32 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-b3afd7fb-5308-4150-a2a1-667ea483d0bb tempest-TestStampPattern-164519336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca38d5d6-a2a1-4b89-b489-373f7c62637c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:10:32 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-b3afd7fb-5308-4150-a2a1-667ea483d0bb tempest-TestStampPattern-164519336 None] Volume fab3ad09-594d-4239-986f-2bf7354a3658: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fab3ad09-594d-4239-986f-2bf7354a3658', 'volume_size': 1, 'snapshot_id': '5d075000-4060-4dc8-b92f-aa89ce07edf6'}
Jun 15 16:10:32 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-b3afd7fb-5308-4150-a2a1-667ea483d0bb tempest-TestStampPattern-164519336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:10:32 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-b3afd7fb-5308-4150-a2a1-667ea483d0bb tempest-TestStampPattern-164519336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:10:32 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-b3afd7fb-5308-4150-a2a1-667ea483d0bb tempest-TestStampPattern-164519336 None] Acquiring lock "cinder-quobyte-5d075000-4060-4dc8-b92f-aa89ce07edf6-fab3ad09-594d-4239-986f-2bf7354a3658" by "_create_volume_from_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:10:32 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-b3afd7fb-5308-4150-a2a1-667ea483d0bb tempest-TestStampPattern-164519336 None] Lock "cinder-quobyte-5d075000-4060-4dc8-b92f-aa89ce07edf6-fab3ad09-594d-4239-986f-2bf7354a3658" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:10:32 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-b3afd7fb-5308-4150-a2a1-667ea483d0bb tempest-TestStampPattern-164519336 None] Creating volume fab3ad09-594d-4239-986f-2bf7354a3658 from snapshot 5d075000-4060-4dc8-b92f-aa89ce07edf6 {{(pid=91863) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 15 16:10:32 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-b3afd7fb-5308-4150-a2a1-667ea483d0bb tempest-TestStampPattern-164519336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:10:32 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-b3afd7fb-5308-4150-a2a1-667ea483d0bb tempest-TestStampPattern-164519336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:10:32 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-b3afd7fb-5308-4150-a2a1-667ea483d0bb tempest-TestStampPattern-164519336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:10:32 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-b3afd7fb-5308-4150-a2a1-667ea483d0bb tempest-TestStampPattern-164519336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:10:32 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-b3afd7fb-5308-4150-a2a1-667ea483d0bb tempest-TestStampPattern-164519336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:10:32 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-b3afd7fb-5308-4150-a2a1-667ea483d0bb tempest-TestStampPattern-164519336 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 16:10:32 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-b3afd7fb-5308-4150-a2a1-667ea483d0bb tempest-TestStampPattern-164519336 None] Acquiring lock "cinder-quobyte-fab3ad09-594d-4239-986f-2bf7354a3658" by "_copy_volume_from_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:10:32 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-b3afd7fb-5308-4150-a2a1-667ea483d0bb tempest-TestStampPattern-164519336 None] Lock "cinder-quobyte-fab3ad09-594d-4239-986f-2bf7354a3658" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:10:32 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-b3afd7fb-5308-4150-a2a1-667ea483d0bb tempest-TestStampPattern-164519336 None] snapshot: 5d075000-4060-4dc8-b92f-aa89ce07edf6, volume: fab3ad09-594d-4239-986f-2bf7354a3658,  {{(pid=91863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 15 16:10:32 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-b3afd7fb-5308-4150-a2a1-667ea483d0bb tempest-TestStampPattern-164519336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:10:32 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-b3afd7fb-5308-4150-a2a1-667ea483d0bb tempest-TestStampPattern-164519336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:10:32 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-b3afd7fb-5308-4150-a2a1-667ea483d0bb tempest-TestStampPattern-164519336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:10:32 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-b3afd7fb-5308-4150-a2a1-667ea483d0bb tempest-TestStampPattern-164519336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:10:32 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-b3afd7fb-5308-4150-a2a1-667ea483d0bb tempest-TestStampPattern-164519336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:10:32 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b1fd903-5572-4fda-a405-e15c0da351cb]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:10:32 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-b3afd7fb-5308-4150-a2a1-667ea483d0bb tempest-TestStampPattern-164519336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-920fa3b3-f87c-4d50-9634-84782c5fe5d7.5d075000-4060-4dc8-b92f-aa89ce07edf6 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:10:32 devstack sudo[110332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-920fa3b3-f87c-4d50-9634-84782c5fe5d7.5d075000-4060-4dc8-b92f-aa89ce07edf6
Jun 15 16:10:32 devstack sudo[110332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:10:33 devstack sudo[110332]: pam_unix(sudo:session): session closed for user root
Jun 15 16:10:33 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-b3afd7fb-5308-4150-a2a1-667ea483d0bb tempest-TestStampPattern-164519336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-920fa3b3-f87c-4d50-9634-84782c5fe5d7.5d075000-4060-4dc8-b92f-aa89ce07edf6" returned: 0 in 0.752s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:10:33 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-b3afd7fb-5308-4150-a2a1-667ea483d0bb tempest-TestStampPattern-164519336 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-920fa3b3-f87c-4d50-9634-84782c5fe5d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 16:10:33 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-b3afd7fb-5308-4150-a2a1-667ea483d0bb tempest-TestStampPattern-164519336 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-920fa3b3-f87c-4d50-9634-84782c5fe5d7 {{(pid=91863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 15 16:10:33 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-b3afd7fb-5308-4150-a2a1-667ea483d0bb tempest-TestStampPattern-164519336 None] Creating direct copy from snapshot {{(pid=91863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 15 16:10:33 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e4788a5-dbe9-4f5a-bd92-19c8166caa13]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:10:33 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-b3afd7fb-5308-4150-a2a1-667ea483d0bb tempest-TestStampPattern-164519336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-920fa3b3-f87c-4d50-9634-84782c5fe5d7 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:10:33 devstack sudo[110340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-920fa3b3-f87c-4d50-9634-84782c5fe5d7
Jun 15 16:10:33 devstack sudo[110340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:10:34 devstack sudo[110340]: pam_unix(sudo:session): session closed for user root
Jun 15 16:10:34 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-b3afd7fb-5308-4150-a2a1-667ea483d0bb tempest-TestStampPattern-164519336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-920fa3b3-f87c-4d50-9634-84782c5fe5d7" returned: 0 in 0.712s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:10:34 devstack cinder-volume[91863]: DEBUG cinder.utils [None req-b3afd7fb-5308-4150-a2a1-667ea483d0bb tempest-TestStampPattern-164519336 None] Path /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fab3ad09-594d-4239-986f-2bf7354a3658 not found in is_blk_device check {{(pid=91863) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 15 16:10:34 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-b3afd7fb-5308-4150-a2a1-667ea483d0bb tempest-TestStampPattern-164519336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-920fa3b3-f87c-4d50-9634-84782c5fe5d7 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fab3ad09-594d-4239-986f-2bf7354a3658 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:10:34 devstack sudo[110345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-920fa3b3-f87c-4d50-9634-84782c5fe5d7 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fab3ad09-594d-4239-986f-2bf7354a3658
Jun 15 16:10:34 devstack sudo[110345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:10:38 devstack sudo[110345]: pam_unix(sudo:session): session closed for user root
Jun 15 16:10:38 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-b3afd7fb-5308-4150-a2a1-667ea483d0bb tempest-TestStampPattern-164519336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-920fa3b3-f87c-4d50-9634-84782c5fe5d7 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fab3ad09-594d-4239-986f-2bf7354a3658" returned: 0 in 4.599s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:10:38 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1baba336-e768-41a2-9e59-5d5ca7de22e3]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:10:38 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-b3afd7fb-5308-4150-a2a1-667ea483d0bb tempest-TestStampPattern-164519336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-920fa3b3-f87c-4d50-9634-84782c5fe5d7 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:10:38 devstack sudo[110359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-920fa3b3-f87c-4d50-9634-84782c5fe5d7
Jun 15 16:10:38 devstack sudo[110359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:10:39 devstack sudo[110359]: pam_unix(sudo:session): session closed for user root
Jun 15 16:10:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-b3afd7fb-5308-4150-a2a1-667ea483d0bb tempest-TestStampPattern-164519336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-920fa3b3-f87c-4d50-9634-84782c5fe5d7" returned: 0 in 0.970s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:10:39 devstack cinder-volume[91863]: DEBUG cinder.image.image_utils [None req-b3afd7fb-5308-4150-a2a1-667ea483d0bb tempest-TestStampPattern-164519336 None] Image conversion details: src /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-920fa3b3-f87c-4d50-9634-84782c5fe5d7, size 1024.00 MB, duration 4.60 sec, destination /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fab3ad09-594d-4239-986f-2bf7354a3658 {{(pid=91863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 15 16:10:39 devstack cinder-volume[91863]: INFO cinder.image.image_utils [None req-b3afd7fb-5308-4150-a2a1-667ea483d0bb tempest-TestStampPattern-164519336 None] Converted 1024.00 MB image at 222.55 MB/s
Jun 15 16:10:39 devstack cinder-volume[91863]: WARNING cinder.volume.drivers.remotefs [None req-b3afd7fb-5308-4150-a2a1-667ea483d0bb tempest-TestStampPattern-164519336 None] /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fab3ad09-594d-4239-986f-2bf7354a3658 is being set with open permissions: ugo+rw
Jun 15 16:10:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-b3afd7fb-5308-4150-a2a1-667ea483d0bb tempest-TestStampPattern-164519336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fab3ad09-594d-4239-986f-2bf7354a3658 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:10:39 devstack sudo[110365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fab3ad09-594d-4239-986f-2bf7354a3658
Jun 15 16:10:39 devstack sudo[110365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:10:40 devstack sudo[110365]: pam_unix(sudo:session): session closed for user root
Jun 15 16:10:40 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-b3afd7fb-5308-4150-a2a1-667ea483d0bb tempest-TestStampPattern-164519336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fab3ad09-594d-4239-986f-2bf7354a3658" returned: 0 in 0.615s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:10:40 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-b3afd7fb-5308-4150-a2a1-667ea483d0bb tempest-TestStampPattern-164519336 None] Lock "cinder-quobyte-fab3ad09-594d-4239-986f-2bf7354a3658" released by "_copy_volume_from_snapshot" :: held 7.767s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:10:40 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-b3afd7fb-5308-4150-a2a1-667ea483d0bb tempest-TestStampPattern-164519336 None] Lock "cinder-quobyte-5d075000-4060-4dc8-b92f-aa89ce07edf6-fab3ad09-594d-4239-986f-2bf7354a3658" released by "_create_volume_from_snapshot" :: held 7.797s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:10:40 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-b3afd7fb-5308-4150-a2a1-667ea483d0bb tempest-TestStampPattern-164519336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.812s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:10:40 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-b3afd7fb-5308-4150-a2a1-667ea483d0bb tempest-TestStampPattern-164519336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca38d5d6-a2a1-4b89-b489-373f7c62637c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fab3ad09-594d-4239-986f-2bf7354a3658', 'volume_size': 1, 'snapshot_id': '5d075000-4060-4dc8-b92f-aa89ce07edf6'}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:10:40 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-b3afd7fb-5308-4150-a2a1-667ea483d0bb tempest-TestStampPattern-164519336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8e3b66c-efca-4782-a873-25ff01454f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:10:40 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-b3afd7fb-5308-4150-a2a1-667ea483d0bb tempest-TestStampPattern-164519336 None] Volume volume-fab3ad09-594d-4239-986f-2bf7354a3658 (fab3ad09-594d-4239-986f-2bf7354a3658): created successfully
Jun 15 16:10:40 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-b3afd7fb-5308-4150-a2a1-667ea483d0bb tempest-TestStampPattern-164519336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8e3b66c-efca-4782-a873-25ff01454f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:10:40 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-b3afd7fb-5308-4150-a2a1-667ea483d0bb tempest-TestStampPattern-164519336 None] Flow 'volume_create_manager' (a4e9ed3f-0e06-4c68-8c59-6848265cc7cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:10:40 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-b3afd7fb-5308-4150-a2a1-667ea483d0bb tempest-TestStampPattern-164519336 None] Created volume successfully.
Jun 15 16:10:50 devstack cinder-volume[91863]: DEBUG dbcounter [-] [91863] Writing DB stats cinder:SELECT=10,cinder:UPDATE=5,cinder:INSERT=1,cinder:DELETE=1 {{(pid=91863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 16:10:50 devstack cinder-volume[91863]: DEBUG dbcounter [-] [91863] Writing DB stats cinder:SELECT=15,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=91863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 16:11:09 devstack cinder-volume[91863]: DEBUG dbcounter [-] [91863] Writing DB stats cinder:SELECT=1 {{(pid=91863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 16:11:09 devstack cinder-volume[91863]: DEBUG dbcounter [-] [91863] Writing DB stats cinder:UPDATE=1 {{(pid=91863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 16:11:16 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [req-afeb7397-7f72-40bb-b250-a21a582d0169 req-c9ed0168-2dbd-4731-9cdc-2882b433cae3 tempest-TestStampPattern-164519336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:11:16 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [req-afeb7397-7f72-40bb-b250-a21a582d0169 req-c9ed0168-2dbd-4731-9cdc-2882b433cae3 tempest-TestStampPattern-164519336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:11:16 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2eb0c3a-c0d2-4043-8806-150ebdce5a00]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:11:16 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-afeb7397-7f72-40bb-b250-a21a582d0169 req-c9ed0168-2dbd-4731-9cdc-2882b433cae3 tempest-TestStampPattern-164519336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fab3ad09-594d-4239-986f-2bf7354a3658 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:11:16 devstack sudo[110510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fab3ad09-594d-4239-986f-2bf7354a3658
Jun 15 16:11:16 devstack sudo[110510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:11:16 devstack sudo[110510]: pam_unix(sudo:session): session closed for user root
Jun 15 16:11:16 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [req-afeb7397-7f72-40bb-b250-a21a582d0169 req-c9ed0168-2dbd-4731-9cdc-2882b433cae3 tempest-TestStampPattern-164519336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fab3ad09-594d-4239-986f-2bf7354a3658" returned: 0 in 0.703s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:11:16 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [req-afeb7397-7f72-40bb-b250-a21a582d0169 req-c9ed0168-2dbd-4731-9cdc-2882b433cae3 tempest-TestStampPattern-164519336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.732s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:11:16 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [req-afeb7397-7f72-40bb-b250-a21a582d0169 req-c9ed0168-2dbd-4731-9cdc-2882b433cae3 tempest-TestStampPattern-164519336 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc', 'name': 'volume-fab3ad09-594d-4239-986f-2bf7354a3658', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '274a12c3-d092-49d2-85df-f3434a9e282e', 'enforce_multipath': True} {{(pid=91863) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 15 16:11:16 devstack cinder-volume[91863]: INFO cinder.volume.manager [req-afeb7397-7f72-40bb-b250-a21a582d0169 req-c9ed0168-2dbd-4731-9cdc-2882b433cae3 tempest-TestStampPattern-164519336 None] attachment_update completed successfully.
Jun 15 16:11:23 devstack cinder-volume[91863]: INFO cinder.volume.manager [req-a6aa1f4e-822c-4b79-847c-945b07337dc5 req-d0fdbdd4-d723-4ed8-8a10-2b9335f947b8 tempest-TestStampPattern-164519336 None] Terminate volume connection completed successfully.
Jun 15 16:11:23 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [req-a6aa1f4e-822c-4b79-847c-945b07337dc5 req-d0fdbdd4-d723-4ed8-8a10-2b9335f947b8 tempest-TestStampPattern-164519336 None] Deleting attachment 274a12c3-d092-49d2-85df-f3434a9e282e. {{(pid=91863) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 15 16:11:31 devstack cinder-volume[91863]: DEBUG oslo_service.periodic_task [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 16:11:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:11:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:11:31 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:11:31 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:11:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:11:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:11:31 devstack sudo[110990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 16:11:31 devstack sudo[110990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:11:31 devstack sudo[110990]: pam_unix(sudo:session): session closed for user root
Jun 15 16:11:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.645s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:11:31 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 16:11:31 devstack cinder-volume[91863]: DEBUG oslo_service.periodic_task [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Running periodic task VolumeManager._thread_info {{(pid=91863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 16:11:31 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] thread count: 28 {{(pid=91863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 15 16:11:31 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] thread info: [<_MainThread(MainThread, started 131088232640640)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131088122704576)>, <Thread(Thread-3 (stat_writer), started daemon 131088123058112)>, <Thread(Rabbit-heartbeat, started daemon 131088121268864)>, <Thread(Thread-5 (_runner), started daemon 131088121904192)>, <Thread(Thread-7 (_runner), started daemon 131088122037248)>, <Thread(fd_logger, started daemon 131088119630784)>, <Thread(privsep_reader, started daemon 131088119781440)>, <Thread(tpool_thread_0, started daemon 131088111617728)>, <Thread(tpool_thread_1, started daemon 131088103225024)>, <Thread(tpool_thread_2, started daemon 131088094832320)>, <Thread(tpool_thread_3, started daemon 131088086439616)>, <Thread(tpool_thread_4, started daemon 131088078046912)>, <Thread(tpool_thread_5, started daemon 131088069654208)>, <Thread(tpool_thread_6, started daemon 131088061261504)>, <Thread(tpool_thread_7, started daemon 131088052868800)>, <Thread(tpool_thread_8, started daemon 131088044476096)>, <Thread(tpool_thread_9, started daemon 131088036083392)>, <Thread(tpool_thread_10, started daemon 131088027690688)>, <Thread(tpool_thread_11, started daemon 131088019297984)>, <Thread(tpool_thread_12, started daemon 131088010905280)>, <Thread(tpool_thread_13, started daemon 131088002512576)>, <Thread(tpool_thread_14, started daemon 131087994119872)>, <Thread(tpool_thread_15, started daemon 131087985727168)>, <Thread(tpool_thread_16, started daemon 131087977334464)>, <Thread(tpool_thread_17, started daemon 131087968941760)>, <Thread(tpool_thread_18, started daemon 131087960549056)>, <Thread(tpool_thread_19, started daemon 131087952156352)>] {{(pid=91863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 15 16:11:32 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-a0ca0b7b-23ed-454c-b49b-dfb1c0b95893 tempest-TestStampPattern-164519336 None] Acquiring lock "cinder-fab3ad09-594d-4239-986f-2bf7354a3658-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:11:32 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-a0ca0b7b-23ed-454c-b49b-dfb1c0b95893 tempest-TestStampPattern-164519336 None] Lock "cinder-fab3ad09-594d-4239-986f-2bf7354a3658-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:11:32 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-a0ca0b7b-23ed-454c-b49b-dfb1c0b95893 tempest-TestStampPattern-164519336 None] Acquiring lock "cinder-quobyte-fab3ad09-594d-4239-986f-2bf7354a3658" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:11:32 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-a0ca0b7b-23ed-454c-b49b-dfb1c0b95893 tempest-TestStampPattern-164519336 None] Lock "cinder-quobyte-fab3ad09-594d-4239-986f-2bf7354a3658" acquired by "delete_volume" :: waited 0.017s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:11:32 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84f3195-399e-4a17-96b5-998b0551297a]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:11:32 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-a0ca0b7b-23ed-454c-b49b-dfb1c0b95893 tempest-TestStampPattern-164519336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fab3ad09-594d-4239-986f-2bf7354a3658 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:11:32 devstack sudo[110993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fab3ad09-594d-4239-986f-2bf7354a3658
Jun 15 16:11:32 devstack sudo[110993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:11:33 devstack sudo[110993]: pam_unix(sudo:session): session closed for user root
Jun 15 16:11:33 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-a0ca0b7b-23ed-454c-b49b-dfb1c0b95893 tempest-TestStampPattern-164519336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fab3ad09-594d-4239-986f-2bf7354a3658" returned: 0 in 0.791s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:11:33 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-a0ca0b7b-23ed-454c-b49b-dfb1c0b95893 tempest-TestStampPattern-164519336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fab3ad09-594d-4239-986f-2bf7354a3658 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:11:33 devstack sudo[110998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fab3ad09-594d-4239-986f-2bf7354a3658
Jun 15 16:11:33 devstack sudo[110998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:11:33 devstack sudo[110998]: pam_unix(sudo:session): session closed for user root
Jun 15 16:11:33 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-a0ca0b7b-23ed-454c-b49b-dfb1c0b95893 tempest-TestStampPattern-164519336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fab3ad09-594d-4239-986f-2bf7354a3658" returned: 0 in 0.567s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:11:33 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-a0ca0b7b-23ed-454c-b49b-dfb1c0b95893 tempest-TestStampPattern-164519336 None] Lock "cinder-quobyte-fab3ad09-594d-4239-986f-2bf7354a3658" released by "delete_volume" :: held 1.410s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:11:33 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-a0ca0b7b-23ed-454c-b49b-dfb1c0b95893 tempest-TestStampPattern-164519336 None] Created reservations ['68a037f7-f593-49ab-853b-3b91d05a5954', 'a56727b7-5069-4cc3-9ab6-32bed28ca0d4', '74359a82-184e-472e-be50-ef7c546f92d5', 'd917d342-bba9-4736-aac6-0328ff5dda0f'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 16:11:33 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-a0ca0b7b-23ed-454c-b49b-dfb1c0b95893 tempest-TestStampPattern-164519336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:11:33 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-a0ca0b7b-23ed-454c-b49b-dfb1c0b95893 tempest-TestStampPattern-164519336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:11:33 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-a0ca0b7b-23ed-454c-b49b-dfb1c0b95893 tempest-TestStampPattern-164519336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:11:33 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-a0ca0b7b-23ed-454c-b49b-dfb1c0b95893 tempest-TestStampPattern-164519336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:11:33 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-a0ca0b7b-23ed-454c-b49b-dfb1c0b95893 tempest-TestStampPattern-164519336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:11:33 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-a0ca0b7b-23ed-454c-b49b-dfb1c0b95893 tempest-TestStampPattern-164519336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:11:33 devstack sudo[111001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 16:11:33 devstack sudo[111001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:11:34 devstack sudo[111001]: pam_unix(sudo:session): session closed for user root
Jun 15 16:11:34 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-a0ca0b7b-23ed-454c-b49b-dfb1c0b95893 tempest-TestStampPattern-164519336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.627s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:11:34 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-a0ca0b7b-23ed-454c-b49b-dfb1c0b95893 tempest-TestStampPattern-164519336 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 16:11:34 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-a0ca0b7b-23ed-454c-b49b-dfb1c0b95893 tempest-TestStampPattern-164519336 None] Deleted volume successfully.
Jun 15 16:11:34 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-a0ca0b7b-23ed-454c-b49b-dfb1c0b95893 tempest-TestStampPattern-164519336 None] Lock "cinder-fab3ad09-594d-4239-986f-2bf7354a3658-delete_volume" released by "delete_volume" :: held 2.232s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:11:34 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-6d36d4fb-2aa1-4675-af5b-92e366f489a7 tempest-TestStampPattern-164519336 None] Acquiring lock "cinder-5d075000-4060-4dc8-b92f-aa89ce07edf6-delete_snapshot" by "delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:11:34 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-6d36d4fb-2aa1-4675-af5b-92e366f489a7 tempest-TestStampPattern-164519336 None] Lock "cinder-5d075000-4060-4dc8-b92f-aa89ce07edf6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:11:34 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-6d36d4fb-2aa1-4675-af5b-92e366f489a7 tempest-TestStampPattern-164519336 None] Acquiring lock "cinder-quobyte-920fa3b3-f87c-4d50-9634-84782c5fe5d7" by "delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:11:34 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-6d36d4fb-2aa1-4675-af5b-92e366f489a7 tempest-TestStampPattern-164519336 None] Lock "cinder-quobyte-920fa3b3-f87c-4d50-9634-84782c5fe5d7" acquired by "delete_snapshot" :: waited 0.012s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:11:34 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-6d36d4fb-2aa1-4675-af5b-92e366f489a7 tempest-TestStampPattern-164519336 None] Acquiring lock "cinder-quobyte-5d075000-4060-4dc8-b92f-aa89ce07edf6" by "_delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:11:34 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-6d36d4fb-2aa1-4675-af5b-92e366f489a7 tempest-TestStampPattern-164519336 None] Lock "cinder-quobyte-5d075000-4060-4dc8-b92f-aa89ce07edf6" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:11:34 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-6d36d4fb-2aa1-4675-af5b-92e366f489a7 tempest-TestStampPattern-164519336 None] Deleting offline snapshot 5d075000-4060-4dc8-b92f-aa89ce07edf6 of volume 920fa3b3-f87c-4d50-9634-84782c5fe5d7 {{(pid=91863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 15 16:11:34 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-6d36d4fb-2aa1-4675-af5b-92e366f489a7 tempest-TestStampPattern-164519336 None] snapshot_file for this snap is: volume-920fa3b3-f87c-4d50-9634-84782c5fe5d7.5d075000-4060-4dc8-b92f-aa89ce07edf6 {{(pid=91863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 15 16:11:34 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d465f150-1e9d-4e28-8eb4-2dedffb3e6db]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:11:34 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6d36d4fb-2aa1-4675-af5b-92e366f489a7 tempest-TestStampPattern-164519336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-920fa3b3-f87c-4d50-9634-84782c5fe5d7.5d075000-4060-4dc8-b92f-aa89ce07edf6 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:11:34 devstack sudo[111004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-920fa3b3-f87c-4d50-9634-84782c5fe5d7.5d075000-4060-4dc8-b92f-aa89ce07edf6
Jun 15 16:11:34 devstack sudo[111004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:11:35 devstack sudo[111004]: pam_unix(sudo:session): session closed for user root
Jun 15 16:11:35 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6d36d4fb-2aa1-4675-af5b-92e366f489a7 tempest-TestStampPattern-164519336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-920fa3b3-f87c-4d50-9634-84782c5fe5d7.5d075000-4060-4dc8-b92f-aa89ce07edf6" returned: 0 in 0.740s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:11:35 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-6d36d4fb-2aa1-4675-af5b-92e366f489a7 tempest-TestStampPattern-164519336 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-920fa3b3-f87c-4d50-9634-84782c5fe5d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 16:11:35 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c03b23-1441-45c9-ae33-7c1f0364a662]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:11:35 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6d36d4fb-2aa1-4675-af5b-92e366f489a7 tempest-TestStampPattern-164519336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-920fa3b3-f87c-4d50-9634-84782c5fe5d7 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:11:35 devstack sudo[111010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-920fa3b3-f87c-4d50-9634-84782c5fe5d7
Jun 15 16:11:35 devstack sudo[111010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:11:36 devstack sudo[111010]: pam_unix(sudo:session): session closed for user root
Jun 15 16:11:36 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6d36d4fb-2aa1-4675-af5b-92e366f489a7 tempest-TestStampPattern-164519336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-920fa3b3-f87c-4d50-9634-84782c5fe5d7" returned: 0 in 0.765s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:11:36 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6d36d4fb-2aa1-4675-af5b-92e366f489a7 tempest-TestStampPattern-164519336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-920fa3b3-f87c-4d50-9634-84782c5fe5d7.5d075000-4060-4dc8-b92f-aa89ce07edf6 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:11:36 devstack sudo[111015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-920fa3b3-f87c-4d50-9634-84782c5fe5d7.5d075000-4060-4dc8-b92f-aa89ce07edf6
Jun 15 16:11:36 devstack sudo[111015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:11:36 devstack sudo[111015]: pam_unix(sudo:session): session closed for user root
Jun 15 16:11:36 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6d36d4fb-2aa1-4675-af5b-92e366f489a7 tempest-TestStampPattern-164519336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-920fa3b3-f87c-4d50-9634-84782c5fe5d7.5d075000-4060-4dc8-b92f-aa89ce07edf6" returned: 0 in 0.651s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:11:36 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6d36d4fb-2aa1-4675-af5b-92e366f489a7 tempest-TestStampPattern-164519336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-920fa3b3-f87c-4d50-9634-84782c5fe5d7.5d075000-4060-4dc8-b92f-aa89ce07edf6 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:11:36 devstack sudo[111020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-920fa3b3-f87c-4d50-9634-84782c5fe5d7.5d075000-4060-4dc8-b92f-aa89ce07edf6
Jun 15 16:11:36 devstack sudo[111020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:11:37 devstack sudo[111020]: pam_unix(sudo:session): session closed for user root
Jun 15 16:11:37 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6d36d4fb-2aa1-4675-af5b-92e366f489a7 tempest-TestStampPattern-164519336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-920fa3b3-f87c-4d50-9634-84782c5fe5d7.5d075000-4060-4dc8-b92f-aa89ce07edf6" returned: 0 in 0.635s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:11:37 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-6d36d4fb-2aa1-4675-af5b-92e366f489a7 tempest-TestStampPattern-164519336 None] Lock "cinder-quobyte-5d075000-4060-4dc8-b92f-aa89ce07edf6" released by "_delete_snapshot" :: held 2.881s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:11:37 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-6d36d4fb-2aa1-4675-af5b-92e366f489a7 tempest-TestStampPattern-164519336 None] Lock "cinder-quobyte-920fa3b3-f87c-4d50-9634-84782c5fe5d7" released by "delete_snapshot" :: held 2.902s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:11:37 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-6d36d4fb-2aa1-4675-af5b-92e366f489a7 tempest-TestStampPattern-164519336 None] Created reservations ['f84a32bb-9808-4d52-b331-b2dba24c621f', '47e74ffd-ef17-4ea6-90e9-d3fef96a5088', 'c0ad7a70-19c4-4ea6-9229-4c80b9fa7c7f', '525e62b3-afd4-45a0-aad0-d306d476e794'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 16:11:37 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-6d36d4fb-2aa1-4675-af5b-92e366f489a7 tempest-TestStampPattern-164519336 None] Delete snapshot completed successfully.
Jun 15 16:11:37 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-6d36d4fb-2aa1-4675-af5b-92e366f489a7 tempest-TestStampPattern-164519336 None] Lock "cinder-5d075000-4060-4dc8-b92f-aa89ce07edf6-delete_snapshot" released by "delete_snapshot" :: held 3.017s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:11:44 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-a2818c51-5ca4-4779-a090-33b9bb31a444 tempest-TestStampPattern-164519336 None] Acquiring lock "cinder-920fa3b3-f87c-4d50-9634-84782c5fe5d7-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:11:44 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-a2818c51-5ca4-4779-a090-33b9bb31a444 tempest-TestStampPattern-164519336 None] Lock "cinder-920fa3b3-f87c-4d50-9634-84782c5fe5d7-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:11:44 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-a2818c51-5ca4-4779-a090-33b9bb31a444 tempest-TestStampPattern-164519336 None] Acquiring lock "cinder-quobyte-920fa3b3-f87c-4d50-9634-84782c5fe5d7" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:11:44 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-a2818c51-5ca4-4779-a090-33b9bb31a444 tempest-TestStampPattern-164519336 None] Lock "cinder-quobyte-920fa3b3-f87c-4d50-9634-84782c5fe5d7" acquired by "delete_volume" :: waited 0.018s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:11:44 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[82cc8ba2-3663-4cc4-89ec-f3dbf9346894]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:11:44 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-a2818c51-5ca4-4779-a090-33b9bb31a444 tempest-TestStampPattern-164519336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-920fa3b3-f87c-4d50-9634-84782c5fe5d7 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:11:45 devstack sudo[111103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-920fa3b3-f87c-4d50-9634-84782c5fe5d7
Jun 15 16:11:45 devstack sudo[111103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:11:45 devstack sudo[111103]: pam_unix(sudo:session): session closed for user root
Jun 15 16:11:45 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-a2818c51-5ca4-4779-a090-33b9bb31a444 tempest-TestStampPattern-164519336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-920fa3b3-f87c-4d50-9634-84782c5fe5d7" returned: 0 in 0.778s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:11:45 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-a2818c51-5ca4-4779-a090-33b9bb31a444 tempest-TestStampPattern-164519336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-920fa3b3-f87c-4d50-9634-84782c5fe5d7 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:11:45 devstack sudo[111109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-920fa3b3-f87c-4d50-9634-84782c5fe5d7
Jun 15 16:11:45 devstack sudo[111109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:11:46 devstack sudo[111109]: pam_unix(sudo:session): session closed for user root
Jun 15 16:11:46 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-a2818c51-5ca4-4779-a090-33b9bb31a444 tempest-TestStampPattern-164519336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-920fa3b3-f87c-4d50-9634-84782c5fe5d7" returned: 0 in 0.610s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:11:46 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-a2818c51-5ca4-4779-a090-33b9bb31a444 tempest-TestStampPattern-164519336 None] Lock "cinder-quobyte-920fa3b3-f87c-4d50-9634-84782c5fe5d7" released by "delete_volume" :: held 1.447s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:11:46 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-a2818c51-5ca4-4779-a090-33b9bb31a444 tempest-TestStampPattern-164519336 None] Created reservations ['35ddeb4c-32af-4145-a51f-6f989bcfdcd3', '445aa898-a6f0-45b8-aaa8-7e64febc0d44', 'f1901cb3-b822-48f7-a9f9-688e9ea09067', '04d8389a-074c-4fb1-8171-5b2bcd0edba2'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 16:11:46 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-a2818c51-5ca4-4779-a090-33b9bb31a444 tempest-TestStampPattern-164519336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:11:46 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-a2818c51-5ca4-4779-a090-33b9bb31a444 tempest-TestStampPattern-164519336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:11:46 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-a2818c51-5ca4-4779-a090-33b9bb31a444 tempest-TestStampPattern-164519336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:11:46 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-a2818c51-5ca4-4779-a090-33b9bb31a444 tempest-TestStampPattern-164519336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:11:46 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-a2818c51-5ca4-4779-a090-33b9bb31a444 tempest-TestStampPattern-164519336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:11:46 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-a2818c51-5ca4-4779-a090-33b9bb31a444 tempest-TestStampPattern-164519336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:11:46 devstack sudo[111112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 16:11:46 devstack sudo[111112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:11:47 devstack sudo[111112]: pam_unix(sudo:session): session closed for user root
Jun 15 16:11:47 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-a2818c51-5ca4-4779-a090-33b9bb31a444 tempest-TestStampPattern-164519336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.565s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:11:47 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-a2818c51-5ca4-4779-a090-33b9bb31a444 tempest-TestStampPattern-164519336 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 16:11:47 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-a2818c51-5ca4-4779-a090-33b9bb31a444 tempest-TestStampPattern-164519336 None] Deleted volume successfully.
Jun 15 16:11:47 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-a2818c51-5ca4-4779-a090-33b9bb31a444 tempest-TestStampPattern-164519336 None] Lock "cinder-920fa3b3-f87c-4d50-9634-84782c5fe5d7-delete_volume" released by "delete_volume" :: held 2.207s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:11:56 devstack cinder-volume[91863]: DEBUG dbcounter [-] [91863] Writing DB stats cinder:SELECT=22,cinder:UPDATE=25,cinder:INSERT=6 {{(pid=91863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 16:11:57 devstack cinder-volume[91863]: DEBUG dbcounter [-] [91863] Writing DB stats cinder:SELECT=22,cinder:UPDATE=21,cinder:INSERT=6,cinder:DELETE=2 {{(pid=91863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 16:12:06 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e526e94-da1d-4a7b-8d40-dedeb86fa529 tempest-CreateVolumesFromImageTest-986482857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 16:12:06 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-9e526e94-da1d-4a7b-8d40-dedeb86fa529 tempest-CreateVolumesFromImageTest-986482857 None] Flow 'volume_create_manager' (b1b007cb-a451-4ab1-b330-d92aa125fb33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:12:06 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-9e526e94-da1d-4a7b-8d40-dedeb86fa529 tempest-CreateVolumesFromImageTest-986482857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (886877fb-95c2-453e-a957-64d4c8fda42a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:06 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-9e526e94-da1d-4a7b-8d40-dedeb86fa529 tempest-CreateVolumesFromImageTest-986482857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (886877fb-95c2-453e-a957-64d4c8fda42a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:12:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1199973503',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47643711-cc07-430c-8a9f-259fa89d74d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0b297f8c14c46c08eeed01d0f5643d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:12:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:12:06Z,use_quota=True,user_id='1727697b78ce40cc91ad158aa625cde5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:06 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-9e526e94-da1d-4a7b-8d40-dedeb86fa529 tempest-CreateVolumesFromImageTest-986482857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18c3c9c6-58aa-4e9a-9822-fbf3f6172642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:06 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-9e526e94-da1d-4a7b-8d40-dedeb86fa529 tempest-CreateVolumesFromImageTest-986482857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18c3c9c6-58aa-4e9a-9822-fbf3f6172642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:06 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-9e526e94-da1d-4a7b-8d40-dedeb86fa529 tempest-CreateVolumesFromImageTest-986482857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9e7f6c3-0411-47a8-98e2-743c5eb95c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:06 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-9e526e94-da1d-4a7b-8d40-dedeb86fa529 tempest-CreateVolumesFromImageTest-986482857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9e7f6c3-0411-47a8-98e2-743c5eb95c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47643711-cc07-430c-8a9f-259fa89d74d2', 'volume_name': 'volume-47643711-cc07-430c-8a9f-259fa89d74d2', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:06 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-9e526e94-da1d-4a7b-8d40-dedeb86fa529 tempest-CreateVolumesFromImageTest-986482857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47753942-f726-44be-82c9-3de5e12e632a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:06 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-9e526e94-da1d-4a7b-8d40-dedeb86fa529 tempest-CreateVolumesFromImageTest-986482857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47753942-f726-44be-82c9-3de5e12e632a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:06 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-9e526e94-da1d-4a7b-8d40-dedeb86fa529 tempest-CreateVolumesFromImageTest-986482857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25855241-e5b7-4c08-bd42-66f84e35852a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:06 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-9e526e94-da1d-4a7b-8d40-dedeb86fa529 tempest-CreateVolumesFromImageTest-986482857 None] Volume 47643711-cc07-430c-8a9f-259fa89d74d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47643711-cc07-430c-8a9f-259fa89d74d2', 'volume_size': 1}
Jun 15 16:12:06 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-9e526e94-da1d-4a7b-8d40-dedeb86fa529 tempest-CreateVolumesFromImageTest-986482857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:12:06 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-9e526e94-da1d-4a7b-8d40-dedeb86fa529 tempest-CreateVolumesFromImageTest-986482857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:12:06 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-9e526e94-da1d-4a7b-8d40-dedeb86fa529 tempest-CreateVolumesFromImageTest-986482857 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:12:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1199973503',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47643711-cc07-430c-8a9f-259fa89d74d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0b297f8c14c46c08eeed01d0f5643d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:12:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:12:06Z,use_quota=True,user_id='1727697b78ce40cc91ad158aa625cde5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 16:12:06 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-9e526e94-da1d-4a7b-8d40-dedeb86fa529 tempest-CreateVolumesFromImageTest-986482857 None] Creating volume 47643711-cc07-430c-8a9f-259fa89d74d2 {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 16:12:06 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-9e526e94-da1d-4a7b-8d40-dedeb86fa529 tempest-CreateVolumesFromImageTest-986482857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:12:06 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-9e526e94-da1d-4a7b-8d40-dedeb86fa529 tempest-CreateVolumesFromImageTest-986482857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:12:06 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-9e526e94-da1d-4a7b-8d40-dedeb86fa529 tempest-CreateVolumesFromImageTest-986482857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:12:06 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-9e526e94-da1d-4a7b-8d40-dedeb86fa529 tempest-CreateVolumesFromImageTest-986482857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:12:06 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-9e526e94-da1d-4a7b-8d40-dedeb86fa529 tempest-CreateVolumesFromImageTest-986482857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:12:06 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-9e526e94-da1d-4a7b-8d40-dedeb86fa529 tempest-CreateVolumesFromImageTest-986482857 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 16:12:06 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-9e526e94-da1d-4a7b-8d40-dedeb86fa529 tempest-CreateVolumesFromImageTest-986482857 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 16:12:06 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-9e526e94-da1d-4a7b-8d40-dedeb86fa529 tempest-CreateVolumesFromImageTest-986482857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-47643711-cc07-430c-8a9f-259fa89d74d2 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:06 devstack sudo[111163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-47643711-cc07-430c-8a9f-259fa89d74d2 1073741824
Jun 15 16:12:06 devstack sudo[111163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:06 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-55651b7b-e6b6-4784-9f6d-256432b398b9 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 16:12:06 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-55651b7b-e6b6-4784-9f6d-256432b398b9 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Flow 'volume_create_manager' (1f5666e0-3b9b-4e46-af4c-1ba608ba1804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:12:06 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-55651b7b-e6b6-4784-9f6d-256432b398b9 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f17e1d96-b669-4a07-8564-82ad020434e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:06 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-55651b7b-e6b6-4784-9f6d-256432b398b9 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f17e1d96-b669-4a07-8564-82ad020434e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:12:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-48306257',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8de4246-6e95-4261-b7f7-f9cebf889e2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34169552e47c463a988f18be3f6bbc19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:12:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:12:07Z,use_quota=True,user_id='44fc9edf90764e9088105b282bec206b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:06 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-55651b7b-e6b6-4784-9f6d-256432b398b9 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aac9619e-80d6-40fd-8e9d-082f311369cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:06 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-55651b7b-e6b6-4784-9f6d-256432b398b9 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aac9619e-80d6-40fd-8e9d-082f311369cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:06 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-55651b7b-e6b6-4784-9f6d-256432b398b9 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (758815ef-e804-437d-9660-6e4e47a94311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:06 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-55651b7b-e6b6-4784-9f6d-256432b398b9 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (758815ef-e804-437d-9660-6e4e47a94311) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8de4246-6e95-4261-b7f7-f9cebf889e2c', 'volume_name': 'volume-d8de4246-6e95-4261-b7f7-f9cebf889e2c', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:06 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-55651b7b-e6b6-4784-9f6d-256432b398b9 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e89d8c26-fcac-4b47-a0b3-9c400175ba53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:06 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-55651b7b-e6b6-4784-9f6d-256432b398b9 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e89d8c26-fcac-4b47-a0b3-9c400175ba53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:06 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-55651b7b-e6b6-4784-9f6d-256432b398b9 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79d4e0df-f328-4e26-b0e4-c2da39cb1ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:06 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-55651b7b-e6b6-4784-9f6d-256432b398b9 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Volume d8de4246-6e95-4261-b7f7-f9cebf889e2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8de4246-6e95-4261-b7f7-f9cebf889e2c', 'volume_size': 1}
Jun 15 16:12:06 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-55651b7b-e6b6-4784-9f6d-256432b398b9 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:12:06 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ac486eb-0913-41dd-9a62-66a40c895415 tempest-CreateVolumesFromImageTest-986482857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 16:12:07 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8ac486eb-0913-41dd-9a62-66a40c895415 tempest-CreateVolumesFromImageTest-986482857 None] Flow 'volume_create_manager' (f2097805-481e-4707-ad93-ff7601420873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:12:07 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8ac486eb-0913-41dd-9a62-66a40c895415 tempest-CreateVolumesFromImageTest-986482857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80ab9955-60fa-4858-b533-f5363aa00100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:07 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8ac486eb-0913-41dd-9a62-66a40c895415 tempest-CreateVolumesFromImageTest-986482857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80ab9955-60fa-4858-b533-f5363aa00100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:12:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1588413017',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21f37e2a-55e9-4921-a9d0-cc402cb29d27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0b297f8c14c46c08eeed01d0f5643d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:12:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:12:07Z,use_quota=True,user_id='1727697b78ce40cc91ad158aa625cde5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:07 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8ac486eb-0913-41dd-9a62-66a40c895415 tempest-CreateVolumesFromImageTest-986482857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (363e2f4a-1760-41cc-a3bd-fd18bcc5dedd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:07 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8ac486eb-0913-41dd-9a62-66a40c895415 tempest-CreateVolumesFromImageTest-986482857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (363e2f4a-1760-41cc-a3bd-fd18bcc5dedd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:07 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8ac486eb-0913-41dd-9a62-66a40c895415 tempest-CreateVolumesFromImageTest-986482857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (012b1e4f-5f0c-4ef5-b1f5-c8c931910120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:07 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8ac486eb-0913-41dd-9a62-66a40c895415 tempest-CreateVolumesFromImageTest-986482857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (012b1e4f-5f0c-4ef5-b1f5-c8c931910120) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21f37e2a-55e9-4921-a9d0-cc402cb29d27', 'volume_name': 'volume-21f37e2a-55e9-4921-a9d0-cc402cb29d27', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:07 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8ac486eb-0913-41dd-9a62-66a40c895415 tempest-CreateVolumesFromImageTest-986482857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c65a7c4-154e-47df-af02-197e6cff2b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:07 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8ac486eb-0913-41dd-9a62-66a40c895415 tempest-CreateVolumesFromImageTest-986482857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c65a7c4-154e-47df-af02-197e6cff2b4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:07 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8ac486eb-0913-41dd-9a62-66a40c895415 tempest-CreateVolumesFromImageTest-986482857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20230030-1b7e-435a-94f3-805dd7514802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:07 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-8ac486eb-0913-41dd-9a62-66a40c895415 tempest-CreateVolumesFromImageTest-986482857 None] Volume 21f37e2a-55e9-4921-a9d0-cc402cb29d27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21f37e2a-55e9-4921-a9d0-cc402cb29d27', 'volume_size': 1}
Jun 15 16:12:07 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-8ac486eb-0913-41dd-9a62-66a40c895415 tempest-CreateVolumesFromImageTest-986482857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:12:07 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f2aa886-3d84-458b-aa62-1021c026a686 tempest-CreateVolumesFromImageTest-986482857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 16:12:07 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-0f2aa886-3d84-458b-aa62-1021c026a686 tempest-CreateVolumesFromImageTest-986482857 None] Flow 'volume_create_manager' (d53121f5-342d-450d-8740-a61e026b945f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:12:07 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-0f2aa886-3d84-458b-aa62-1021c026a686 tempest-CreateVolumesFromImageTest-986482857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7284cea2-fa95-43dd-831c-6f2f92136673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:07 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-0f2aa886-3d84-458b-aa62-1021c026a686 tempest-CreateVolumesFromImageTest-986482857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7284cea2-fa95-43dd-831c-6f2f92136673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:12:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1779581043',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb40da53-da6b-4838-ab3e-4c52c68f9626,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0b297f8c14c46c08eeed01d0f5643d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:12:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:12:07Z,use_quota=True,user_id='1727697b78ce40cc91ad158aa625cde5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:07 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-0f2aa886-3d84-458b-aa62-1021c026a686 tempest-CreateVolumesFromImageTest-986482857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2130809-1bdb-4f09-8fbc-22f8af997c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:07 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-0f2aa886-3d84-458b-aa62-1021c026a686 tempest-CreateVolumesFromImageTest-986482857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2130809-1bdb-4f09-8fbc-22f8af997c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:07 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-0f2aa886-3d84-458b-aa62-1021c026a686 tempest-CreateVolumesFromImageTest-986482857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6870afd-4613-4eb1-92e6-0a5e7df64f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:07 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-0f2aa886-3d84-458b-aa62-1021c026a686 tempest-CreateVolumesFromImageTest-986482857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6870afd-4613-4eb1-92e6-0a5e7df64f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb40da53-da6b-4838-ab3e-4c52c68f9626', 'volume_name': 'volume-eb40da53-da6b-4838-ab3e-4c52c68f9626', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:07 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-0f2aa886-3d84-458b-aa62-1021c026a686 tempest-CreateVolumesFromImageTest-986482857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3bceb0e-0d06-42b4-816b-ddc73e0b1048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:07 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-0f2aa886-3d84-458b-aa62-1021c026a686 tempest-CreateVolumesFromImageTest-986482857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3bceb0e-0d06-42b4-816b-ddc73e0b1048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:07 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-0f2aa886-3d84-458b-aa62-1021c026a686 tempest-CreateVolumesFromImageTest-986482857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e475155-41ae-43fe-b237-79878e674e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:07 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-0f2aa886-3d84-458b-aa62-1021c026a686 tempest-CreateVolumesFromImageTest-986482857 None] Volume eb40da53-da6b-4838-ab3e-4c52c68f9626: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb40da53-da6b-4838-ab3e-4c52c68f9626', 'volume_size': 1}
Jun 15 16:12:07 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-0f2aa886-3d84-458b-aa62-1021c026a686 tempest-CreateVolumesFromImageTest-986482857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:12:08 devstack sudo[111163]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:08 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f137b64-b1b2-48d6-bf4a-a88ae96ea335 tempest-CreateVolumesFromImageTest-986482857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 16:12:08 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-4f137b64-b1b2-48d6-bf4a-a88ae96ea335 tempest-CreateVolumesFromImageTest-986482857 None] Flow 'volume_create_manager' (b0d6fc88-c4f6-42e4-9078-1e8c466f5784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:12:08 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-4f137b64-b1b2-48d6-bf4a-a88ae96ea335 tempest-CreateVolumesFromImageTest-986482857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39241053-c570-4f5d-a0db-3ee237c7c0be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:08 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-9e526e94-da1d-4a7b-8d40-dedeb86fa529 tempest-CreateVolumesFromImageTest-986482857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-47643711-cc07-430c-8a9f-259fa89d74d2 1073741824" returned: 0 in 1.447s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:08 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-4f137b64-b1b2-48d6-bf4a-a88ae96ea335 tempest-CreateVolumesFromImageTest-986482857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39241053-c570-4f5d-a0db-3ee237c7c0be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:12:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-624356694',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43e6e8a2-f6a3-4797-83c2-266dfb86abe8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0b297f8c14c46c08eeed01d0f5643d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:12:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:12:08Z,use_quota=True,user_id='1727697b78ce40cc91ad158aa625cde5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:08 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-4f137b64-b1b2-48d6-bf4a-a88ae96ea335 tempest-CreateVolumesFromImageTest-986482857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fb98eda-5d70-40cb-b508-bcbc9cc9f17b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:08 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-4f137b64-b1b2-48d6-bf4a-a88ae96ea335 tempest-CreateVolumesFromImageTest-986482857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fb98eda-5d70-40cb-b508-bcbc9cc9f17b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:08 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-4f137b64-b1b2-48d6-bf4a-a88ae96ea335 tempest-CreateVolumesFromImageTest-986482857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (105e3dad-30a7-49a5-be56-369603dae896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:08 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-4f137b64-b1b2-48d6-bf4a-a88ae96ea335 tempest-CreateVolumesFromImageTest-986482857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (105e3dad-30a7-49a5-be56-369603dae896) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43e6e8a2-f6a3-4797-83c2-266dfb86abe8', 'volume_name': 'volume-43e6e8a2-f6a3-4797-83c2-266dfb86abe8', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:08 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-4f137b64-b1b2-48d6-bf4a-a88ae96ea335 tempest-CreateVolumesFromImageTest-986482857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e73d213d-f424-4c52-a504-abd97460dbfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:08 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-4f137b64-b1b2-48d6-bf4a-a88ae96ea335 tempest-CreateVolumesFromImageTest-986482857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e73d213d-f424-4c52-a504-abd97460dbfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:08 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-4f137b64-b1b2-48d6-bf4a-a88ae96ea335 tempest-CreateVolumesFromImageTest-986482857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5985eec8-1aa4-42fd-8035-36350f462058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:08 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-4f137b64-b1b2-48d6-bf4a-a88ae96ea335 tempest-CreateVolumesFromImageTest-986482857 None] Volume 43e6e8a2-f6a3-4797-83c2-266dfb86abe8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43e6e8a2-f6a3-4797-83c2-266dfb86abe8', 'volume_size': 1}
Jun 15 16:12:08 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-4f137b64-b1b2-48d6-bf4a-a88ae96ea335 tempest-CreateVolumesFromImageTest-986482857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:12:08 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-9e526e94-da1d-4a7b-8d40-dedeb86fa529 tempest-CreateVolumesFromImageTest-986482857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-47643711-cc07-430c-8a9f-259fa89d74d2 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:08 devstack sudo[111169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-47643711-cc07-430c-8a9f-259fa89d74d2
Jun 15 16:12:08 devstack sudo[111169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:08 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-80c8a1fd-6263-4849-bd88-fd3d9d7708af tempest-CreateVolumesFromImageTest-986482857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 16:12:08 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-80c8a1fd-6263-4849-bd88-fd3d9d7708af tempest-CreateVolumesFromImageTest-986482857 None] Flow 'volume_create_manager' (f36f4472-7a0e-495d-b45a-aeee00b6ba9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:12:08 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-80c8a1fd-6263-4849-bd88-fd3d9d7708af tempest-CreateVolumesFromImageTest-986482857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (607708c4-a7c8-455c-9e83-0652cf4b1847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:08 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-80c8a1fd-6263-4849-bd88-fd3d9d7708af tempest-CreateVolumesFromImageTest-986482857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (607708c4-a7c8-455c-9e83-0652cf4b1847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:12:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-548001396',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc7da5df-aabc-4ca4-a374-5a5e57b95bd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0b297f8c14c46c08eeed01d0f5643d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:12:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:12:08Z,use_quota=True,user_id='1727697b78ce40cc91ad158aa625cde5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:08 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-80c8a1fd-6263-4849-bd88-fd3d9d7708af tempest-CreateVolumesFromImageTest-986482857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (431d9b68-44a3-43ba-912d-a70090779079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:08 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-80c8a1fd-6263-4849-bd88-fd3d9d7708af tempest-CreateVolumesFromImageTest-986482857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (431d9b68-44a3-43ba-912d-a70090779079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:08 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-80c8a1fd-6263-4849-bd88-fd3d9d7708af tempest-CreateVolumesFromImageTest-986482857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (022613a0-eb6f-495c-949b-361ae523a447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:08 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-80c8a1fd-6263-4849-bd88-fd3d9d7708af tempest-CreateVolumesFromImageTest-986482857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (022613a0-eb6f-495c-949b-361ae523a447) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc7da5df-aabc-4ca4-a374-5a5e57b95bd8', 'volume_name': 'volume-cc7da5df-aabc-4ca4-a374-5a5e57b95bd8', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:08 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-80c8a1fd-6263-4849-bd88-fd3d9d7708af tempest-CreateVolumesFromImageTest-986482857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16ec5899-9ccd-4096-9532-17aaefd3c755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:08 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-80c8a1fd-6263-4849-bd88-fd3d9d7708af tempest-CreateVolumesFromImageTest-986482857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16ec5899-9ccd-4096-9532-17aaefd3c755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:08 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-80c8a1fd-6263-4849-bd88-fd3d9d7708af tempest-CreateVolumesFromImageTest-986482857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d585347-6aec-4ddd-b5ea-cbeb5027c147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:08 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-80c8a1fd-6263-4849-bd88-fd3d9d7708af tempest-CreateVolumesFromImageTest-986482857 None] Volume cc7da5df-aabc-4ca4-a374-5a5e57b95bd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc7da5df-aabc-4ca4-a374-5a5e57b95bd8', 'volume_size': 1}
Jun 15 16:12:08 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-80c8a1fd-6263-4849-bd88-fd3d9d7708af tempest-CreateVolumesFromImageTest-986482857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:12:08 devstack sudo[111169]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:08 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-9e526e94-da1d-4a7b-8d40-dedeb86fa529 tempest-CreateVolumesFromImageTest-986482857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-47643711-cc07-430c-8a9f-259fa89d74d2" returned: 0 in 0.713s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:08 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-9e526e94-da1d-4a7b-8d40-dedeb86fa529 tempest-CreateVolumesFromImageTest-986482857 None] <== create_volume: return (2298ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 16:12:08 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-9e526e94-da1d-4a7b-8d40-dedeb86fa529 tempest-CreateVolumesFromImageTest-986482857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.300s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:12:08 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-55651b7b-e6b6-4784-9f6d-256432b398b9 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.132s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:12:08 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-55651b7b-e6b6-4784-9f6d-256432b398b9 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:12:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-48306257',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8de4246-6e95-4261-b7f7-f9cebf889e2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34169552e47c463a988f18be3f6bbc19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:12:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:12:07Z,use_quota=True,user_id='44fc9edf90764e9088105b282bec206b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 16:12:08 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-55651b7b-e6b6-4784-9f6d-256432b398b9 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Creating volume d8de4246-6e95-4261-b7f7-f9cebf889e2c {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 16:12:08 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-55651b7b-e6b6-4784-9f6d-256432b398b9 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:12:08 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-55651b7b-e6b6-4784-9f6d-256432b398b9 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:12:08 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-55651b7b-e6b6-4784-9f6d-256432b398b9 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:12:08 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-55651b7b-e6b6-4784-9f6d-256432b398b9 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:12:08 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-55651b7b-e6b6-4784-9f6d-256432b398b9 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:12:08 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-55651b7b-e6b6-4784-9f6d-256432b398b9 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 16:12:08 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-55651b7b-e6b6-4784-9f6d-256432b398b9 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 16:12:08 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-55651b7b-e6b6-4784-9f6d-256432b398b9 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-d8de4246-6e95-4261-b7f7-f9cebf889e2c 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:09 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-9e526e94-da1d-4a7b-8d40-dedeb86fa529 tempest-CreateVolumesFromImageTest-986482857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25855241-e5b7-4c08-bd42-66f84e35852a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47643711-cc07-430c-8a9f-259fa89d74d2', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:09 devstack sudo[111172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-d8de4246-6e95-4261-b7f7-f9cebf889e2c 1073741824
Jun 15 16:12:09 devstack sudo[111172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:09 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-9e526e94-da1d-4a7b-8d40-dedeb86fa529 tempest-CreateVolumesFromImageTest-986482857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (266ed84b-14e0-4c2b-a0ba-0d1fc23b25f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:09 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-9e526e94-da1d-4a7b-8d40-dedeb86fa529 tempest-CreateVolumesFromImageTest-986482857 None] Volume volume-47643711-cc07-430c-8a9f-259fa89d74d2 (47643711-cc07-430c-8a9f-259fa89d74d2): created successfully
Jun 15 16:12:09 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-9e526e94-da1d-4a7b-8d40-dedeb86fa529 tempest-CreateVolumesFromImageTest-986482857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (266ed84b-14e0-4c2b-a0ba-0d1fc23b25f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:09 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-9e526e94-da1d-4a7b-8d40-dedeb86fa529 tempest-CreateVolumesFromImageTest-986482857 None] Flow 'volume_create_manager' (b1b007cb-a451-4ab1-b330-d92aa125fb33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:12:09 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-9e526e94-da1d-4a7b-8d40-dedeb86fa529 tempest-CreateVolumesFromImageTest-986482857 None] Created volume successfully.
Jun 15 16:12:09 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e16110a-351f-422a-9307-62e02d26d185 tempest-VolumeImageDependencyTests-761867979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 16:12:09 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-1e16110a-351f-422a-9307-62e02d26d185 tempest-VolumeImageDependencyTests-761867979 None] Flow 'volume_create_manager' (35c5f6a6-c129-4285-81ce-d9c0e2e9b6b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:12:09 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-1e16110a-351f-422a-9307-62e02d26d185 tempest-VolumeImageDependencyTests-761867979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d3fcb87-7ce6-4836-8d44-c367a88c21c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:09 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-1e16110a-351f-422a-9307-62e02d26d185 tempest-VolumeImageDependencyTests-761867979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d3fcb87-7ce6-4836-8d44-c367a88c21c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:12:10Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c130995e-792e-41cc-983d-cee5247ae06b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4479a314d37d4603b317eba55c4f7c13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:12:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:12:10Z,use_quota=True,user_id='1def98cb552845cb9d2fdb91ed95a9bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:09 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-1e16110a-351f-422a-9307-62e02d26d185 tempest-VolumeImageDependencyTests-761867979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d96f7d46-55b1-4d2e-a5f6-e16a8864ab36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:09 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-1e16110a-351f-422a-9307-62e02d26d185 tempest-VolumeImageDependencyTests-761867979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d96f7d46-55b1-4d2e-a5f6-e16a8864ab36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:09 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-1e16110a-351f-422a-9307-62e02d26d185 tempest-VolumeImageDependencyTests-761867979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e798416-988c-4422-b8f5-60d509a8b5a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:09 devstack cinder-volume[91863]: DEBUG cinder.image.glance [None req-1e16110a-351f-422a-9307-62e02d26d185 tempest-VolumeImageDependencyTests-761867979 None] Creating Keystone auth plugin from conf {{(pid=91863) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 15 16:12:09 devstack sudo[111172]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:09 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-55651b7b-e6b6-4784-9f6d-256432b398b9 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-d8de4246-6e95-4261-b7f7-f9cebf889e2c 1073741824" returned: 0 in 0.976s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:09 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-55651b7b-e6b6-4784-9f6d-256432b398b9 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-d8de4246-6e95-4261-b7f7-f9cebf889e2c {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:10 devstack sudo[111178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-d8de4246-6e95-4261-b7f7-f9cebf889e2c
Jun 15 16:12:10 devstack sudo[111178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:10 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-1e16110a-351f-422a-9307-62e02d26d185 tempest-VolumeImageDependencyTests-761867979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e798416-988c-4422-b8f5-60d509a8b5a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c130995e-792e-41cc-983d-cee5247ae06b', 'volume_name': 'volume-c130995e-792e-41cc-983d-cee5247ae06b', 'volume_size': 1, 'image_id': '90cfc52a-50f6-4fb9-b3d1-9b0d2193e47c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/90cfc52a-50f6-4fb9-b3d1-9b0d2193e47c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'dbb44614329982eebd0dc4acdabd0105', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4479a314d37d4603b317eba55c4f7c13', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1730567f3408a789a91a30a37fed3c160d0130ea3e94711d6f82f7754099b7e1e5b4a405a36a4d04f7506dc4515200144b5a0f108a65d4967af488aa9892facc', 'id': '90cfc52a-50f6-4fb9-b3d1-9b0d2193e47c', 'created_at': datetime.datetime(2026, 6, 15, 14, 12, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 14, 12, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/90cfc52a-50f6-4fb9-b3d1-9b0d2193e47c/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x77394a4452b0>}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:10 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-1e16110a-351f-422a-9307-62e02d26d185 tempest-VolumeImageDependencyTests-761867979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de56ee3d-c674-4bb0-8a0d-fcd0696c3703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:10 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-1e16110a-351f-422a-9307-62e02d26d185 tempest-VolumeImageDependencyTests-761867979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de56ee3d-c674-4bb0-8a0d-fcd0696c3703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:10 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-1e16110a-351f-422a-9307-62e02d26d185 tempest-VolumeImageDependencyTests-761867979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (424ef7ce-22b2-4be7-9443-3b08854cd8a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:10 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-1e16110a-351f-422a-9307-62e02d26d185 tempest-VolumeImageDependencyTests-761867979 None] Volume c130995e-792e-41cc-983d-cee5247ae06b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c130995e-792e-41cc-983d-cee5247ae06b', 'volume_size': 1, 'image_id': '90cfc52a-50f6-4fb9-b3d1-9b0d2193e47c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/90cfc52a-50f6-4fb9-b3d1-9b0d2193e47c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'dbb44614329982eebd0dc4acdabd0105', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4479a314d37d4603b317eba55c4f7c13', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1730567f3408a789a91a30a37fed3c160d0130ea3e94711d6f82f7754099b7e1e5b4a405a36a4d04f7506dc4515200144b5a0f108a65d4967af488aa9892facc', 'id': '90cfc52a-50f6-4fb9-b3d1-9b0d2193e47c', 'created_at': datetime.datetime(2026, 6, 15, 14, 12, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 14, 12, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/90cfc52a-50f6-4fb9-b3d1-9b0d2193e47c/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x77394a4452b0>}
Jun 15 16:12:10 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e16110a-351f-422a-9307-62e02d26d185 tempest-VolumeImageDependencyTests-761867979 None] Trying to clone c130995e-792e-41cc-983d-cee5247ae06b from image 90cfc52a-50f6-4fb9-b3d1-9b0d2193e47c at location (None, [{'url': 'file:///opt/stack/data/glance/images/90cfc52a-50f6-4fb9-b3d1-9b0d2193e47c', 'metadata': {}}]). {{(pid=91863) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jun 15 16:12:10 devstack cinder-volume[91863]: DEBUG cinder.image.image_utils [None req-1e16110a-351f-422a-9307-62e02d26d185 tempest-VolumeImageDependencyTests-761867979 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_90cfc52a-50f6-4fb9-b3d1-9b0d2193e47c_z1szlnpndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=91863) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 15 16:12:10 devstack cinder-volume[91863]: INFO cinder.image.image_utils [None req-1e16110a-351f-422a-9307-62e02d26d185 tempest-VolumeImageDependencyTests-761867979 None] Image download 0.00 MB at 0.00 MB/s
Jun 15 16:12:10 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b613ecbc-34ef-414c-8f08-e4ed835a0435]: (4, 'raw') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:12:10 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-1e16110a-351f-422a-9307-62e02d26d185 tempest-VolumeImageDependencyTests-761867979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_90cfc52a-50f6-4fb9-b3d1-9b0d2193e47c_z1szlnpndevstack@QuobyteHD {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:10 devstack sudo[111180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_90cfc52a-50f6-4fb9-b3d1-9b0d2193e47c_z1szlnpndevstack@QuobyteHD
Jun 15 16:12:10 devstack sudo[111180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:10 devstack sudo[111178]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:10 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-55651b7b-e6b6-4784-9f6d-256432b398b9 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-d8de4246-6e95-4261-b7f7-f9cebf889e2c" returned: 0 in 0.673s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:10 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-55651b7b-e6b6-4784-9f6d-256432b398b9 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] <== create_volume: return (1696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 16:12:10 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-55651b7b-e6b6-4784-9f6d-256432b398b9 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.700s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:12:10 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-8ac486eb-0913-41dd-9a62-66a40c895415 tempest-CreateVolumesFromImageTest-986482857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.552s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:12:10 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-8ac486eb-0913-41dd-9a62-66a40c895415 tempest-CreateVolumesFromImageTest-986482857 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:12:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1588413017',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21f37e2a-55e9-4921-a9d0-cc402cb29d27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0b297f8c14c46c08eeed01d0f5643d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:12:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:12:07Z,use_quota=True,user_id='1727697b78ce40cc91ad158aa625cde5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 16:12:10 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-8ac486eb-0913-41dd-9a62-66a40c895415 tempest-CreateVolumesFromImageTest-986482857 None] Creating volume 21f37e2a-55e9-4921-a9d0-cc402cb29d27 {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 16:12:10 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-8ac486eb-0913-41dd-9a62-66a40c895415 tempest-CreateVolumesFromImageTest-986482857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:12:10 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-8ac486eb-0913-41dd-9a62-66a40c895415 tempest-CreateVolumesFromImageTest-986482857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:12:10 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-8ac486eb-0913-41dd-9a62-66a40c895415 tempest-CreateVolumesFromImageTest-986482857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:12:10 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-8ac486eb-0913-41dd-9a62-66a40c895415 tempest-CreateVolumesFromImageTest-986482857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:12:10 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-8ac486eb-0913-41dd-9a62-66a40c895415 tempest-CreateVolumesFromImageTest-986482857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:12:10 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-8ac486eb-0913-41dd-9a62-66a40c895415 tempest-CreateVolumesFromImageTest-986482857 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 16:12:10 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-8ac486eb-0913-41dd-9a62-66a40c895415 tempest-CreateVolumesFromImageTest-986482857 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 16:12:10 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-8ac486eb-0913-41dd-9a62-66a40c895415 tempest-CreateVolumesFromImageTest-986482857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-21f37e2a-55e9-4921-a9d0-cc402cb29d27 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:10 devstack sudo[111183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-21f37e2a-55e9-4921-a9d0-cc402cb29d27 1073741824
Jun 15 16:12:10 devstack sudo[111183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:10 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-55651b7b-e6b6-4784-9f6d-256432b398b9 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79d4e0df-f328-4e26-b0e4-c2da39cb1ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8de4246-6e95-4261-b7f7-f9cebf889e2c', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:10 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-55651b7b-e6b6-4784-9f6d-256432b398b9 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2844735-a641-4c0d-be50-2f9785c4320f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:10 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-c31a8b8b-a9e2-4db6-ae2e-046a7f4215ed tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 16:12:10 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-c31a8b8b-a9e2-4db6-ae2e-046a7f4215ed tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] Flow 'volume_create_manager' (3bb2a65d-2643-4d0e-870e-415e6352eab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:12:10 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-c31a8b8b-a9e2-4db6-ae2e-046a7f4215ed tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc2f3260-0c64-425a-9e04-4685f7932690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:10 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-55651b7b-e6b6-4784-9f6d-256432b398b9 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Volume volume-d8de4246-6e95-4261-b7f7-f9cebf889e2c (d8de4246-6e95-4261-b7f7-f9cebf889e2c): created successfully
Jun 15 16:12:10 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-55651b7b-e6b6-4784-9f6d-256432b398b9 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2844735-a641-4c0d-be50-2f9785c4320f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:10 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-55651b7b-e6b6-4784-9f6d-256432b398b9 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Flow 'volume_create_manager' (1f5666e0-3b9b-4e46-af4c-1ba608ba1804) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:12:10 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-c31a8b8b-a9e2-4db6-ae2e-046a7f4215ed tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc2f3260-0c64-425a-9e04-4685f7932690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:12:10Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d89e0e0-a019-419e-9e12-6aee4dbc88e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32d33ce746a14ec882cb31ac04bc5285',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:12:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:12:11Z,use_quota=True,user_id='ab33fd116d4c462f8e889f48c5aa2c1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6a1045de-7dc2-4902-939e-f3b2605b9298),volume_type_id=6a1045de-7dc2-4902-939e-f3b2605b9298)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:10 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-c31a8b8b-a9e2-4db6-ae2e-046a7f4215ed tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f625968-32d2-4e22-b764-99bbcde431a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:10 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-c31a8b8b-a9e2-4db6-ae2e-046a7f4215ed tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f625968-32d2-4e22-b764-99bbcde431a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:10 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-c31a8b8b-a9e2-4db6-ae2e-046a7f4215ed tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9dc9725-f107-4ae7-8a03-4fbe0b2d3034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:10 devstack cinder-volume[91863]: DEBUG cinder.image.glance [None req-c31a8b8b-a9e2-4db6-ae2e-046a7f4215ed tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] Creating Keystone auth plugin from conf {{(pid=91863) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 15 16:12:10 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-55651b7b-e6b6-4784-9f6d-256432b398b9 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Created volume successfully.
Jun 15 16:12:11 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-c31a8b8b-a9e2-4db6-ae2e-046a7f4215ed tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9dc9725-f107-4ae7-8a03-4fbe0b2d3034) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7d89e0e0-a019-419e-9e12-6aee4dbc88e1', 'volume_name': 'volume-7d89e0e0-a019-419e-9e12-6aee4dbc88e1', 'volume_size': 1, 'image_id': '39f5e834-44ad-4d59-bd8b-97ed9b791648', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/39f5e834-44ad-4d59-bd8b-97ed9b791648', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '70ce7c24a61df7d23c4047066433efab', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '32d33ce746a14ec882cb31ac04bc5285', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4449306190b2615438ea272a07ec54be3b8ae817053a94b2a9767c88c54cdb789a405cfadb7f9b4b27698b7e0da4b191543dd497feb1efce6b86105774c02711', 'id': '39f5e834-44ad-4d59-bd8b-97ed9b791648', 'created_at': datetime.datetime(2026, 6, 15, 14, 12, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 14, 12, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/39f5e834-44ad-4d59-bd8b-97ed9b791648/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x77394a254d10>}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:11 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-c31a8b8b-a9e2-4db6-ae2e-046a7f4215ed tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (308278f3-4139-47c3-bde4-5c629202f1ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:11 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-c31a8b8b-a9e2-4db6-ae2e-046a7f4215ed tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (308278f3-4139-47c3-bde4-5c629202f1ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:11 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-c31a8b8b-a9e2-4db6-ae2e-046a7f4215ed tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29d4229a-e481-4358-92a2-a8e47cdbcecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:11 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-c31a8b8b-a9e2-4db6-ae2e-046a7f4215ed tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] Volume 7d89e0e0-a019-419e-9e12-6aee4dbc88e1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7d89e0e0-a019-419e-9e12-6aee4dbc88e1', 'volume_size': 1, 'image_id': '39f5e834-44ad-4d59-bd8b-97ed9b791648', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/39f5e834-44ad-4d59-bd8b-97ed9b791648', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '70ce7c24a61df7d23c4047066433efab', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '32d33ce746a14ec882cb31ac04bc5285', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4449306190b2615438ea272a07ec54be3b8ae817053a94b2a9767c88c54cdb789a405cfadb7f9b4b27698b7e0da4b191543dd497feb1efce6b86105774c02711', 'id': '39f5e834-44ad-4d59-bd8b-97ed9b791648', 'created_at': datetime.datetime(2026, 6, 15, 14, 12, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 14, 12, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/39f5e834-44ad-4d59-bd8b-97ed9b791648/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x77394a254d10>}
Jun 15 16:12:11 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-c31a8b8b-a9e2-4db6-ae2e-046a7f4215ed tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] Trying to clone 7d89e0e0-a019-419e-9e12-6aee4dbc88e1 from image 39f5e834-44ad-4d59-bd8b-97ed9b791648 at location (None, [{'url': 'file:///opt/stack/data/glance/images/39f5e834-44ad-4d59-bd8b-97ed9b791648', 'metadata': {}}]). {{(pid=91863) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jun 15 16:12:11 devstack sudo[111180]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:11 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-1e16110a-351f-422a-9307-62e02d26d185 tempest-VolumeImageDependencyTests-761867979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_90cfc52a-50f6-4fb9-b3d1-9b0d2193e47c_z1szlnpndevstack@QuobyteHD" returned: 0 in 0.813s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:11 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-1e16110a-351f-422a-9307-62e02d26d185 tempest-VolumeImageDependencyTests-761867979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_90cfc52a-50f6-4fb9-b3d1-9b0d2193e47c_z1szlnpndevstack@QuobyteHD {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:11 devstack cinder-volume[91863]: DEBUG cinder.image.image_utils [None req-c31a8b8b-a9e2-4db6-ae2e-046a7f4215ed tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_39f5e834-44ad-4d59-bd8b-97ed9b791648_elh7751ldevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=91863) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 15 16:12:11 devstack cinder-volume[91863]: INFO cinder.image.image_utils [None req-c31a8b8b-a9e2-4db6-ae2e-046a7f4215ed tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] Image download 0.00 MB at 0.00 MB/s
Jun 15 16:12:11 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-04f3bc5d-2a6c-4cf8-965b-a65b02528688 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 16:12:11 devstack sudo[111187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_90cfc52a-50f6-4fb9-b3d1-9b0d2193e47c_z1szlnpndevstack@QuobyteHD
Jun 15 16:12:11 devstack sudo[111187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:11 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-04f3bc5d-2a6c-4cf8-965b-a65b02528688 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Flow 'volume_create_manager' (b84f0378-be62-45f1-bd6c-328bebce6288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:12:11 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-04f3bc5d-2a6c-4cf8-965b-a65b02528688 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5a62d50-c8e7-42bd-a5d4-996d6d881246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:11 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae01f947-177b-4d70-bc4f-15b92d7d4e9d]: (4, 'raw') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:12:11 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c31a8b8b-a9e2-4db6-ae2e-046a7f4215ed tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_39f5e834-44ad-4d59-bd8b-97ed9b791648_elh7751ldevstack@QuobyteHD {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:11 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-04f3bc5d-2a6c-4cf8-965b-a65b02528688 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5a62d50-c8e7-42bd-a5d4-996d6d881246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:12:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-283988237',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=413041fa-40e5-4bcc-96b5-1563744d2716,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34169552e47c463a988f18be3f6bbc19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:12:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:12:11Z,use_quota=True,user_id='44fc9edf90764e9088105b282bec206b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:11 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-04f3bc5d-2a6c-4cf8-965b-a65b02528688 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61d565b3-bb81-4f69-88c1-b5df469523bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:11 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-04f3bc5d-2a6c-4cf8-965b-a65b02528688 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61d565b3-bb81-4f69-88c1-b5df469523bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:11 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-04f3bc5d-2a6c-4cf8-965b-a65b02528688 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (771f7974-4d9e-4409-88c5-1c790526e673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:11 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-04f3bc5d-2a6c-4cf8-965b-a65b02528688 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (771f7974-4d9e-4409-88c5-1c790526e673) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '413041fa-40e5-4bcc-96b5-1563744d2716', 'volume_name': 'volume-413041fa-40e5-4bcc-96b5-1563744d2716', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:11 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-04f3bc5d-2a6c-4cf8-965b-a65b02528688 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c95adff-fc8b-4d5a-886a-dc35f3acac26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:11 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-04f3bc5d-2a6c-4cf8-965b-a65b02528688 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c95adff-fc8b-4d5a-886a-dc35f3acac26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:11 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-04f3bc5d-2a6c-4cf8-965b-a65b02528688 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edd7650a-d97b-4979-8bf0-e2a37a6dd07b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:11 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-04f3bc5d-2a6c-4cf8-965b-a65b02528688 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Volume 413041fa-40e5-4bcc-96b5-1563744d2716: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-413041fa-40e5-4bcc-96b5-1563744d2716', 'volume_size': 1}
Jun 15 16:12:11 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-04f3bc5d-2a6c-4cf8-965b-a65b02528688 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:12:11 devstack sudo[111193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_39f5e834-44ad-4d59-bd8b-97ed9b791648_elh7751ldevstack@QuobyteHD
Jun 15 16:12:11 devstack sudo[111193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:11 devstack sudo[111183]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:11 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-8ac486eb-0913-41dd-9a62-66a40c895415 tempest-CreateVolumesFromImageTest-986482857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-21f37e2a-55e9-4921-a9d0-cc402cb29d27 1073741824" returned: 0 in 1.156s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:11 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-8ac486eb-0913-41dd-9a62-66a40c895415 tempest-CreateVolumesFromImageTest-986482857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-21f37e2a-55e9-4921-a9d0-cc402cb29d27 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:11 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-730198e5-c5a3-44e6-a75d-12e8996e488d tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 16:12:11 devstack sudo[111195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-21f37e2a-55e9-4921-a9d0-cc402cb29d27
Jun 15 16:12:11 devstack sudo[111195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:11 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-730198e5-c5a3-44e6-a75d-12e8996e488d tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Flow 'volume_create_manager' (5fce9af0-8b45-4039-bc09-0a45c9b5f789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:12:12 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-730198e5-c5a3-44e6-a75d-12e8996e488d tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccc69019-1a39-4a94-9f57-2a90e1eab83e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:12 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-730198e5-c5a3-44e6-a75d-12e8996e488d tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccc69019-1a39-4a94-9f57-2a90e1eab83e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:12:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1727679370',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee6bb652-4fd7-4e2a-a015-22326843139a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34169552e47c463a988f18be3f6bbc19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:12:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:12:12Z,use_quota=True,user_id='44fc9edf90764e9088105b282bec206b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:12 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-730198e5-c5a3-44e6-a75d-12e8996e488d tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4110e706-dd6a-4ef3-a9e3-220fbe419a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:12 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-730198e5-c5a3-44e6-a75d-12e8996e488d tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4110e706-dd6a-4ef3-a9e3-220fbe419a7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:12 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-730198e5-c5a3-44e6-a75d-12e8996e488d tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25d93a49-85a0-4316-9f76-f29e83c8ebeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:12 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-730198e5-c5a3-44e6-a75d-12e8996e488d tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25d93a49-85a0-4316-9f76-f29e83c8ebeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee6bb652-4fd7-4e2a-a015-22326843139a', 'volume_name': 'volume-ee6bb652-4fd7-4e2a-a015-22326843139a', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:12 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-730198e5-c5a3-44e6-a75d-12e8996e488d tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (682c2ce6-8a75-4ff2-a64e-10b1fd19f87a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:12 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-730198e5-c5a3-44e6-a75d-12e8996e488d tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (682c2ce6-8a75-4ff2-a64e-10b1fd19f87a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:12 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-730198e5-c5a3-44e6-a75d-12e8996e488d tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ed77bf8-d0be-4453-ba07-2b4050399a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:12 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-730198e5-c5a3-44e6-a75d-12e8996e488d tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Volume ee6bb652-4fd7-4e2a-a015-22326843139a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee6bb652-4fd7-4e2a-a015-22326843139a', 'volume_size': 1}
Jun 15 16:12:12 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-730198e5-c5a3-44e6-a75d-12e8996e488d tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:12:12 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-8329bfbf-592e-4a47-9a11-e15ccffa666a tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 16:12:12 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8329bfbf-592e-4a47-9a11-e15ccffa666a tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Flow 'volume_create_manager' (877b0fad-39bb-4528-aa0a-6d3da9128bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:12:12 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8329bfbf-592e-4a47-9a11-e15ccffa666a tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7f6ba6c-eb67-49ae-8cf1-8e0131c1235f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:12 devstack sudo[111187]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:12 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8329bfbf-592e-4a47-9a11-e15ccffa666a tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7f6ba6c-eb67-49ae-8cf1-8e0131c1235f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:12:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1069864329',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efd7d5c7-6a22-4b6e-bcae-7675b4a28623,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34169552e47c463a988f18be3f6bbc19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:12:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:12:12Z,use_quota=True,user_id='44fc9edf90764e9088105b282bec206b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:12 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8329bfbf-592e-4a47-9a11-e15ccffa666a tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (149f29f3-fce8-46a2-bd56-1632b9b52025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:12 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8329bfbf-592e-4a47-9a11-e15ccffa666a tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (149f29f3-fce8-46a2-bd56-1632b9b52025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:12 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8329bfbf-592e-4a47-9a11-e15ccffa666a tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (438ba174-a3f2-41de-a41a-3f047b549f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:12 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8329bfbf-592e-4a47-9a11-e15ccffa666a tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (438ba174-a3f2-41de-a41a-3f047b549f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efd7d5c7-6a22-4b6e-bcae-7675b4a28623', 'volume_name': 'volume-efd7d5c7-6a22-4b6e-bcae-7675b4a28623', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:12 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8329bfbf-592e-4a47-9a11-e15ccffa666a tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ba1c4e7-5d89-4185-89a6-cbb50ecda33c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:12 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8329bfbf-592e-4a47-9a11-e15ccffa666a tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ba1c4e7-5d89-4185-89a6-cbb50ecda33c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:12 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8329bfbf-592e-4a47-9a11-e15ccffa666a tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c1aaa7e-3fa0-4716-979e-25b68082ff57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:12 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-8329bfbf-592e-4a47-9a11-e15ccffa666a tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Volume efd7d5c7-6a22-4b6e-bcae-7675b4a28623: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efd7d5c7-6a22-4b6e-bcae-7675b4a28623', 'volume_size': 1}
Jun 15 16:12:12 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-8329bfbf-592e-4a47-9a11-e15ccffa666a tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:12:12 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-1e16110a-351f-422a-9307-62e02d26d185 tempest-VolumeImageDependencyTests-761867979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_90cfc52a-50f6-4fb9-b3d1-9b0d2193e47c_z1szlnpndevstack@QuobyteHD" returned: 1 in 1.224s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:12 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-1e16110a-351f-422a-9307-62e02d26d185 tempest-VolumeImageDependencyTests-761867979 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_90cfc52a-50f6-4fb9-b3d1-9b0d2193e47c_z1szlnpndevstack@QuobyteHD' failed. Not Retrying. {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 15 16:12:12 devstack cinder-volume[91863]: DEBUG cinder.image.image_utils [None req-1e16110a-351f-422a-9307-62e02d26d185 tempest-VolumeImageDependencyTests-761867979 None] Temporary image 90cfc52a-50f6-4fb9-b3d1-9b0d2193e47c is fetched for user 1def98cb552845cb9d2fdb91ed95a9bc. {{(pid=91863) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 15 16:12:12 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c12804e9-fad0-4f5e-a1cb-620558cccc8a]: (4, 'raw') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:12:12 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-1e16110a-351f-422a-9307-62e02d26d185 tempest-VolumeImageDependencyTests-761867979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_90cfc52a-50f6-4fb9-b3d1-9b0d2193e47c_z1szlnpndevstack@QuobyteHD {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:12 devstack sudo[111193]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:12 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c31a8b8b-a9e2-4db6-ae2e-046a7f4215ed tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_39f5e834-44ad-4d59-bd8b-97ed9b791648_elh7751ldevstack@QuobyteHD" returned: 0 in 1.061s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:12 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c31a8b8b-a9e2-4db6-ae2e-046a7f4215ed tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_39f5e834-44ad-4d59-bd8b-97ed9b791648_elh7751ldevstack@QuobyteHD {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:12 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-40f72a33-ee93-49b1-b0e8-415471a8d541 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 16:12:12 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-40f72a33-ee93-49b1-b0e8-415471a8d541 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Flow 'volume_create_manager' (34652cd7-0596-4221-9664-6d0db52ad6c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:12:12 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-40f72a33-ee93-49b1-b0e8-415471a8d541 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ade54df8-a54b-47ea-958c-02114ac3e493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:12 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-40f72a33-ee93-49b1-b0e8-415471a8d541 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ade54df8-a54b-47ea-958c-02114ac3e493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:12:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1205796878',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94100df7-6457-4766-9b51-84abe9c315f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34169552e47c463a988f18be3f6bbc19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:12:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:12:13Z,use_quota=True,user_id='44fc9edf90764e9088105b282bec206b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:12 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-40f72a33-ee93-49b1-b0e8-415471a8d541 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e66a3106-ed0b-4baf-b0b3-a471160f64b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:12 devstack sudo[111202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_90cfc52a-50f6-4fb9-b3d1-9b0d2193e47c_z1szlnpndevstack@QuobyteHD
Jun 15 16:12:12 devstack sudo[111202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:12 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-40f72a33-ee93-49b1-b0e8-415471a8d541 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e66a3106-ed0b-4baf-b0b3-a471160f64b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:12 devstack sudo[111203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_39f5e834-44ad-4d59-bd8b-97ed9b791648_elh7751ldevstack@QuobyteHD
Jun 15 16:12:12 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-40f72a33-ee93-49b1-b0e8-415471a8d541 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3ba0daf-4356-4ee9-b8bb-228d04091681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:12 devstack sudo[111203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:12 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-40f72a33-ee93-49b1-b0e8-415471a8d541 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3ba0daf-4356-4ee9-b8bb-228d04091681) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94100df7-6457-4766-9b51-84abe9c315f4', 'volume_name': 'volume-94100df7-6457-4766-9b51-84abe9c315f4', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:12 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-40f72a33-ee93-49b1-b0e8-415471a8d541 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe91de0e-9b91-403d-864e-1ad3b26e1350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:12 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-40f72a33-ee93-49b1-b0e8-415471a8d541 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe91de0e-9b91-403d-864e-1ad3b26e1350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:12 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-40f72a33-ee93-49b1-b0e8-415471a8d541 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bed499a-bc2a-4baa-8030-6105df7a8a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:12 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-40f72a33-ee93-49b1-b0e8-415471a8d541 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Volume 94100df7-6457-4766-9b51-84abe9c315f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94100df7-6457-4766-9b51-84abe9c315f4', 'volume_size': 1}
Jun 15 16:12:12 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-40f72a33-ee93-49b1-b0e8-415471a8d541 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:12:12 devstack sudo[111195]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:12 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-8ac486eb-0913-41dd-9a62-66a40c895415 tempest-CreateVolumesFromImageTest-986482857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-21f37e2a-55e9-4921-a9d0-cc402cb29d27" returned: 0 in 0.991s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:12 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-8ac486eb-0913-41dd-9a62-66a40c895415 tempest-CreateVolumesFromImageTest-986482857 None] <== create_volume: return (2247ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 16:12:12 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-8ac486eb-0913-41dd-9a62-66a40c895415 tempest-CreateVolumesFromImageTest-986482857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.255s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:12:12 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-0f2aa886-3d84-458b-aa62-1021c026a686 tempest-CreateVolumesFromImageTest-986482857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.257s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:12:12 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-0f2aa886-3d84-458b-aa62-1021c026a686 tempest-CreateVolumesFromImageTest-986482857 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:12:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1779581043',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb40da53-da6b-4838-ab3e-4c52c68f9626,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0b297f8c14c46c08eeed01d0f5643d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:12:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:12:07Z,use_quota=True,user_id='1727697b78ce40cc91ad158aa625cde5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 16:12:12 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-0f2aa886-3d84-458b-aa62-1021c026a686 tempest-CreateVolumesFromImageTest-986482857 None] Creating volume eb40da53-da6b-4838-ab3e-4c52c68f9626 {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 16:12:12 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-0f2aa886-3d84-458b-aa62-1021c026a686 tempest-CreateVolumesFromImageTest-986482857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:12:12 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-0f2aa886-3d84-458b-aa62-1021c026a686 tempest-CreateVolumesFromImageTest-986482857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:12:12 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-0f2aa886-3d84-458b-aa62-1021c026a686 tempest-CreateVolumesFromImageTest-986482857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:12:12 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-0f2aa886-3d84-458b-aa62-1021c026a686 tempest-CreateVolumesFromImageTest-986482857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:12:12 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-0f2aa886-3d84-458b-aa62-1021c026a686 tempest-CreateVolumesFromImageTest-986482857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:12:12 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-0f2aa886-3d84-458b-aa62-1021c026a686 tempest-CreateVolumesFromImageTest-986482857 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 16:12:12 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-0f2aa886-3d84-458b-aa62-1021c026a686 tempest-CreateVolumesFromImageTest-986482857 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 16:12:12 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-0f2aa886-3d84-458b-aa62-1021c026a686 tempest-CreateVolumesFromImageTest-986482857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-eb40da53-da6b-4838-ab3e-4c52c68f9626 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:12 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8ac486eb-0913-41dd-9a62-66a40c895415 tempest-CreateVolumesFromImageTest-986482857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20230030-1b7e-435a-94f3-805dd7514802) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21f37e2a-55e9-4921-a9d0-cc402cb29d27', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:12 devstack sudo[111207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-eb40da53-da6b-4838-ab3e-4c52c68f9626 1073741824
Jun 15 16:12:12 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8ac486eb-0913-41dd-9a62-66a40c895415 tempest-CreateVolumesFromImageTest-986482857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d853754-a6ef-4151-9e24-8903df54690f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:13 devstack sudo[111207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:13 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-8ac486eb-0913-41dd-9a62-66a40c895415 tempest-CreateVolumesFromImageTest-986482857 None] Volume volume-21f37e2a-55e9-4921-a9d0-cc402cb29d27 (21f37e2a-55e9-4921-a9d0-cc402cb29d27): created successfully
Jun 15 16:12:13 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8ac486eb-0913-41dd-9a62-66a40c895415 tempest-CreateVolumesFromImageTest-986482857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d853754-a6ef-4151-9e24-8903df54690f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:13 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8ac486eb-0913-41dd-9a62-66a40c895415 tempest-CreateVolumesFromImageTest-986482857 None] Flow 'volume_create_manager' (f2097805-481e-4707-ad93-ff7601420873) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:12:13 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-8ac486eb-0913-41dd-9a62-66a40c895415 tempest-CreateVolumesFromImageTest-986482857 None] Created volume successfully.
Jun 15 16:12:13 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-e05bca0e-246d-4e30-841a-e5b5e494da23 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 16:12:13 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e05bca0e-246d-4e30-841a-e5b5e494da23 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Flow 'volume_create_manager' (433fb125-27c3-48e5-934a-8cce20990821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:12:13 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e05bca0e-246d-4e30-841a-e5b5e494da23 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61f58b77-1797-464a-b047-828ddd963811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:13 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e05bca0e-246d-4e30-841a-e5b5e494da23 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61f58b77-1797-464a-b047-828ddd963811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:12:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1410952659',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17f43a62-26d6-4f80-8468-a31a45fdf993,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34169552e47c463a988f18be3f6bbc19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:12:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:12:13Z,use_quota=True,user_id='44fc9edf90764e9088105b282bec206b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:13 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e05bca0e-246d-4e30-841a-e5b5e494da23 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3235bed9-5a45-433a-9bde-e44c4cebb8b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:13 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e05bca0e-246d-4e30-841a-e5b5e494da23 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3235bed9-5a45-433a-9bde-e44c4cebb8b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:13 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e05bca0e-246d-4e30-841a-e5b5e494da23 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6adf9ca1-0d43-4b22-826d-618b92f09563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:13 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e05bca0e-246d-4e30-841a-e5b5e494da23 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6adf9ca1-0d43-4b22-826d-618b92f09563) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17f43a62-26d6-4f80-8468-a31a45fdf993', 'volume_name': 'volume-17f43a62-26d6-4f80-8468-a31a45fdf993', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:13 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e05bca0e-246d-4e30-841a-e5b5e494da23 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70d08c65-90d5-4f70-97d6-04ce260a086a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:13 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e05bca0e-246d-4e30-841a-e5b5e494da23 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70d08c65-90d5-4f70-97d6-04ce260a086a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:13 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e05bca0e-246d-4e30-841a-e5b5e494da23 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6dbc2e7-8572-4182-857b-22f56e88518a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:13 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-e05bca0e-246d-4e30-841a-e5b5e494da23 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Volume 17f43a62-26d6-4f80-8468-a31a45fdf993: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17f43a62-26d6-4f80-8468-a31a45fdf993', 'volume_size': 1}
Jun 15 16:12:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-e05bca0e-246d-4e30-841a-e5b5e494da23 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:12:13 devstack sudo[111203]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c31a8b8b-a9e2-4db6-ae2e-046a7f4215ed tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_39f5e834-44ad-4d59-bd8b-97ed9b791648_elh7751ldevstack@QuobyteHD" returned: 1 in 0.854s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c31a8b8b-a9e2-4db6-ae2e-046a7f4215ed tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_39f5e834-44ad-4d59-bd8b-97ed9b791648_elh7751ldevstack@QuobyteHD' failed. Not Retrying. {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 15 16:12:13 devstack cinder-volume[91863]: DEBUG cinder.image.image_utils [None req-c31a8b8b-a9e2-4db6-ae2e-046a7f4215ed tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] Temporary image 39f5e834-44ad-4d59-bd8b-97ed9b791648 is fetched for user ab33fd116d4c462f8e889f48c5aa2c1f. {{(pid=91863) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 15 16:12:13 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3757385f-5386-47b9-bf0a-7b0d802efe24]: (4, 'raw') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:12:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c31a8b8b-a9e2-4db6-ae2e-046a7f4215ed tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_39f5e834-44ad-4d59-bd8b-97ed9b791648_elh7751ldevstack@QuobyteHD {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:13 devstack sudo[111202]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-1e16110a-351f-422a-9307-62e02d26d185 tempest-VolumeImageDependencyTests-761867979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_90cfc52a-50f6-4fb9-b3d1-9b0d2193e47c_z1szlnpndevstack@QuobyteHD" returned: 0 in 0.982s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-1e16110a-351f-422a-9307-62e02d26d185 tempest-VolumeImageDependencyTests-761867979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_90cfc52a-50f6-4fb9-b3d1-9b0d2193e47c_z1szlnpndevstack@QuobyteHD {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:13 devstack sudo[111214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_39f5e834-44ad-4d59-bd8b-97ed9b791648_elh7751ldevstack@QuobyteHD
Jun 15 16:12:13 devstack sudo[111214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:13 devstack sudo[111215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_90cfc52a-50f6-4fb9-b3d1-9b0d2193e47c_z1szlnpndevstack@QuobyteHD
Jun 15 16:12:13 devstack sudo[111215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:13 devstack sudo[111207]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-0f2aa886-3d84-458b-aa62-1021c026a686 tempest-CreateVolumesFromImageTest-986482857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-eb40da53-da6b-4838-ab3e-4c52c68f9626 1073741824" returned: 0 in 0.997s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-0f2aa886-3d84-458b-aa62-1021c026a686 tempest-CreateVolumesFromImageTest-986482857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-eb40da53-da6b-4838-ab3e-4c52c68f9626 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:14 devstack sudo[111221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-eb40da53-da6b-4838-ab3e-4c52c68f9626
Jun 15 16:12:14 devstack sudo[111221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:14 devstack sudo[111214]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:14 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c31a8b8b-a9e2-4db6-ae2e-046a7f4215ed tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_39f5e834-44ad-4d59-bd8b-97ed9b791648_elh7751ldevstack@QuobyteHD" returned: 0 in 0.725s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:14 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c31a8b8b-a9e2-4db6-ae2e-046a7f4215ed tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_39f5e834-44ad-4d59-bd8b-97ed9b791648_elh7751ldevstack@QuobyteHD {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:14 devstack sudo[111215]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:14 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-1e16110a-351f-422a-9307-62e02d26d185 tempest-VolumeImageDependencyTests-761867979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_90cfc52a-50f6-4fb9-b3d1-9b0d2193e47c_z1szlnpndevstack@QuobyteHD" returned: 1 in 0.750s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:14 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-1e16110a-351f-422a-9307-62e02d26d185 tempest-VolumeImageDependencyTests-761867979 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_90cfc52a-50f6-4fb9-b3d1-9b0d2193e47c_z1szlnpndevstack@QuobyteHD' failed. Not Retrying. {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 15 16:12:14 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-1e16110a-351f-422a-9307-62e02d26d185 tempest-VolumeImageDependencyTests-761867979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:12:14 devstack sudo[111228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_39f5e834-44ad-4d59-bd8b-97ed9b791648_elh7751ldevstack@QuobyteHD
Jun 15 16:12:14 devstack sudo[111228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:14 devstack sudo[111221]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:14 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-0f2aa886-3d84-458b-aa62-1021c026a686 tempest-CreateVolumesFromImageTest-986482857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-eb40da53-da6b-4838-ab3e-4c52c68f9626" returned: 0 in 0.604s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:14 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-0f2aa886-3d84-458b-aa62-1021c026a686 tempest-CreateVolumesFromImageTest-986482857 None] <== create_volume: return (1651ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 16:12:14 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-0f2aa886-3d84-458b-aa62-1021c026a686 tempest-CreateVolumesFromImageTest-986482857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.655s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:12:14 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-4f137b64-b1b2-48d6-bf4a-a88ae96ea335 tempest-CreateVolumesFromImageTest-986482857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.379s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:12:14 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-4f137b64-b1b2-48d6-bf4a-a88ae96ea335 tempest-CreateVolumesFromImageTest-986482857 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:12:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-624356694',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43e6e8a2-f6a3-4797-83c2-266dfb86abe8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0b297f8c14c46c08eeed01d0f5643d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:12:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:12:08Z,use_quota=True,user_id='1727697b78ce40cc91ad158aa625cde5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 16:12:14 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-4f137b64-b1b2-48d6-bf4a-a88ae96ea335 tempest-CreateVolumesFromImageTest-986482857 None] Creating volume 43e6e8a2-f6a3-4797-83c2-266dfb86abe8 {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 16:12:14 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-4f137b64-b1b2-48d6-bf4a-a88ae96ea335 tempest-CreateVolumesFromImageTest-986482857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:12:14 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-4f137b64-b1b2-48d6-bf4a-a88ae96ea335 tempest-CreateVolumesFromImageTest-986482857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:12:14 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-4f137b64-b1b2-48d6-bf4a-a88ae96ea335 tempest-CreateVolumesFromImageTest-986482857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:12:14 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-4f137b64-b1b2-48d6-bf4a-a88ae96ea335 tempest-CreateVolumesFromImageTest-986482857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:12:14 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-4f137b64-b1b2-48d6-bf4a-a88ae96ea335 tempest-CreateVolumesFromImageTest-986482857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:12:14 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-4f137b64-b1b2-48d6-bf4a-a88ae96ea335 tempest-CreateVolumesFromImageTest-986482857 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 16:12:14 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-4f137b64-b1b2-48d6-bf4a-a88ae96ea335 tempest-CreateVolumesFromImageTest-986482857 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 16:12:14 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-4f137b64-b1b2-48d6-bf4a-a88ae96ea335 tempest-CreateVolumesFromImageTest-986482857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-43e6e8a2-f6a3-4797-83c2-266dfb86abe8 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:14 devstack sudo[111231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-43e6e8a2-f6a3-4797-83c2-266dfb86abe8 1073741824
Jun 15 16:12:14 devstack sudo[111231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:14 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-0f2aa886-3d84-458b-aa62-1021c026a686 tempest-CreateVolumesFromImageTest-986482857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e475155-41ae-43fe-b237-79878e674e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb40da53-da6b-4838-ab3e-4c52c68f9626', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:14 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-0f2aa886-3d84-458b-aa62-1021c026a686 tempest-CreateVolumesFromImageTest-986482857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (708bdb2f-7c04-401d-9440-226add631f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:14 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-0f2aa886-3d84-458b-aa62-1021c026a686 tempest-CreateVolumesFromImageTest-986482857 None] Volume volume-eb40da53-da6b-4838-ab3e-4c52c68f9626 (eb40da53-da6b-4838-ab3e-4c52c68f9626): created successfully
Jun 15 16:12:14 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-0f2aa886-3d84-458b-aa62-1021c026a686 tempest-CreateVolumesFromImageTest-986482857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (708bdb2f-7c04-401d-9440-226add631f2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:14 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-0f2aa886-3d84-458b-aa62-1021c026a686 tempest-CreateVolumesFromImageTest-986482857 None] Flow 'volume_create_manager' (d53121f5-342d-450d-8740-a61e026b945f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:12:14 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-0f2aa886-3d84-458b-aa62-1021c026a686 tempest-CreateVolumesFromImageTest-986482857 None] Created volume successfully.
Jun 15 16:12:14 devstack sudo[111228]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:14 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c31a8b8b-a9e2-4db6-ae2e-046a7f4215ed tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_39f5e834-44ad-4d59-bd8b-97ed9b791648_elh7751ldevstack@QuobyteHD" returned: 1 in 0.680s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:14 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c31a8b8b-a9e2-4db6-ae2e-046a7f4215ed tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_39f5e834-44ad-4d59-bd8b-97ed9b791648_elh7751ldevstack@QuobyteHD' failed. Not Retrying. {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 15 16:12:14 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-c31a8b8b-a9e2-4db6-ae2e-046a7f4215ed tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:12:15 devstack sudo[111231]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:15 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-4f137b64-b1b2-48d6-bf4a-a88ae96ea335 tempest-CreateVolumesFromImageTest-986482857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-43e6e8a2-f6a3-4797-83c2-266dfb86abe8 1073741824" returned: 0 in 0.768s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:15 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-4f137b64-b1b2-48d6-bf4a-a88ae96ea335 tempest-CreateVolumesFromImageTest-986482857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-43e6e8a2-f6a3-4797-83c2-266dfb86abe8 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:15 devstack sudo[111240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-43e6e8a2-f6a3-4797-83c2-266dfb86abe8
Jun 15 16:12:15 devstack sudo[111240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:15 devstack sudo[111240]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:15 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-4f137b64-b1b2-48d6-bf4a-a88ae96ea335 tempest-CreateVolumesFromImageTest-986482857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-43e6e8a2-f6a3-4797-83c2-266dfb86abe8" returned: 0 in 0.587s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:15 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-4f137b64-b1b2-48d6-bf4a-a88ae96ea335 tempest-CreateVolumesFromImageTest-986482857 None] <== create_volume: return (1389ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 16:12:15 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-4f137b64-b1b2-48d6-bf4a-a88ae96ea335 tempest-CreateVolumesFromImageTest-986482857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.392s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:12:15 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-80c8a1fd-6263-4849-bd88-fd3d9d7708af tempest-CreateVolumesFromImageTest-986482857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.437s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:12:15 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-80c8a1fd-6263-4849-bd88-fd3d9d7708af tempest-CreateVolumesFromImageTest-986482857 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:12:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-548001396',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc7da5df-aabc-4ca4-a374-5a5e57b95bd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0b297f8c14c46c08eeed01d0f5643d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:12:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:12:08Z,use_quota=True,user_id='1727697b78ce40cc91ad158aa625cde5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 16:12:15 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-80c8a1fd-6263-4849-bd88-fd3d9d7708af tempest-CreateVolumesFromImageTest-986482857 None] Creating volume cc7da5df-aabc-4ca4-a374-5a5e57b95bd8 {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 16:12:15 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-80c8a1fd-6263-4849-bd88-fd3d9d7708af tempest-CreateVolumesFromImageTest-986482857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:12:15 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-80c8a1fd-6263-4849-bd88-fd3d9d7708af tempest-CreateVolumesFromImageTest-986482857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:12:15 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-80c8a1fd-6263-4849-bd88-fd3d9d7708af tempest-CreateVolumesFromImageTest-986482857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:12:15 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-80c8a1fd-6263-4849-bd88-fd3d9d7708af tempest-CreateVolumesFromImageTest-986482857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:12:15 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-80c8a1fd-6263-4849-bd88-fd3d9d7708af tempest-CreateVolumesFromImageTest-986482857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:12:15 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-80c8a1fd-6263-4849-bd88-fd3d9d7708af tempest-CreateVolumesFromImageTest-986482857 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 16:12:15 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-80c8a1fd-6263-4849-bd88-fd3d9d7708af tempest-CreateVolumesFromImageTest-986482857 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 16:12:15 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-80c8a1fd-6263-4849-bd88-fd3d9d7708af tempest-CreateVolumesFromImageTest-986482857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-cc7da5df-aabc-4ca4-a374-5a5e57b95bd8 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:16 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-4f137b64-b1b2-48d6-bf4a-a88ae96ea335 tempest-CreateVolumesFromImageTest-986482857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5985eec8-1aa4-42fd-8035-36350f462058) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43e6e8a2-f6a3-4797-83c2-266dfb86abe8', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:16 devstack sudo[111244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-cc7da5df-aabc-4ca4-a374-5a5e57b95bd8 1073741824
Jun 15 16:12:16 devstack sudo[111244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:16 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-4f137b64-b1b2-48d6-bf4a-a88ae96ea335 tempest-CreateVolumesFromImageTest-986482857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70205c77-956f-4142-a2ec-00ecb4d022c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:16 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-4f137b64-b1b2-48d6-bf4a-a88ae96ea335 tempest-CreateVolumesFromImageTest-986482857 None] Volume volume-43e6e8a2-f6a3-4797-83c2-266dfb86abe8 (43e6e8a2-f6a3-4797-83c2-266dfb86abe8): created successfully
Jun 15 16:12:16 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-4f137b64-b1b2-48d6-bf4a-a88ae96ea335 tempest-CreateVolumesFromImageTest-986482857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70205c77-956f-4142-a2ec-00ecb4d022c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:16 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-4f137b64-b1b2-48d6-bf4a-a88ae96ea335 tempest-CreateVolumesFromImageTest-986482857 None] Flow 'volume_create_manager' (b0d6fc88-c4f6-42e4-9078-1e8c466f5784) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:12:16 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-4f137b64-b1b2-48d6-bf4a-a88ae96ea335 tempest-CreateVolumesFromImageTest-986482857 None] Created volume successfully.
Jun 15 16:12:16 devstack sudo[111244]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:16 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-80c8a1fd-6263-4849-bd88-fd3d9d7708af tempest-CreateVolumesFromImageTest-986482857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-cc7da5df-aabc-4ca4-a374-5a5e57b95bd8 1073741824" returned: 0 in 0.785s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:16 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-80c8a1fd-6263-4849-bd88-fd3d9d7708af tempest-CreateVolumesFromImageTest-986482857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-cc7da5df-aabc-4ca4-a374-5a5e57b95bd8 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:16 devstack sudo[111250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-cc7da5df-aabc-4ca4-a374-5a5e57b95bd8
Jun 15 16:12:16 devstack sudo[111250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:17 devstack sudo[111250]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:17 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-80c8a1fd-6263-4849-bd88-fd3d9d7708af tempest-CreateVolumesFromImageTest-986482857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-cc7da5df-aabc-4ca4-a374-5a5e57b95bd8" returned: 0 in 0.564s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:17 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-80c8a1fd-6263-4849-bd88-fd3d9d7708af tempest-CreateVolumesFromImageTest-986482857 None] <== create_volume: return (1385ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 16:12:17 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-80c8a1fd-6263-4849-bd88-fd3d9d7708af tempest-CreateVolumesFromImageTest-986482857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.388s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:12:17 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-04f3bc5d-2a6c-4cf8-965b-a65b02528688 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.653s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:12:17 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-04f3bc5d-2a6c-4cf8-965b-a65b02528688 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:12:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-283988237',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=413041fa-40e5-4bcc-96b5-1563744d2716,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34169552e47c463a988f18be3f6bbc19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:12:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:12:11Z,use_quota=True,user_id='44fc9edf90764e9088105b282bec206b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 16:12:17 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-04f3bc5d-2a6c-4cf8-965b-a65b02528688 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Creating volume 413041fa-40e5-4bcc-96b5-1563744d2716 {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 16:12:17 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-04f3bc5d-2a6c-4cf8-965b-a65b02528688 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:12:17 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-04f3bc5d-2a6c-4cf8-965b-a65b02528688 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:12:17 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-04f3bc5d-2a6c-4cf8-965b-a65b02528688 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:12:17 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-04f3bc5d-2a6c-4cf8-965b-a65b02528688 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:12:17 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-04f3bc5d-2a6c-4cf8-965b-a65b02528688 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:12:17 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-04f3bc5d-2a6c-4cf8-965b-a65b02528688 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 16:12:17 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-04f3bc5d-2a6c-4cf8-965b-a65b02528688 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 16:12:17 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-04f3bc5d-2a6c-4cf8-965b-a65b02528688 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-413041fa-40e5-4bcc-96b5-1563744d2716 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:17 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-80c8a1fd-6263-4849-bd88-fd3d9d7708af tempest-CreateVolumesFromImageTest-986482857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d585347-6aec-4ddd-b5ea-cbeb5027c147) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc7da5df-aabc-4ca4-a374-5a5e57b95bd8', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:17 devstack sudo[111253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-413041fa-40e5-4bcc-96b5-1563744d2716 1073741824
Jun 15 16:12:17 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-80c8a1fd-6263-4849-bd88-fd3d9d7708af tempest-CreateVolumesFromImageTest-986482857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47cf9157-5823-4c76-9f20-5cb36ff6d378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:17 devstack sudo[111253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:17 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-80c8a1fd-6263-4849-bd88-fd3d9d7708af tempest-CreateVolumesFromImageTest-986482857 None] Volume volume-cc7da5df-aabc-4ca4-a374-5a5e57b95bd8 (cc7da5df-aabc-4ca4-a374-5a5e57b95bd8): created successfully
Jun 15 16:12:17 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-80c8a1fd-6263-4849-bd88-fd3d9d7708af tempest-CreateVolumesFromImageTest-986482857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47cf9157-5823-4c76-9f20-5cb36ff6d378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:17 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-80c8a1fd-6263-4849-bd88-fd3d9d7708af tempest-CreateVolumesFromImageTest-986482857 None] Flow 'volume_create_manager' (f36f4472-7a0e-495d-b45a-aeee00b6ba9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:12:17 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-80c8a1fd-6263-4849-bd88-fd3d9d7708af tempest-CreateVolumesFromImageTest-986482857 None] Created volume successfully.
Jun 15 16:12:18 devstack sudo[111253]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:18 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-04f3bc5d-2a6c-4cf8-965b-a65b02528688 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-413041fa-40e5-4bcc-96b5-1563744d2716 1073741824" returned: 0 in 0.797s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:18 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-04f3bc5d-2a6c-4cf8-965b-a65b02528688 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-413041fa-40e5-4bcc-96b5-1563744d2716 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:18 devstack sudo[111259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-413041fa-40e5-4bcc-96b5-1563744d2716
Jun 15 16:12:18 devstack sudo[111259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:18 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-f0164bb4-0ccc-46be-bc73-27a90a1093a7 tempest-CreateVolumesFromImageTest-986482857 None] Acquiring lock "cinder-cc7da5df-aabc-4ca4-a374-5a5e57b95bd8-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:12:18 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-f0164bb4-0ccc-46be-bc73-27a90a1093a7 tempest-CreateVolumesFromImageTest-986482857 None] Lock "cinder-cc7da5df-aabc-4ca4-a374-5a5e57b95bd8-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:12:18 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-f0164bb4-0ccc-46be-bc73-27a90a1093a7 tempest-CreateVolumesFromImageTest-986482857 None] Acquiring lock "cinder-quobyte-cc7da5df-aabc-4ca4-a374-5a5e57b95bd8" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:12:18 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-f0164bb4-0ccc-46be-bc73-27a90a1093a7 tempest-CreateVolumesFromImageTest-986482857 None] Lock "cinder-quobyte-cc7da5df-aabc-4ca4-a374-5a5e57b95bd8" acquired by "delete_volume" :: waited 0.021s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:12:18 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[92cee47b-5b33-40a3-b345-4c48bfedcf9a]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:12:18 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-f0164bb4-0ccc-46be-bc73-27a90a1093a7 tempest-CreateVolumesFromImageTest-986482857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-cc7da5df-aabc-4ca4-a374-5a5e57b95bd8 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:18 devstack sudo[111261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-cc7da5df-aabc-4ca4-a374-5a5e57b95bd8
Jun 15 16:12:18 devstack sudo[111261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:18 devstack sudo[111259]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:18 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-04f3bc5d-2a6c-4cf8-965b-a65b02528688 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-413041fa-40e5-4bcc-96b5-1563744d2716" returned: 0 in 0.586s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:18 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-04f3bc5d-2a6c-4cf8-965b-a65b02528688 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] <== create_volume: return (1420ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 16:12:18 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-04f3bc5d-2a6c-4cf8-965b-a65b02528688 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.423s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:12:18 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-730198e5-c5a3-44e6-a75d-12e8996e488d tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.732s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:12:18 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-730198e5-c5a3-44e6-a75d-12e8996e488d tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:12:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1727679370',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee6bb652-4fd7-4e2a-a015-22326843139a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34169552e47c463a988f18be3f6bbc19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:12:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:12:12Z,use_quota=True,user_id='44fc9edf90764e9088105b282bec206b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 16:12:18 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-730198e5-c5a3-44e6-a75d-12e8996e488d tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Creating volume ee6bb652-4fd7-4e2a-a015-22326843139a {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 16:12:18 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-730198e5-c5a3-44e6-a75d-12e8996e488d tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:12:18 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-730198e5-c5a3-44e6-a75d-12e8996e488d tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:12:18 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-730198e5-c5a3-44e6-a75d-12e8996e488d tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:12:18 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-730198e5-c5a3-44e6-a75d-12e8996e488d tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:12:18 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-730198e5-c5a3-44e6-a75d-12e8996e488d tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:12:18 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-730198e5-c5a3-44e6-a75d-12e8996e488d tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 16:12:18 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-730198e5-c5a3-44e6-a75d-12e8996e488d tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 16:12:18 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-730198e5-c5a3-44e6-a75d-12e8996e488d tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-ee6bb652-4fd7-4e2a-a015-22326843139a 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:18 devstack sudo[111264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-ee6bb652-4fd7-4e2a-a015-22326843139a 1073741824
Jun 15 16:12:18 devstack sudo[111264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:18 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-04f3bc5d-2a6c-4cf8-965b-a65b02528688 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edd7650a-d97b-4979-8bf0-e2a37a6dd07b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-413041fa-40e5-4bcc-96b5-1563744d2716', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:18 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-04f3bc5d-2a6c-4cf8-965b-a65b02528688 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e869f94-4d09-4a9c-ab97-b9aa6d450966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:18 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-04f3bc5d-2a6c-4cf8-965b-a65b02528688 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Volume volume-413041fa-40e5-4bcc-96b5-1563744d2716 (413041fa-40e5-4bcc-96b5-1563744d2716): created successfully
Jun 15 16:12:18 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-04f3bc5d-2a6c-4cf8-965b-a65b02528688 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e869f94-4d09-4a9c-ab97-b9aa6d450966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:18 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-04f3bc5d-2a6c-4cf8-965b-a65b02528688 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Flow 'volume_create_manager' (b84f0378-be62-45f1-bd6c-328bebce6288) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:12:18 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-04f3bc5d-2a6c-4cf8-965b-a65b02528688 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Created volume successfully.
Jun 15 16:12:19 devstack sudo[111261]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:19 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-f0164bb4-0ccc-46be-bc73-27a90a1093a7 tempest-CreateVolumesFromImageTest-986482857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-cc7da5df-aabc-4ca4-a374-5a5e57b95bd8" returned: 0 in 0.764s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:19 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-f0164bb4-0ccc-46be-bc73-27a90a1093a7 tempest-CreateVolumesFromImageTest-986482857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-cc7da5df-aabc-4ca4-a374-5a5e57b95bd8 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:19 devstack sudo[111271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-cc7da5df-aabc-4ca4-a374-5a5e57b95bd8
Jun 15 16:12:19 devstack sudo[111271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:19 devstack sudo[111264]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:19 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-730198e5-c5a3-44e6-a75d-12e8996e488d tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-ee6bb652-4fd7-4e2a-a015-22326843139a 1073741824" returned: 0 in 0.824s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:19 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-730198e5-c5a3-44e6-a75d-12e8996e488d tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-ee6bb652-4fd7-4e2a-a015-22326843139a {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:19 devstack sudo[111274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-ee6bb652-4fd7-4e2a-a015-22326843139a
Jun 15 16:12:19 devstack sudo[111274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:19 devstack sudo[111271]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:19 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-f0164bb4-0ccc-46be-bc73-27a90a1093a7 tempest-CreateVolumesFromImageTest-986482857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-cc7da5df-aabc-4ca4-a374-5a5e57b95bd8" returned: 0 in 0.593s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:19 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-f0164bb4-0ccc-46be-bc73-27a90a1093a7 tempest-CreateVolumesFromImageTest-986482857 None] Lock "cinder-quobyte-cc7da5df-aabc-4ca4-a374-5a5e57b95bd8" released by "delete_volume" :: held 1.423s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:12:19 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-f0164bb4-0ccc-46be-bc73-27a90a1093a7 tempest-CreateVolumesFromImageTest-986482857 None] Created reservations ['38600c13-1aca-402d-882f-9400ed1aefee', '5fa22a3f-c5aa-4226-91fc-d689f633aaaf', 'dceaef2f-6432-45a9-88ad-2a15bbef611c', '7c7b937a-f3ee-4b1b-a458-d354889f12ca'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 16:12:20 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-f0164bb4-0ccc-46be-bc73-27a90a1093a7 tempest-CreateVolumesFromImageTest-986482857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:12:20 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-f0164bb4-0ccc-46be-bc73-27a90a1093a7 tempest-CreateVolumesFromImageTest-986482857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:12:20 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-f0164bb4-0ccc-46be-bc73-27a90a1093a7 tempest-CreateVolumesFromImageTest-986482857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:12:20 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-f0164bb4-0ccc-46be-bc73-27a90a1093a7 tempest-CreateVolumesFromImageTest-986482857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:12:20 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-f0164bb4-0ccc-46be-bc73-27a90a1093a7 tempest-CreateVolumesFromImageTest-986482857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:12:20 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-f0164bb4-0ccc-46be-bc73-27a90a1093a7 tempest-CreateVolumesFromImageTest-986482857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:20 devstack sudo[111277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 16:12:20 devstack sudo[111277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:20 devstack sudo[111274]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:20 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-730198e5-c5a3-44e6-a75d-12e8996e488d tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-ee6bb652-4fd7-4e2a-a015-22326843139a" returned: 0 in 0.640s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:20 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-730198e5-c5a3-44e6-a75d-12e8996e488d tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] <== create_volume: return (1508ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 16:12:20 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-730198e5-c5a3-44e6-a75d-12e8996e488d tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.515s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:12:20 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-8329bfbf-592e-4a47-9a11-e15ccffa666a tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.850s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:12:20 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-8329bfbf-592e-4a47-9a11-e15ccffa666a tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:12:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1069864329',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efd7d5c7-6a22-4b6e-bcae-7675b4a28623,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34169552e47c463a988f18be3f6bbc19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:12:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:12:12Z,use_quota=True,user_id='44fc9edf90764e9088105b282bec206b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 16:12:20 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-8329bfbf-592e-4a47-9a11-e15ccffa666a tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Creating volume efd7d5c7-6a22-4b6e-bcae-7675b4a28623 {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 16:12:20 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-8329bfbf-592e-4a47-9a11-e15ccffa666a tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:12:20 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-8329bfbf-592e-4a47-9a11-e15ccffa666a tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:12:20 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-8329bfbf-592e-4a47-9a11-e15ccffa666a tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:12:20 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-8329bfbf-592e-4a47-9a11-e15ccffa666a tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:12:20 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-8329bfbf-592e-4a47-9a11-e15ccffa666a tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:12:20 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-8329bfbf-592e-4a47-9a11-e15ccffa666a tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 16:12:20 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-8329bfbf-592e-4a47-9a11-e15ccffa666a tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 16:12:20 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-8329bfbf-592e-4a47-9a11-e15ccffa666a tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-efd7d5c7-6a22-4b6e-bcae-7675b4a28623 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:20 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-730198e5-c5a3-44e6-a75d-12e8996e488d tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ed77bf8-d0be-4453-ba07-2b4050399a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee6bb652-4fd7-4e2a-a015-22326843139a', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:20 devstack sudo[111280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-efd7d5c7-6a22-4b6e-bcae-7675b4a28623 1073741824
Jun 15 16:12:20 devstack sudo[111280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:20 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-730198e5-c5a3-44e6-a75d-12e8996e488d tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32cf1098-acf1-4808-ae49-79c8039ab3bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:20 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-730198e5-c5a3-44e6-a75d-12e8996e488d tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Volume volume-ee6bb652-4fd7-4e2a-a015-22326843139a (ee6bb652-4fd7-4e2a-a015-22326843139a): created successfully
Jun 15 16:12:20 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-730198e5-c5a3-44e6-a75d-12e8996e488d tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32cf1098-acf1-4808-ae49-79c8039ab3bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:20 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-730198e5-c5a3-44e6-a75d-12e8996e488d tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Flow 'volume_create_manager' (5fce9af0-8b45-4039-bc09-0a45c9b5f789) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:12:20 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-730198e5-c5a3-44e6-a75d-12e8996e488d tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Created volume successfully.
Jun 15 16:12:20 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-df4eb701-1580-41bb-ab99-29e4f45e22f0 tempest-CreateVolumesFromImageTest-986482857 None] Acquiring lock "cinder-43e6e8a2-f6a3-4797-83c2-266dfb86abe8-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:12:20 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-df4eb701-1580-41bb-ab99-29e4f45e22f0 tempest-CreateVolumesFromImageTest-986482857 None] Lock "cinder-43e6e8a2-f6a3-4797-83c2-266dfb86abe8-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:12:20 devstack sudo[111277]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:20 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-f0164bb4-0ccc-46be-bc73-27a90a1093a7 tempest-CreateVolumesFromImageTest-986482857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.645s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:20 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-f0164bb4-0ccc-46be-bc73-27a90a1093a7 tempest-CreateVolumesFromImageTest-986482857 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 16:12:20 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-f0164bb4-0ccc-46be-bc73-27a90a1093a7 tempest-CreateVolumesFromImageTest-986482857 None] Deleted volume successfully.
Jun 15 16:12:20 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-df4eb701-1580-41bb-ab99-29e4f45e22f0 tempest-CreateVolumesFromImageTest-986482857 None] Acquiring lock "cinder-quobyte-43e6e8a2-f6a3-4797-83c2-266dfb86abe8" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:12:20 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-df4eb701-1580-41bb-ab99-29e4f45e22f0 tempest-CreateVolumesFromImageTest-986482857 None] Lock "cinder-quobyte-43e6e8a2-f6a3-4797-83c2-266dfb86abe8" acquired by "delete_volume" :: waited 0.022s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:12:20 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-f0164bb4-0ccc-46be-bc73-27a90a1093a7 tempest-CreateVolumesFromImageTest-986482857 None] Lock "cinder-cc7da5df-aabc-4ca4-a374-5a5e57b95bd8-delete_volume" released by "delete_volume" :: held 2.363s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:12:20 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c48afff1-bd8f-4cd0-9bc4-f0a555fc8bbe]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:12:20 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-df4eb701-1580-41bb-ab99-29e4f45e22f0 tempest-CreateVolumesFromImageTest-986482857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-43e6e8a2-f6a3-4797-83c2-266dfb86abe8 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:20 devstack sudo[111284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-43e6e8a2-f6a3-4797-83c2-266dfb86abe8
Jun 15 16:12:20 devstack sudo[111284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:21 devstack sudo[111280]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-8329bfbf-592e-4a47-9a11-e15ccffa666a tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-efd7d5c7-6a22-4b6e-bcae-7675b4a28623 1073741824" returned: 0 in 0.826s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-8329bfbf-592e-4a47-9a11-e15ccffa666a tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-efd7d5c7-6a22-4b6e-bcae-7675b4a28623 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:21 devstack sudo[111289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-efd7d5c7-6a22-4b6e-bcae-7675b4a28623
Jun 15 16:12:21 devstack sudo[111289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:21 devstack sudo[111284]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-df4eb701-1580-41bb-ab99-29e4f45e22f0 tempest-CreateVolumesFromImageTest-986482857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-43e6e8a2-f6a3-4797-83c2-266dfb86abe8" returned: 0 in 0.758s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-df4eb701-1580-41bb-ab99-29e4f45e22f0 tempest-CreateVolumesFromImageTest-986482857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-43e6e8a2-f6a3-4797-83c2-266dfb86abe8 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:21 devstack sudo[111295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-43e6e8a2-f6a3-4797-83c2-266dfb86abe8
Jun 15 16:12:21 devstack sudo[111295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:21 devstack sudo[111289]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-8329bfbf-592e-4a47-9a11-e15ccffa666a tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-efd7d5c7-6a22-4b6e-bcae-7675b4a28623" returned: 0 in 0.637s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:21 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-8329bfbf-592e-4a47-9a11-e15ccffa666a tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] <== create_volume: return (1508ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 16:12:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-8329bfbf-592e-4a47-9a11-e15ccffa666a tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.512s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:12:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-40f72a33-ee93-49b1-b0e8-415471a8d541 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.942s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:12:21 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-40f72a33-ee93-49b1-b0e8-415471a8d541 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:12:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1205796878',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94100df7-6457-4766-9b51-84abe9c315f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34169552e47c463a988f18be3f6bbc19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:12:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:12:13Z,use_quota=True,user_id='44fc9edf90764e9088105b282bec206b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 16:12:21 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-40f72a33-ee93-49b1-b0e8-415471a8d541 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Creating volume 94100df7-6457-4766-9b51-84abe9c315f4 {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 16:12:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-40f72a33-ee93-49b1-b0e8-415471a8d541 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:12:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-40f72a33-ee93-49b1-b0e8-415471a8d541 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:12:21 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-40f72a33-ee93-49b1-b0e8-415471a8d541 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:12:21 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-40f72a33-ee93-49b1-b0e8-415471a8d541 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:12:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-40f72a33-ee93-49b1-b0e8-415471a8d541 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:12:21 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-40f72a33-ee93-49b1-b0e8-415471a8d541 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 16:12:21 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-40f72a33-ee93-49b1-b0e8-415471a8d541 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 16:12:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-40f72a33-ee93-49b1-b0e8-415471a8d541 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-94100df7-6457-4766-9b51-84abe9c315f4 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:21 devstack sudo[111298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-94100df7-6457-4766-9b51-84abe9c315f4 1073741824
Jun 15 16:12:21 devstack sudo[111298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:21 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8329bfbf-592e-4a47-9a11-e15ccffa666a tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c1aaa7e-3fa0-4716-979e-25b68082ff57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efd7d5c7-6a22-4b6e-bcae-7675b4a28623', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:21 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8329bfbf-592e-4a47-9a11-e15ccffa666a tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86e43c02-c5c6-4f0f-8ab3-fae62f2b72f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:21 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-8329bfbf-592e-4a47-9a11-e15ccffa666a tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Volume volume-efd7d5c7-6a22-4b6e-bcae-7675b4a28623 (efd7d5c7-6a22-4b6e-bcae-7675b4a28623): created successfully
Jun 15 16:12:21 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8329bfbf-592e-4a47-9a11-e15ccffa666a tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86e43c02-c5c6-4f0f-8ab3-fae62f2b72f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:21 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-8329bfbf-592e-4a47-9a11-e15ccffa666a tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Flow 'volume_create_manager' (877b0fad-39bb-4528-aa0a-6d3da9128bda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:12:21 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-8329bfbf-592e-4a47-9a11-e15ccffa666a tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Created volume successfully.
Jun 15 16:12:22 devstack sudo[111295]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:22 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-df4eb701-1580-41bb-ab99-29e4f45e22f0 tempest-CreateVolumesFromImageTest-986482857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-43e6e8a2-f6a3-4797-83c2-266dfb86abe8" returned: 0 in 0.615s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:22 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-df4eb701-1580-41bb-ab99-29e4f45e22f0 tempest-CreateVolumesFromImageTest-986482857 None] Lock "cinder-quobyte-43e6e8a2-f6a3-4797-83c2-266dfb86abe8" released by "delete_volume" :: held 1.426s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:12:22 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-df4eb701-1580-41bb-ab99-29e4f45e22f0 tempest-CreateVolumesFromImageTest-986482857 None] Created reservations ['b8612d5a-cd64-44ad-9b3b-e315c9b23a51', '7e76f466-11f2-4c69-a95b-955844490449', '9788ee30-2d2f-4b16-b65e-7c984bd56616', 'df31f2c2-6348-4e64-ad75-9c23a0dda42f'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 16:12:22 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-df4eb701-1580-41bb-ab99-29e4f45e22f0 tempest-CreateVolumesFromImageTest-986482857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:12:22 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-df4eb701-1580-41bb-ab99-29e4f45e22f0 tempest-CreateVolumesFromImageTest-986482857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:12:22 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-df4eb701-1580-41bb-ab99-29e4f45e22f0 tempest-CreateVolumesFromImageTest-986482857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:12:22 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-df4eb701-1580-41bb-ab99-29e4f45e22f0 tempest-CreateVolumesFromImageTest-986482857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:12:22 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-df4eb701-1580-41bb-ab99-29e4f45e22f0 tempest-CreateVolumesFromImageTest-986482857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:12:22 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-df4eb701-1580-41bb-ab99-29e4f45e22f0 tempest-CreateVolumesFromImageTest-986482857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:22 devstack sudo[111301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 16:12:22 devstack sudo[111301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:22 devstack sudo[111298]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:22 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-40f72a33-ee93-49b1-b0e8-415471a8d541 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-94100df7-6457-4766-9b51-84abe9c315f4 1073741824" returned: 0 in 0.815s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:22 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-40f72a33-ee93-49b1-b0e8-415471a8d541 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-94100df7-6457-4766-9b51-84abe9c315f4 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:22 devstack sudo[111306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-94100df7-6457-4766-9b51-84abe9c315f4
Jun 15 16:12:22 devstack sudo[111306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:22 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-33927bd3-4a40-4194-b29b-cf9ef8e3af35 tempest-CreateVolumesFromImageTest-986482857 None] Acquiring lock "cinder-eb40da53-da6b-4838-ab3e-4c52c68f9626-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:12:22 devstack sudo[111301]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:22 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-df4eb701-1580-41bb-ab99-29e4f45e22f0 tempest-CreateVolumesFromImageTest-986482857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.611s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:22 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-df4eb701-1580-41bb-ab99-29e4f45e22f0 tempest-CreateVolumesFromImageTest-986482857 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 16:12:22 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-33927bd3-4a40-4194-b29b-cf9ef8e3af35 tempest-CreateVolumesFromImageTest-986482857 None] Lock "cinder-eb40da53-da6b-4838-ab3e-4c52c68f9626-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:12:22 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-df4eb701-1580-41bb-ab99-29e4f45e22f0 tempest-CreateVolumesFromImageTest-986482857 None] Deleted volume successfully.
Jun 15 16:12:22 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-df4eb701-1580-41bb-ab99-29e4f45e22f0 tempest-CreateVolumesFromImageTest-986482857 None] Lock "cinder-43e6e8a2-f6a3-4797-83c2-266dfb86abe8-delete_volume" released by "delete_volume" :: held 2.295s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:12:23 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-33927bd3-4a40-4194-b29b-cf9ef8e3af35 tempest-CreateVolumesFromImageTest-986482857 None] Acquiring lock "cinder-quobyte-eb40da53-da6b-4838-ab3e-4c52c68f9626" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:12:23 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-33927bd3-4a40-4194-b29b-cf9ef8e3af35 tempest-CreateVolumesFromImageTest-986482857 None] Lock "cinder-quobyte-eb40da53-da6b-4838-ab3e-4c52c68f9626" acquired by "delete_volume" :: waited 0.014s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:12:23 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b449877-edd4-422b-bb33-cd6df2480dc3]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:12:23 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-33927bd3-4a40-4194-b29b-cf9ef8e3af35 tempest-CreateVolumesFromImageTest-986482857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-eb40da53-da6b-4838-ab3e-4c52c68f9626 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:23 devstack sudo[111309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-eb40da53-da6b-4838-ab3e-4c52c68f9626
Jun 15 16:12:23 devstack sudo[111309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:23 devstack sudo[111306]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:23 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-40f72a33-ee93-49b1-b0e8-415471a8d541 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-94100df7-6457-4766-9b51-84abe9c315f4" returned: 0 in 0.644s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:23 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-40f72a33-ee93-49b1-b0e8-415471a8d541 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] <== create_volume: return (1501ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 16:12:23 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-40f72a33-ee93-49b1-b0e8-415471a8d541 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.505s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:12:23 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-e05bca0e-246d-4e30-841a-e5b5e494da23 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.016s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:12:23 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-e05bca0e-246d-4e30-841a-e5b5e494da23 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:12:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1410952659',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17f43a62-26d6-4f80-8468-a31a45fdf993,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34169552e47c463a988f18be3f6bbc19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:12:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:12:13Z,use_quota=True,user_id='44fc9edf90764e9088105b282bec206b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 16:12:23 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-e05bca0e-246d-4e30-841a-e5b5e494da23 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Creating volume 17f43a62-26d6-4f80-8468-a31a45fdf993 {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 16:12:23 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-e05bca0e-246d-4e30-841a-e5b5e494da23 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:12:23 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-e05bca0e-246d-4e30-841a-e5b5e494da23 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:12:23 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-e05bca0e-246d-4e30-841a-e5b5e494da23 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:12:23 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-e05bca0e-246d-4e30-841a-e5b5e494da23 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:12:23 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-e05bca0e-246d-4e30-841a-e5b5e494da23 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:12:23 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-e05bca0e-246d-4e30-841a-e5b5e494da23 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 16:12:23 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-e05bca0e-246d-4e30-841a-e5b5e494da23 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 16:12:23 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-e05bca0e-246d-4e30-841a-e5b5e494da23 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-17f43a62-26d6-4f80-8468-a31a45fdf993 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:23 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-40f72a33-ee93-49b1-b0e8-415471a8d541 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bed499a-bc2a-4baa-8030-6105df7a8a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94100df7-6457-4766-9b51-84abe9c315f4', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:23 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-40f72a33-ee93-49b1-b0e8-415471a8d541 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46ed3b5d-ba76-49d3-80c0-33aef02600db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:23 devstack sudo[111312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-17f43a62-26d6-4f80-8468-a31a45fdf993 1073741824
Jun 15 16:12:23 devstack sudo[111312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:23 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-40f72a33-ee93-49b1-b0e8-415471a8d541 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Volume volume-94100df7-6457-4766-9b51-84abe9c315f4 (94100df7-6457-4766-9b51-84abe9c315f4): created successfully
Jun 15 16:12:23 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-40f72a33-ee93-49b1-b0e8-415471a8d541 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46ed3b5d-ba76-49d3-80c0-33aef02600db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:23 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-40f72a33-ee93-49b1-b0e8-415471a8d541 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Flow 'volume_create_manager' (34652cd7-0596-4221-9664-6d0db52ad6c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:12:23 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-40f72a33-ee93-49b1-b0e8-415471a8d541 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Created volume successfully.
Jun 15 16:12:23 devstack sudo[111309]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:23 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-33927bd3-4a40-4194-b29b-cf9ef8e3af35 tempest-CreateVolumesFromImageTest-986482857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-eb40da53-da6b-4838-ab3e-4c52c68f9626" returned: 0 in 0.692s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:23 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-33927bd3-4a40-4194-b29b-cf9ef8e3af35 tempest-CreateVolumesFromImageTest-986482857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-eb40da53-da6b-4838-ab3e-4c52c68f9626 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:23 devstack sudo[111317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-eb40da53-da6b-4838-ab3e-4c52c68f9626
Jun 15 16:12:23 devstack sudo[111317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:24 devstack sudo[111312]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:24 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-e05bca0e-246d-4e30-841a-e5b5e494da23 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-17f43a62-26d6-4f80-8468-a31a45fdf993 1073741824" returned: 0 in 0.824s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:24 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-e05bca0e-246d-4e30-841a-e5b5e494da23 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-17f43a62-26d6-4f80-8468-a31a45fdf993 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:24 devstack sudo[111325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-17f43a62-26d6-4f80-8468-a31a45fdf993
Jun 15 16:12:24 devstack sudo[111325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:24 devstack sudo[111317]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:24 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-33927bd3-4a40-4194-b29b-cf9ef8e3af35 tempest-CreateVolumesFromImageTest-986482857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-eb40da53-da6b-4838-ab3e-4c52c68f9626" returned: 0 in 0.618s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:24 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-33927bd3-4a40-4194-b29b-cf9ef8e3af35 tempest-CreateVolumesFromImageTest-986482857 None] Lock "cinder-quobyte-eb40da53-da6b-4838-ab3e-4c52c68f9626" released by "delete_volume" :: held 1.357s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:12:24 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-33927bd3-4a40-4194-b29b-cf9ef8e3af35 tempest-CreateVolumesFromImageTest-986482857 None] Created reservations ['a3cafa0c-ae0c-42c9-9296-a1119f6cc6fb', 'f06ca28b-1433-4875-8a2e-e89907f533c3', 'c63efa35-438a-4987-b4d1-356e8fccefdb', '8fd894fe-8f67-4594-9851-1e4b91cf9eb1'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 16:12:24 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-33927bd3-4a40-4194-b29b-cf9ef8e3af35 tempest-CreateVolumesFromImageTest-986482857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:12:24 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-33927bd3-4a40-4194-b29b-cf9ef8e3af35 tempest-CreateVolumesFromImageTest-986482857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:12:24 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-33927bd3-4a40-4194-b29b-cf9ef8e3af35 tempest-CreateVolumesFromImageTest-986482857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:12:24 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-33927bd3-4a40-4194-b29b-cf9ef8e3af35 tempest-CreateVolumesFromImageTest-986482857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:12:24 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-33927bd3-4a40-4194-b29b-cf9ef8e3af35 tempest-CreateVolumesFromImageTest-986482857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:12:24 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-33927bd3-4a40-4194-b29b-cf9ef8e3af35 tempest-CreateVolumesFromImageTest-986482857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:24 devstack sudo[111331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 16:12:24 devstack sudo[111331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:24 devstack sudo[111325]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:24 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-e05bca0e-246d-4e30-841a-e5b5e494da23 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-17f43a62-26d6-4f80-8468-a31a45fdf993" returned: 0 in 0.596s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:24 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-e05bca0e-246d-4e30-841a-e5b5e494da23 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] <== create_volume: return (1470ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 16:12:24 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-e05bca0e-246d-4e30-841a-e5b5e494da23 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.473s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:12:24 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-1e16110a-351f-422a-9307-62e02d26d185 tempest-VolumeImageDependencyTests-761867979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.490s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:12:24 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-1e16110a-351f-422a-9307-62e02d26d185 tempest-VolumeImageDependencyTests-761867979 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:12:10Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c130995e-792e-41cc-983d-cee5247ae06b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4479a314d37d4603b317eba55c4f7c13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:12:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:12:10Z,use_quota=True,user_id='1def98cb552845cb9d2fdb91ed95a9bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 16:12:24 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-1e16110a-351f-422a-9307-62e02d26d185 tempest-VolumeImageDependencyTests-761867979 None] Creating volume c130995e-792e-41cc-983d-cee5247ae06b {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 16:12:24 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-1e16110a-351f-422a-9307-62e02d26d185 tempest-VolumeImageDependencyTests-761867979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:12:24 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-1e16110a-351f-422a-9307-62e02d26d185 tempest-VolumeImageDependencyTests-761867979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:12:24 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-1e16110a-351f-422a-9307-62e02d26d185 tempest-VolumeImageDependencyTests-761867979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:12:24 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-1e16110a-351f-422a-9307-62e02d26d185 tempest-VolumeImageDependencyTests-761867979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:12:24 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-1e16110a-351f-422a-9307-62e02d26d185 tempest-VolumeImageDependencyTests-761867979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:12:24 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-1e16110a-351f-422a-9307-62e02d26d185 tempest-VolumeImageDependencyTests-761867979 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 16:12:24 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-1e16110a-351f-422a-9307-62e02d26d185 tempest-VolumeImageDependencyTests-761867979 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 16:12:24 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-1e16110a-351f-422a-9307-62e02d26d185 tempest-VolumeImageDependencyTests-761867979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-c130995e-792e-41cc-983d-cee5247ae06b 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:24 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e05bca0e-246d-4e30-841a-e5b5e494da23 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6dbc2e7-8572-4182-857b-22f56e88518a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17f43a62-26d6-4f80-8468-a31a45fdf993', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:24 devstack sudo[111334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-c130995e-792e-41cc-983d-cee5247ae06b 1073741824
Jun 15 16:12:24 devstack sudo[111334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:24 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e05bca0e-246d-4e30-841a-e5b5e494da23 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d15ccecb-c5d3-4485-9751-33589f88d42d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:24 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-e05bca0e-246d-4e30-841a-e5b5e494da23 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Volume volume-17f43a62-26d6-4f80-8468-a31a45fdf993 (17f43a62-26d6-4f80-8468-a31a45fdf993): created successfully
Jun 15 16:12:24 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e05bca0e-246d-4e30-841a-e5b5e494da23 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d15ccecb-c5d3-4485-9751-33589f88d42d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:24 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e05bca0e-246d-4e30-841a-e5b5e494da23 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Flow 'volume_create_manager' (433fb125-27c3-48e5-934a-8cce20990821) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:12:24 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-e05bca0e-246d-4e30-841a-e5b5e494da23 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Created volume successfully.
Jun 15 16:12:25 devstack sudo[111331]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:25 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-33927bd3-4a40-4194-b29b-cf9ef8e3af35 tempest-CreateVolumesFromImageTest-986482857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.617s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:25 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-33927bd3-4a40-4194-b29b-cf9ef8e3af35 tempest-CreateVolumesFromImageTest-986482857 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 16:12:25 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-33927bd3-4a40-4194-b29b-cf9ef8e3af35 tempest-CreateVolumesFromImageTest-986482857 None] Deleted volume successfully.
Jun 15 16:12:25 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-33927bd3-4a40-4194-b29b-cf9ef8e3af35 tempest-CreateVolumesFromImageTest-986482857 None] Lock "cinder-eb40da53-da6b-4838-ab3e-4c52c68f9626-delete_volume" released by "delete_volume" :: held 2.215s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:12:25 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-c344d762-1713-422a-8789-75ddce26e940 tempest-CreateVolumesFromImageTest-986482857 None] Acquiring lock "cinder-21f37e2a-55e9-4921-a9d0-cc402cb29d27-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:12:25 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-c344d762-1713-422a-8789-75ddce26e940 tempest-CreateVolumesFromImageTest-986482857 None] Lock "cinder-21f37e2a-55e9-4921-a9d0-cc402cb29d27-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:12:25 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-c344d762-1713-422a-8789-75ddce26e940 tempest-CreateVolumesFromImageTest-986482857 None] Acquiring lock "cinder-quobyte-21f37e2a-55e9-4921-a9d0-cc402cb29d27" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:12:25 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-c344d762-1713-422a-8789-75ddce26e940 tempest-CreateVolumesFromImageTest-986482857 None] Lock "cinder-quobyte-21f37e2a-55e9-4921-a9d0-cc402cb29d27" acquired by "delete_volume" :: waited 0.027s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:12:25 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d32d12ea-5aea-42e1-a2bb-d47e2597f6ae]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:12:25 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c344d762-1713-422a-8789-75ddce26e940 tempest-CreateVolumesFromImageTest-986482857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-21f37e2a-55e9-4921-a9d0-cc402cb29d27 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:25 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-bfd1ab29-f0d6-4ef3-8c88-ec0f0a8fd80a tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Acquiring lock "cinder-17f43a62-26d6-4f80-8468-a31a45fdf993-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:12:25 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-bfd1ab29-f0d6-4ef3-8c88-ec0f0a8fd80a tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Lock "cinder-17f43a62-26d6-4f80-8468-a31a45fdf993-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:12:25 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-bfd1ab29-f0d6-4ef3-8c88-ec0f0a8fd80a tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Acquiring lock "cinder-quobyte-17f43a62-26d6-4f80-8468-a31a45fdf993" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:12:25 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-bfd1ab29-f0d6-4ef3-8c88-ec0f0a8fd80a tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Lock "cinder-quobyte-17f43a62-26d6-4f80-8468-a31a45fdf993" acquired by "delete_volume" :: waited 0.019s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:12:25 devstack sudo[111338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-21f37e2a-55e9-4921-a9d0-cc402cb29d27
Jun 15 16:12:25 devstack sudo[111338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:25 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1435aa13-9070-481a-8fc5-788727fdb17f]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:12:25 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-bfd1ab29-f0d6-4ef3-8c88-ec0f0a8fd80a tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-17f43a62-26d6-4f80-8468-a31a45fdf993 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:25 devstack sudo[111343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-17f43a62-26d6-4f80-8468-a31a45fdf993
Jun 15 16:12:25 devstack sudo[111343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:25 devstack sudo[111334]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:25 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-1e16110a-351f-422a-9307-62e02d26d185 tempest-VolumeImageDependencyTests-761867979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-c130995e-792e-41cc-983d-cee5247ae06b 1073741824" returned: 0 in 0.861s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:25 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-1e16110a-351f-422a-9307-62e02d26d185 tempest-VolumeImageDependencyTests-761867979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-c130995e-792e-41cc-983d-cee5247ae06b {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:25 devstack sudo[111346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-c130995e-792e-41cc-983d-cee5247ae06b
Jun 15 16:12:25 devstack sudo[111346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:26 devstack sudo[111338]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:26 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c344d762-1713-422a-8789-75ddce26e940 tempest-CreateVolumesFromImageTest-986482857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-21f37e2a-55e9-4921-a9d0-cc402cb29d27" returned: 0 in 0.773s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:26 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c344d762-1713-422a-8789-75ddce26e940 tempest-CreateVolumesFromImageTest-986482857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-21f37e2a-55e9-4921-a9d0-cc402cb29d27 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:26 devstack sudo[111353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-21f37e2a-55e9-4921-a9d0-cc402cb29d27
Jun 15 16:12:26 devstack sudo[111353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:26 devstack sudo[111343]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:26 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-bfd1ab29-f0d6-4ef3-8c88-ec0f0a8fd80a tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-17f43a62-26d6-4f80-8468-a31a45fdf993" returned: 0 in 0.761s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:26 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-bfd1ab29-f0d6-4ef3-8c88-ec0f0a8fd80a tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-17f43a62-26d6-4f80-8468-a31a45fdf993 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:26 devstack sudo[111357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-17f43a62-26d6-4f80-8468-a31a45fdf993
Jun 15 16:12:26 devstack sudo[111357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:26 devstack sudo[111346]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:26 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-1e16110a-351f-422a-9307-62e02d26d185 tempest-VolumeImageDependencyTests-761867979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-c130995e-792e-41cc-983d-cee5247ae06b" returned: 0 in 0.630s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:26 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-1e16110a-351f-422a-9307-62e02d26d185 tempest-VolumeImageDependencyTests-761867979 None] <== create_volume: return (1552ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 16:12:26 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-1e16110a-351f-422a-9307-62e02d26d185 tempest-VolumeImageDependencyTests-761867979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.556s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:12:26 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-c31a8b8b-a9e2-4db6-ae2e-046a7f4215ed tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.429s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:12:26 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-c31a8b8b-a9e2-4db6-ae2e-046a7f4215ed tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:12:10Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d89e0e0-a019-419e-9e12-6aee4dbc88e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32d33ce746a14ec882cb31ac04bc5285',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:12:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:12:11Z,use_quota=True,user_id='ab33fd116d4c462f8e889f48c5aa2c1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6a1045de-7dc2-4902-939e-f3b2605b9298),volume_type_id=6a1045de-7dc2-4902-939e-f3b2605b9298)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 16:12:26 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-c31a8b8b-a9e2-4db6-ae2e-046a7f4215ed tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] Creating volume 7d89e0e0-a019-419e-9e12-6aee4dbc88e1 {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 16:12:26 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-c31a8b8b-a9e2-4db6-ae2e-046a7f4215ed tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:12:26 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-c31a8b8b-a9e2-4db6-ae2e-046a7f4215ed tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:12:26 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-c31a8b8b-a9e2-4db6-ae2e-046a7f4215ed tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:12:26 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-c31a8b8b-a9e2-4db6-ae2e-046a7f4215ed tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:12:26 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-c31a8b8b-a9e2-4db6-ae2e-046a7f4215ed tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:12:26 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-c31a8b8b-a9e2-4db6-ae2e-046a7f4215ed tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 16:12:26 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-c31a8b8b-a9e2-4db6-ae2e-046a7f4215ed tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 16:12:26 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c31a8b8b-a9e2-4db6-ae2e-046a7f4215ed tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-7d89e0e0-a019-419e-9e12-6aee4dbc88e1 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:26 devstack sudo[111359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-7d89e0e0-a019-419e-9e12-6aee4dbc88e1 1073741824
Jun 15 16:12:26 devstack sudo[111359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:26 devstack cinder-volume[91863]: DEBUG cinder.volume.volume_utils [None req-1e16110a-351f-422a-9307-62e02d26d185 tempest-VolumeImageDependencyTests-761867979 None] Attempting download of 90cfc52a-50f6-4fb9-b3d1-9b0d2193e47c ((None, [{'url': 'file:///opt/stack/data/glance/images/90cfc52a-50f6-4fb9-b3d1-9b0d2193e47c', 'metadata': {}}])) to volume c130995e-792e-41cc-983d-cee5247ae06b. {{(pid=91863) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 15 16:12:26 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d8b5f4-9cbc-48ef-929c-44d92ffe9b8d]: (4, 'raw') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:12:26 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-1e16110a-351f-422a-9307-62e02d26d185 tempest-VolumeImageDependencyTests-761867979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_90cfc52a-50f6-4fb9-b3d1-9b0d2193e47c_cigq1h2n {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:26 devstack sudo[111361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_90cfc52a-50f6-4fb9-b3d1-9b0d2193e47c_cigq1h2n
Jun 15 16:12:26 devstack sudo[111361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:26 devstack sudo[111353]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:26 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c344d762-1713-422a-8789-75ddce26e940 tempest-CreateVolumesFromImageTest-986482857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-21f37e2a-55e9-4921-a9d0-cc402cb29d27" returned: 0 in 0.650s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:26 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-c344d762-1713-422a-8789-75ddce26e940 tempest-CreateVolumesFromImageTest-986482857 None] Lock "cinder-quobyte-21f37e2a-55e9-4921-a9d0-cc402cb29d27" released by "delete_volume" :: held 1.482s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:12:26 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-c344d762-1713-422a-8789-75ddce26e940 tempest-CreateVolumesFromImageTest-986482857 None] Created reservations ['425b55c0-a7f7-477e-8fca-6c548792fae3', '551f7160-6d79-4274-952b-63737bdd321b', 'c9d352e2-c97f-4115-9d5f-8fc76ddd76ff', '6cda9a2b-a668-4853-a023-5d3d151a222b'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 16:12:26 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-c344d762-1713-422a-8789-75ddce26e940 tempest-CreateVolumesFromImageTest-986482857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:12:26 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-c344d762-1713-422a-8789-75ddce26e940 tempest-CreateVolumesFromImageTest-986482857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:12:26 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-c344d762-1713-422a-8789-75ddce26e940 tempest-CreateVolumesFromImageTest-986482857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:12:26 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-c344d762-1713-422a-8789-75ddce26e940 tempest-CreateVolumesFromImageTest-986482857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:12:26 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-c344d762-1713-422a-8789-75ddce26e940 tempest-CreateVolumesFromImageTest-986482857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:12:26 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c344d762-1713-422a-8789-75ddce26e940 tempest-CreateVolumesFromImageTest-986482857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:27 devstack sudo[111368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 16:12:27 devstack sudo[111368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:27 devstack sudo[111357]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:27 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-bfd1ab29-f0d6-4ef3-8c88-ec0f0a8fd80a tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-17f43a62-26d6-4f80-8468-a31a45fdf993" returned: 0 in 0.815s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:27 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-bfd1ab29-f0d6-4ef3-8c88-ec0f0a8fd80a tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Lock "cinder-quobyte-17f43a62-26d6-4f80-8468-a31a45fdf993" released by "delete_volume" :: held 1.626s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:12:27 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-bfd1ab29-f0d6-4ef3-8c88-ec0f0a8fd80a tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Created reservations ['2da2f90b-c54b-4187-b10d-1dea3a55e3a3', '05704a9e-ef38-4087-92d1-02a62726b6b1', 'bac4241a-e39f-4e5e-8346-c8928d75a14c', 'f623ef38-7900-4019-b39a-43c4f5828a01'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 16:12:27 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-bfd1ab29-f0d6-4ef3-8c88-ec0f0a8fd80a tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:12:27 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-bfd1ab29-f0d6-4ef3-8c88-ec0f0a8fd80a tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:12:27 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-bfd1ab29-f0d6-4ef3-8c88-ec0f0a8fd80a tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:12:27 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-bfd1ab29-f0d6-4ef3-8c88-ec0f0a8fd80a tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:12:27 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-bfd1ab29-f0d6-4ef3-8c88-ec0f0a8fd80a tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:12:27 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-bfd1ab29-f0d6-4ef3-8c88-ec0f0a8fd80a tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:27 devstack sudo[111359]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:27 devstack sudo[111372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 16:12:27 devstack sudo[111372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:27 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c31a8b8b-a9e2-4db6-ae2e-046a7f4215ed tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-7d89e0e0-a019-419e-9e12-6aee4dbc88e1 1073741824" returned: 0 in 0.901s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:27 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c31a8b8b-a9e2-4db6-ae2e-046a7f4215ed tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-7d89e0e0-a019-419e-9e12-6aee4dbc88e1 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:27 devstack sudo[111361]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:27 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-1e16110a-351f-422a-9307-62e02d26d185 tempest-VolumeImageDependencyTests-761867979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_90cfc52a-50f6-4fb9-b3d1-9b0d2193e47c_cigq1h2n" returned: 0 in 0.859s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:27 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-1e16110a-351f-422a-9307-62e02d26d185 tempest-VolumeImageDependencyTests-761867979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_90cfc52a-50f6-4fb9-b3d1-9b0d2193e47c_cigq1h2n {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:27 devstack sudo[111374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-7d89e0e0-a019-419e-9e12-6aee4dbc88e1
Jun 15 16:12:27 devstack sudo[111374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:27 devstack sudo[111376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_90cfc52a-50f6-4fb9-b3d1-9b0d2193e47c_cigq1h2n
Jun 15 16:12:27 devstack sudo[111376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:27 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-99a55083-0196-4a4b-9b4c-906e78c0fd5b tempest-CreateVolumesFromImageTest-986482857 None] Acquiring lock "cinder-47643711-cc07-430c-8a9f-259fa89d74d2-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:12:27 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-99a55083-0196-4a4b-9b4c-906e78c0fd5b tempest-CreateVolumesFromImageTest-986482857 None] Lock "cinder-47643711-cc07-430c-8a9f-259fa89d74d2-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:12:27 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-99a55083-0196-4a4b-9b4c-906e78c0fd5b tempest-CreateVolumesFromImageTest-986482857 None] Acquiring lock "cinder-quobyte-47643711-cc07-430c-8a9f-259fa89d74d2" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:12:27 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-99a55083-0196-4a4b-9b4c-906e78c0fd5b tempest-CreateVolumesFromImageTest-986482857 None] Lock "cinder-quobyte-47643711-cc07-430c-8a9f-259fa89d74d2" acquired by "delete_volume" :: waited 0.025s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:12:27 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[301ed332-5738-49bb-8e7d-481c85b4f169]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:12:27 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-99a55083-0196-4a4b-9b4c-906e78c0fd5b tempest-CreateVolumesFromImageTest-986482857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-47643711-cc07-430c-8a9f-259fa89d74d2 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:27 devstack sudo[111368]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:27 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c344d762-1713-422a-8789-75ddce26e940 tempest-CreateVolumesFromImageTest-986482857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.794s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:27 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-c344d762-1713-422a-8789-75ddce26e940 tempest-CreateVolumesFromImageTest-986482857 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 16:12:27 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-c344d762-1713-422a-8789-75ddce26e940 tempest-CreateVolumesFromImageTest-986482857 None] Deleted volume successfully.
Jun 15 16:12:27 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-45d5379b-1fa1-4965-be77-5d738d82bbef tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Acquiring lock "cinder-94100df7-6457-4766-9b51-84abe9c315f4-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:12:27 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-c344d762-1713-422a-8789-75ddce26e940 tempest-CreateVolumesFromImageTest-986482857 None] Lock "cinder-21f37e2a-55e9-4921-a9d0-cc402cb29d27-delete_volume" released by "delete_volume" :: held 2.624s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:12:27 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-45d5379b-1fa1-4965-be77-5d738d82bbef tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Lock "cinder-94100df7-6457-4766-9b51-84abe9c315f4-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:12:27 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-45d5379b-1fa1-4965-be77-5d738d82bbef tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Acquiring lock "cinder-quobyte-94100df7-6457-4766-9b51-84abe9c315f4" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:12:27 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-45d5379b-1fa1-4965-be77-5d738d82bbef tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Lock "cinder-quobyte-94100df7-6457-4766-9b51-84abe9c315f4" acquired by "delete_volume" :: waited 0.027s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:12:27 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fcf3e76-8d56-434e-a00b-ea46505672b3]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:12:28 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-45d5379b-1fa1-4965-be77-5d738d82bbef tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-94100df7-6457-4766-9b51-84abe9c315f4 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:28 devstack sudo[111379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-47643711-cc07-430c-8a9f-259fa89d74d2
Jun 15 16:12:28 devstack sudo[111379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:28 devstack sudo[111381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-94100df7-6457-4766-9b51-84abe9c315f4
Jun 15 16:12:28 devstack sudo[111381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:28 devstack sudo[111372]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:28 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-bfd1ab29-f0d6-4ef3-8c88-ec0f0a8fd80a tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.873s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:28 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-bfd1ab29-f0d6-4ef3-8c88-ec0f0a8fd80a tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 16:12:28 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-bfd1ab29-f0d6-4ef3-8c88-ec0f0a8fd80a tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Deleted volume successfully.
Jun 15 16:12:28 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-bfd1ab29-f0d6-4ef3-8c88-ec0f0a8fd80a tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Lock "cinder-17f43a62-26d6-4f80-8468-a31a45fdf993-delete_volume" released by "delete_volume" :: held 2.803s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:12:28 devstack sudo[111376]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:28 devstack sudo[111374]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:28 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-1e16110a-351f-422a-9307-62e02d26d185 tempest-VolumeImageDependencyTests-761867979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_90cfc52a-50f6-4fb9-b3d1-9b0d2193e47c_cigq1h2n" returned: 1 in 1.034s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:28 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-1e16110a-351f-422a-9307-62e02d26d185 tempest-VolumeImageDependencyTests-761867979 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_90cfc52a-50f6-4fb9-b3d1-9b0d2193e47c_cigq1h2n' failed. Not Retrying. {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 15 16:12:28 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e9e647-ce47-423f-b341-9f97c5e4e6d2]: (4, 'raw') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:12:28 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c31a8b8b-a9e2-4db6-ae2e-046a7f4215ed tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-7d89e0e0-a019-419e-9e12-6aee4dbc88e1" returned: 0 in 1.062s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:28 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-1e16110a-351f-422a-9307-62e02d26d185 tempest-VolumeImageDependencyTests-761867979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_90cfc52a-50f6-4fb9-b3d1-9b0d2193e47c_z1szlnpndevstack@QuobyteHD {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:28 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-c31a8b8b-a9e2-4db6-ae2e-046a7f4215ed tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] <== create_volume: return (2026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 16:12:28 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-c31a8b8b-a9e2-4db6-ae2e-046a7f4215ed tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.032s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:12:28 devstack cinder-volume[91863]: DEBUG cinder.volume.volume_utils [None req-c31a8b8b-a9e2-4db6-ae2e-046a7f4215ed tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] Attempting download of 39f5e834-44ad-4d59-bd8b-97ed9b791648 ((None, [{'url': 'file:///opt/stack/data/glance/images/39f5e834-44ad-4d59-bd8b-97ed9b791648', 'metadata': {}}])) to volume 7d89e0e0-a019-419e-9e12-6aee4dbc88e1. {{(pid=91863) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 15 16:12:28 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[6783ffbb-2142-4527-a9bf-d595d325bcaf]: (4, 'raw') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:12:28 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c31a8b8b-a9e2-4db6-ae2e-046a7f4215ed tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_39f5e834-44ad-4d59-bd8b-97ed9b791648_k4y7jyek {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:28 devstack sudo[111387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_90cfc52a-50f6-4fb9-b3d1-9b0d2193e47c_z1szlnpndevstack@QuobyteHD
Jun 15 16:12:28 devstack sudo[111387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:28 devstack sudo[111388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_39f5e834-44ad-4d59-bd8b-97ed9b791648_k4y7jyek
Jun 15 16:12:28 devstack sudo[111388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:28 devstack sudo[111379]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:28 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-99a55083-0196-4a4b-9b4c-906e78c0fd5b tempest-CreateVolumesFromImageTest-986482857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-47643711-cc07-430c-8a9f-259fa89d74d2" returned: 0 in 1.006s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:28 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-99a55083-0196-4a4b-9b4c-906e78c0fd5b tempest-CreateVolumesFromImageTest-986482857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-47643711-cc07-430c-8a9f-259fa89d74d2 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:28 devstack sudo[111395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-47643711-cc07-430c-8a9f-259fa89d74d2
Jun 15 16:12:28 devstack sudo[111395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:28 devstack sudo[111381]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:28 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-45d5379b-1fa1-4965-be77-5d738d82bbef tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-94100df7-6457-4766-9b51-84abe9c315f4" returned: 0 in 0.931s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:28 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-45d5379b-1fa1-4965-be77-5d738d82bbef tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-94100df7-6457-4766-9b51-84abe9c315f4 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:28 devstack sudo[111401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-94100df7-6457-4766-9b51-84abe9c315f4
Jun 15 16:12:28 devstack sudo[111401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:29 devstack sudo[111387]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:29 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-1e16110a-351f-422a-9307-62e02d26d185 tempest-VolumeImageDependencyTests-761867979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_90cfc52a-50f6-4fb9-b3d1-9b0d2193e47c_z1szlnpndevstack@QuobyteHD" returned: 0 in 0.800s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:29 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-1e16110a-351f-422a-9307-62e02d26d185 tempest-VolumeImageDependencyTests-761867979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_90cfc52a-50f6-4fb9-b3d1-9b0d2193e47c_z1szlnpndevstack@QuobyteHD {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:29 devstack sudo[111388]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:29 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c31a8b8b-a9e2-4db6-ae2e-046a7f4215ed tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_39f5e834-44ad-4d59-bd8b-97ed9b791648_k4y7jyek" returned: 0 in 0.723s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:29 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c31a8b8b-a9e2-4db6-ae2e-046a7f4215ed tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_39f5e834-44ad-4d59-bd8b-97ed9b791648_k4y7jyek {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:29 devstack sudo[111407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_90cfc52a-50f6-4fb9-b3d1-9b0d2193e47c_z1szlnpndevstack@QuobyteHD
Jun 15 16:12:29 devstack sudo[111407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:29 devstack sudo[111408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_39f5e834-44ad-4d59-bd8b-97ed9b791648_k4y7jyek
Jun 15 16:12:29 devstack sudo[111408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:29 devstack sudo[111395]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:29 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-99a55083-0196-4a4b-9b4c-906e78c0fd5b tempest-CreateVolumesFromImageTest-986482857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-47643711-cc07-430c-8a9f-259fa89d74d2" returned: 0 in 0.683s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:29 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-99a55083-0196-4a4b-9b4c-906e78c0fd5b tempest-CreateVolumesFromImageTest-986482857 None] Lock "cinder-quobyte-47643711-cc07-430c-8a9f-259fa89d74d2" released by "delete_volume" :: held 1.747s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:12:29 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-99a55083-0196-4a4b-9b4c-906e78c0fd5b tempest-CreateVolumesFromImageTest-986482857 None] Created reservations ['42fa0047-6c39-4bfd-b835-4302db87fd8f', '5aa08b66-899c-434f-b4ec-43b0e8d627a3', 'dd845a08-f9fb-4151-87ea-f51a4b346321', '767dc727-5582-4c70-a4c5-9905501a5555'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 16:12:29 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-99a55083-0196-4a4b-9b4c-906e78c0fd5b tempest-CreateVolumesFromImageTest-986482857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:12:29 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-99a55083-0196-4a4b-9b4c-906e78c0fd5b tempest-CreateVolumesFromImageTest-986482857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:12:29 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-99a55083-0196-4a4b-9b4c-906e78c0fd5b tempest-CreateVolumesFromImageTest-986482857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:12:29 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-99a55083-0196-4a4b-9b4c-906e78c0fd5b tempest-CreateVolumesFromImageTest-986482857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:12:29 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-99a55083-0196-4a4b-9b4c-906e78c0fd5b tempest-CreateVolumesFromImageTest-986482857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:12:29 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-99a55083-0196-4a4b-9b4c-906e78c0fd5b tempest-CreateVolumesFromImageTest-986482857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:29 devstack sudo[111401]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:29 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-45d5379b-1fa1-4965-be77-5d738d82bbef tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-94100df7-6457-4766-9b51-84abe9c315f4" returned: 0 in 0.669s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:29 devstack sudo[111413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 16:12:29 devstack sudo[111413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:29 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-45d5379b-1fa1-4965-be77-5d738d82bbef tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Lock "cinder-quobyte-94100df7-6457-4766-9b51-84abe9c315f4" released by "delete_volume" :: held 1.661s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:12:29 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-45d5379b-1fa1-4965-be77-5d738d82bbef tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Created reservations ['a2f1883b-e74a-485f-8c9f-fc7d724fd439', '9cee3883-d0c1-4dda-ae6f-7918caf14244', '0375614a-3890-4543-8733-15069e8f6960', '429ccfce-a961-43ae-bf6c-5df6e729e266'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 16:12:29 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-45d5379b-1fa1-4965-be77-5d738d82bbef tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:12:29 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-45d5379b-1fa1-4965-be77-5d738d82bbef tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:12:29 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-45d5379b-1fa1-4965-be77-5d738d82bbef tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:12:29 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-45d5379b-1fa1-4965-be77-5d738d82bbef tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:12:29 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-45d5379b-1fa1-4965-be77-5d738d82bbef tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:12:29 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-45d5379b-1fa1-4965-be77-5d738d82bbef tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:29 devstack sudo[111415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 16:12:29 devstack sudo[111415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:30 devstack sudo[111407]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:30 devstack sudo[111408]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:30 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-1e16110a-351f-422a-9307-62e02d26d185 tempest-VolumeImageDependencyTests-761867979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_90cfc52a-50f6-4fb9-b3d1-9b0d2193e47c_z1szlnpndevstack@QuobyteHD" returned: 1 in 0.808s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:30 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-1e16110a-351f-422a-9307-62e02d26d185 tempest-VolumeImageDependencyTests-761867979 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_90cfc52a-50f6-4fb9-b3d1-9b0d2193e47c_z1szlnpndevstack@QuobyteHD' failed. Not Retrying. {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 15 16:12:30 devstack cinder-volume[91863]: DEBUG cinder.image.image_utils [None req-1e16110a-351f-422a-9307-62e02d26d185 tempest-VolumeImageDependencyTests-761867979 None] 90cfc52a-50f6-4fb9-b3d1-9b0d2193e47c was raw, converting to raw {{(pid=91863) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 15 16:12:30 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-1e16110a-351f-422a-9307-62e02d26d185 tempest-VolumeImageDependencyTests-761867979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_90cfc52a-50f6-4fb9-b3d1-9b0d2193e47c_z1szlnpndevstack@QuobyteHD /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-c130995e-792e-41cc-983d-cee5247ae06b {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:30 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c31a8b8b-a9e2-4db6-ae2e-046a7f4215ed tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_39f5e834-44ad-4d59-bd8b-97ed9b791648_k4y7jyek" returned: 1 in 0.818s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:30 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c31a8b8b-a9e2-4db6-ae2e-046a7f4215ed tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_39f5e834-44ad-4d59-bd8b-97ed9b791648_k4y7jyek' failed. Not Retrying. {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 15 16:12:30 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c0c402c-ea2a-47bb-b88d-5a87794405e1]: (4, 'raw') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:12:30 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c31a8b8b-a9e2-4db6-ae2e-046a7f4215ed tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_39f5e834-44ad-4d59-bd8b-97ed9b791648_elh7751ldevstack@QuobyteHD {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:30 devstack sudo[111422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_90cfc52a-50f6-4fb9-b3d1-9b0d2193e47c_z1szlnpndevstack@QuobyteHD /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-c130995e-792e-41cc-983d-cee5247ae06b
Jun 15 16:12:30 devstack sudo[111422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:30 devstack sudo[111423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_39f5e834-44ad-4d59-bd8b-97ed9b791648_elh7751ldevstack@QuobyteHD
Jun 15 16:12:30 devstack sudo[111423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:30 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-0474f059-530a-4e50-aa78-fcc53b175e66 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Acquiring lock "cinder-efd7d5c7-6a22-4b6e-bcae-7675b4a28623-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:12:30 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-0474f059-530a-4e50-aa78-fcc53b175e66 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Lock "cinder-efd7d5c7-6a22-4b6e-bcae-7675b4a28623-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:12:30 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-0474f059-530a-4e50-aa78-fcc53b175e66 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Acquiring lock "cinder-quobyte-efd7d5c7-6a22-4b6e-bcae-7675b4a28623" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:12:30 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-0474f059-530a-4e50-aa78-fcc53b175e66 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Lock "cinder-quobyte-efd7d5c7-6a22-4b6e-bcae-7675b4a28623" acquired by "delete_volume" :: waited 0.025s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:12:30 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[554ba849-ad97-41f8-89e3-bcb032ad0361]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:12:30 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-0474f059-530a-4e50-aa78-fcc53b175e66 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-efd7d5c7-6a22-4b6e-bcae-7675b4a28623 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:30 devstack sudo[111413]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:30 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-99a55083-0196-4a4b-9b4c-906e78c0fd5b tempest-CreateVolumesFromImageTest-986482857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.934s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:30 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-99a55083-0196-4a4b-9b4c-906e78c0fd5b tempest-CreateVolumesFromImageTest-986482857 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 16:12:30 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-99a55083-0196-4a4b-9b4c-906e78c0fd5b tempest-CreateVolumesFromImageTest-986482857 None] Deleted volume successfully.
Jun 15 16:12:30 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-99a55083-0196-4a4b-9b4c-906e78c0fd5b tempest-CreateVolumesFromImageTest-986482857 None] Lock "cinder-47643711-cc07-430c-8a9f-259fa89d74d2-delete_volume" released by "delete_volume" :: held 2.974s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:12:30 devstack sudo[111427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-efd7d5c7-6a22-4b6e-bcae-7675b4a28623
Jun 15 16:12:30 devstack sudo[111427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:30 devstack sudo[111415]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:30 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-45d5379b-1fa1-4965-be77-5d738d82bbef tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.962s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:30 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-45d5379b-1fa1-4965-be77-5d738d82bbef tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 16:12:30 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-45d5379b-1fa1-4965-be77-5d738d82bbef tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Deleted volume successfully.
Jun 15 16:12:30 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-45d5379b-1fa1-4965-be77-5d738d82bbef tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Lock "cinder-94100df7-6457-4766-9b51-84abe9c315f4-delete_volume" released by "delete_volume" :: held 2.894s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:12:31 devstack sudo[111423]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c31a8b8b-a9e2-4db6-ae2e-046a7f4215ed tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_39f5e834-44ad-4d59-bd8b-97ed9b791648_elh7751ldevstack@QuobyteHD" returned: 0 in 0.963s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c31a8b8b-a9e2-4db6-ae2e-046a7f4215ed tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_39f5e834-44ad-4d59-bd8b-97ed9b791648_elh7751ldevstack@QuobyteHD {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:31 devstack cinder-volume[91863]: DEBUG oslo_service.periodic_task [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 16:12:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:12:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:12:31 devstack sudo[111434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_39f5e834-44ad-4d59-bd8b-97ed9b791648_elh7751ldevstack@QuobyteHD
Jun 15 16:12:31 devstack sudo[111434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:31 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:12:31 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:12:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:12:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:31 devstack sudo[111437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 16:12:31 devstack sudo[111437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:31 devstack sudo[111422]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-1e16110a-351f-422a-9307-62e02d26d185 tempest-VolumeImageDependencyTests-761867979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_90cfc52a-50f6-4fb9-b3d1-9b0d2193e47c_z1szlnpndevstack@QuobyteHD /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-c130995e-792e-41cc-983d-cee5247ae06b" returned: 0 in 1.200s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:31 devstack cinder-volume[91863]: DEBUG cinder.image.image_utils [None req-1e16110a-351f-422a-9307-62e02d26d185 tempest-VolumeImageDependencyTests-761867979 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_90cfc52a-50f6-4fb9-b3d1-9b0d2193e47c_z1szlnpndevstack@QuobyteHD, size 0.00 MB, duration 1.20 sec, destination /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-c130995e-792e-41cc-983d-cee5247ae06b {{(pid=91863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 15 16:12:31 devstack cinder-volume[91863]: INFO cinder.image.image_utils [None req-1e16110a-351f-422a-9307-62e02d26d185 tempest-VolumeImageDependencyTests-761867979 None] Converted 0.00 MB image at 0.00 MB/s
Jun 15 16:12:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-1e16110a-351f-422a-9307-62e02d26d185 tempest-VolumeImageDependencyTests-761867979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-c130995e-792e-41cc-983d-cee5247ae06b 1G {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:31 devstack sudo[111442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-c130995e-792e-41cc-983d-cee5247ae06b 1G
Jun 15 16:12:31 devstack sudo[111442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:31 devstack sudo[111427]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-0474f059-530a-4e50-aa78-fcc53b175e66 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-efd7d5c7-6a22-4b6e-bcae-7675b4a28623" returned: 0 in 0.993s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-0474f059-530a-4e50-aa78-fcc53b175e66 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-efd7d5c7-6a22-4b6e-bcae-7675b4a28623 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:31 devstack sudo[111444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-efd7d5c7-6a22-4b6e-bcae-7675b4a28623
Jun 15 16:12:31 devstack sudo[111444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:31 devstack sudo[111437]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.769s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:31 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 16:12:31 devstack cinder-volume[91863]: DEBUG oslo_service.periodic_task [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Running periodic task VolumeManager._thread_info {{(pid=91863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 16:12:31 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] thread count: 28 {{(pid=91863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 15 16:12:31 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] thread info: [<_MainThread(MainThread, started 131088232640640)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131088122704576)>, <Thread(Thread-3 (stat_writer), started daemon 131088123058112)>, <Thread(Rabbit-heartbeat, started daemon 131088121268864)>, <Thread(Thread-5 (_runner), started daemon 131088121904192)>, <Thread(Thread-7 (_runner), started daemon 131088122037248)>, <Thread(fd_logger, started daemon 131088119630784)>, <Thread(privsep_reader, started daemon 131088119781440)>, <Thread(tpool_thread_0, started daemon 131088111617728)>, <Thread(tpool_thread_1, started daemon 131088103225024)>, <Thread(tpool_thread_2, started daemon 131088094832320)>, <Thread(tpool_thread_3, started daemon 131088086439616)>, <Thread(tpool_thread_4, started daemon 131088078046912)>, <Thread(tpool_thread_5, started daemon 131088069654208)>, <Thread(tpool_thread_6, started daemon 131088061261504)>, <Thread(tpool_thread_7, started daemon 131088052868800)>, <Thread(tpool_thread_8, started daemon 131088044476096)>, <Thread(tpool_thread_9, started daemon 131088036083392)>, <Thread(tpool_thread_10, started daemon 131088027690688)>, <Thread(tpool_thread_11, started daemon 131088019297984)>, <Thread(tpool_thread_12, started daemon 131088010905280)>, <Thread(tpool_thread_13, started daemon 131088002512576)>, <Thread(tpool_thread_14, started daemon 131087994119872)>, <Thread(tpool_thread_15, started daemon 131087985727168)>, <Thread(tpool_thread_16, started daemon 131087977334464)>, <Thread(tpool_thread_17, started daemon 131087968941760)>, <Thread(tpool_thread_18, started daemon 131087960549056)>, <Thread(tpool_thread_19, started daemon 131087952156352)>] {{(pid=91863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 15 16:12:31 devstack sudo[111434]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c31a8b8b-a9e2-4db6-ae2e-046a7f4215ed tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_39f5e834-44ad-4d59-bd8b-97ed9b791648_elh7751ldevstack@QuobyteHD" returned: 1 in 0.934s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c31a8b8b-a9e2-4db6-ae2e-046a7f4215ed tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_39f5e834-44ad-4d59-bd8b-97ed9b791648_elh7751ldevstack@QuobyteHD' failed. Not Retrying. {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 15 16:12:31 devstack cinder-volume[91863]: DEBUG cinder.image.image_utils [None req-c31a8b8b-a9e2-4db6-ae2e-046a7f4215ed tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] 39f5e834-44ad-4d59-bd8b-97ed9b791648 was raw, converting to raw {{(pid=91863) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 15 16:12:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c31a8b8b-a9e2-4db6-ae2e-046a7f4215ed tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_39f5e834-44ad-4d59-bd8b-97ed9b791648_elh7751ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-7d89e0e0-a019-419e-9e12-6aee4dbc88e1 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:32 devstack sudo[111450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_39f5e834-44ad-4d59-bd8b-97ed9b791648_elh7751ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-7d89e0e0-a019-419e-9e12-6aee4dbc88e1
Jun 15 16:12:32 devstack sudo[111450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:32 devstack sudo[111444]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:32 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-0474f059-530a-4e50-aa78-fcc53b175e66 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-efd7d5c7-6a22-4b6e-bcae-7675b4a28623" returned: 0 in 0.788s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:32 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-0474f059-530a-4e50-aa78-fcc53b175e66 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Lock "cinder-quobyte-efd7d5c7-6a22-4b6e-bcae-7675b4a28623" released by "delete_volume" :: held 1.849s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:12:32 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-0474f059-530a-4e50-aa78-fcc53b175e66 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Created reservations ['81ea039f-b24f-40c3-a202-7842b582e898', '56e87ae4-24e4-4de1-b646-017ca9526801', '5d3e5c37-512c-4174-bb98-96ffcdbaee8a', 'eeb26ac8-6425-4817-83c5-b9fa11155a43'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 16:12:32 devstack sudo[111442]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:32 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-1e16110a-351f-422a-9307-62e02d26d185 tempest-VolumeImageDependencyTests-761867979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-c130995e-792e-41cc-983d-cee5247ae06b 1G" returned: 0 in 1.065s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:32 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-0474f059-530a-4e50-aa78-fcc53b175e66 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:12:32 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-0474f059-530a-4e50-aa78-fcc53b175e66 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:12:32 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-0474f059-530a-4e50-aa78-fcc53b175e66 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:12:32 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-0474f059-530a-4e50-aa78-fcc53b175e66 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:12:32 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-0474f059-530a-4e50-aa78-fcc53b175e66 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:12:32 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-0474f059-530a-4e50-aa78-fcc53b175e66 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:32 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c07138-d187-4902-8266-b4d46f86e7cf]: (4, 'raw') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:12:32 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-1e16110a-351f-422a-9307-62e02d26d185 tempest-VolumeImageDependencyTests-761867979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-c130995e-792e-41cc-983d-cee5247ae06b {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:32 devstack sudo[111456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 16:12:32 devstack sudo[111456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:32 devstack sudo[111457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-c130995e-792e-41cc-983d-cee5247ae06b
Jun 15 16:12:32 devstack sudo[111457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:32 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-9d340512-a61f-44f2-a070-0af306485edc tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Acquiring lock "cinder-ee6bb652-4fd7-4e2a-a015-22326843139a-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:12:32 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-9d340512-a61f-44f2-a070-0af306485edc tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Lock "cinder-ee6bb652-4fd7-4e2a-a015-22326843139a-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:12:32 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-9d340512-a61f-44f2-a070-0af306485edc tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Acquiring lock "cinder-quobyte-ee6bb652-4fd7-4e2a-a015-22326843139a" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:12:32 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-9d340512-a61f-44f2-a070-0af306485edc tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Lock "cinder-quobyte-ee6bb652-4fd7-4e2a-a015-22326843139a" acquired by "delete_volume" :: waited 0.017s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:12:32 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4391ad2b-e37d-40bb-816f-0d07768db44a]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:12:32 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-9d340512-a61f-44f2-a070-0af306485edc tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-ee6bb652-4fd7-4e2a-a015-22326843139a {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:32 devstack sudo[111450]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:32 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c31a8b8b-a9e2-4db6-ae2e-046a7f4215ed tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_39f5e834-44ad-4d59-bd8b-97ed9b791648_elh7751ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-7d89e0e0-a019-419e-9e12-6aee4dbc88e1" returned: 0 in 0.909s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:32 devstack cinder-volume[91863]: DEBUG cinder.image.image_utils [None req-c31a8b8b-a9e2-4db6-ae2e-046a7f4215ed tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_39f5e834-44ad-4d59-bd8b-97ed9b791648_elh7751ldevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-7d89e0e0-a019-419e-9e12-6aee4dbc88e1 {{(pid=91863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 15 16:12:32 devstack cinder-volume[91863]: INFO cinder.image.image_utils [None req-c31a8b8b-a9e2-4db6-ae2e-046a7f4215ed tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] Converted 0.00 MB image at 0.00 MB/s
Jun 15 16:12:32 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c31a8b8b-a9e2-4db6-ae2e-046a7f4215ed tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-7d89e0e0-a019-419e-9e12-6aee4dbc88e1 1G {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:32 devstack sudo[111463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-ee6bb652-4fd7-4e2a-a015-22326843139a
Jun 15 16:12:32 devstack sudo[111463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:32 devstack sudo[111464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-7d89e0e0-a019-419e-9e12-6aee4dbc88e1 1G
Jun 15 16:12:32 devstack sudo[111464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:33 devstack sudo[111456]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:33 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-0474f059-530a-4e50-aa78-fcc53b175e66 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.962s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:33 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-0474f059-530a-4e50-aa78-fcc53b175e66 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 16:12:33 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-0474f059-530a-4e50-aa78-fcc53b175e66 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Deleted volume successfully.
Jun 15 16:12:33 devstack sudo[111457]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:33 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-1e16110a-351f-422a-9307-62e02d26d185 tempest-VolumeImageDependencyTests-761867979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-c130995e-792e-41cc-983d-cee5247ae06b" returned: 0 in 0.991s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:33 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-1e16110a-351f-422a-9307-62e02d26d185 tempest-VolumeImageDependencyTests-761867979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-c130995e-792e-41cc-983d-cee5247ae06b {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:33 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-0474f059-530a-4e50-aa78-fcc53b175e66 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Lock "cinder-efd7d5c7-6a22-4b6e-bcae-7675b4a28623-delete_volume" released by "delete_volume" :: held 3.129s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:12:33 devstack sudo[111470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-c130995e-792e-41cc-983d-cee5247ae06b
Jun 15 16:12:33 devstack sudo[111470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:33 devstack sudo[111464]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:33 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c31a8b8b-a9e2-4db6-ae2e-046a7f4215ed tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-7d89e0e0-a019-419e-9e12-6aee4dbc88e1 1G" returned: 0 in 0.820s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:33 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e249c5-c6e2-47bc-ad6d-9216246fd8e9]: (4, 'raw') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:12:33 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c31a8b8b-a9e2-4db6-ae2e-046a7f4215ed tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-7d89e0e0-a019-419e-9e12-6aee4dbc88e1 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:33 devstack sudo[111463]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:33 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-9d340512-a61f-44f2-a070-0af306485edc tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-ee6bb652-4fd7-4e2a-a015-22326843139a" returned: 0 in 1.084s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:33 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-9d340512-a61f-44f2-a070-0af306485edc tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-ee6bb652-4fd7-4e2a-a015-22326843139a {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:33 devstack sudo[111480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-ee6bb652-4fd7-4e2a-a015-22326843139a
Jun 15 16:12:33 devstack sudo[111480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:33 devstack sudo[111479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-7d89e0e0-a019-419e-9e12-6aee4dbc88e1
Jun 15 16:12:33 devstack sudo[111479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:34 devstack sudo[111470]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:34 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-1e16110a-351f-422a-9307-62e02d26d185 tempest-VolumeImageDependencyTests-761867979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-c130995e-792e-41cc-983d-cee5247ae06b" returned: 1 in 0.805s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:34 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-1e16110a-351f-422a-9307-62e02d26d185 tempest-VolumeImageDependencyTests-761867979 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-c130995e-792e-41cc-983d-cee5247ae06b' failed. Not Retrying. {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 15 16:12:34 devstack cinder-volume[91863]: DEBUG cinder.volume.volume_utils [None req-1e16110a-351f-422a-9307-62e02d26d185 tempest-VolumeImageDependencyTests-761867979 None] Downloaded image 90cfc52a-50f6-4fb9-b3d1-9b0d2193e47c ((None, [{'url': 'file:///opt/stack/data/glance/images/90cfc52a-50f6-4fb9-b3d1-9b0d2193e47c', 'metadata': {}}])) to volume c130995e-792e-41cc-983d-cee5247ae06b successfully. {{(pid=91863) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 15 16:12:34 devstack cinder-volume[91863]: DEBUG cinder.image.image_utils [None req-1e16110a-351f-422a-9307-62e02d26d185 tempest-VolumeImageDependencyTests-761867979 None] Temporary image 90cfc52a-50f6-4fb9-b3d1-9b0d2193e47c for user 1def98cb552845cb9d2fdb91ed95a9bc is deleted. {{(pid=91863) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 15 16:12:34 devstack cinder-volume[91863]: DEBUG cinder.volume.volume_utils [None req-1e16110a-351f-422a-9307-62e02d26d185 tempest-VolumeImageDependencyTests-761867979 None] Marking volume c130995e-792e-41cc-983d-cee5247ae06b as bootable. {{(pid=91863) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 15 16:12:34 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e16110a-351f-422a-9307-62e02d26d185 tempest-VolumeImageDependencyTests-761867979 None] Copying metadata from image 90cfc52a-50f6-4fb9-b3d1-9b0d2193e47c to c130995e-792e-41cc-983d-cee5247ae06b. {{(pid=91863) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 15 16:12:34 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e16110a-351f-422a-9307-62e02d26d185 tempest-VolumeImageDependencyTests-761867979 None] Creating volume glance metadata for volume c130995e-792e-41cc-983d-cee5247ae06b backed by image 90cfc52a-50f6-4fb9-b3d1-9b0d2193e47c with: {'image_id': '90cfc52a-50f6-4fb9-b3d1-9b0d2193e47c', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'dbb44614329982eebd0dc4acdabd0105', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=91863) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 15 16:12:34 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-1e16110a-351f-422a-9307-62e02d26d185 tempest-VolumeImageDependencyTests-761867979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (424ef7ce-22b2-4be7-9443-3b08854cd8a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c130995e-792e-41cc-983d-cee5247ae06b', 'volume_size': 1, 'image_id': '90cfc52a-50f6-4fb9-b3d1-9b0d2193e47c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/90cfc52a-50f6-4fb9-b3d1-9b0d2193e47c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'dbb44614329982eebd0dc4acdabd0105', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4479a314d37d4603b317eba55c4f7c13', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1730567f3408a789a91a30a37fed3c160d0130ea3e94711d6f82f7754099b7e1e5b4a405a36a4d04f7506dc4515200144b5a0f108a65d4967af488aa9892facc', 'id': '90cfc52a-50f6-4fb9-b3d1-9b0d2193e47c', 'created_at': datetime.datetime(2026, 6, 15, 14, 12, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 14, 12, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/90cfc52a-50f6-4fb9-b3d1-9b0d2193e47c/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x77394a4452b0>}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:34 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-1e16110a-351f-422a-9307-62e02d26d185 tempest-VolumeImageDependencyTests-761867979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19d6ef33-ab03-4581-85d3-ee743833579c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:34 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-1e16110a-351f-422a-9307-62e02d26d185 tempest-VolumeImageDependencyTests-761867979 None] Volume volume-c130995e-792e-41cc-983d-cee5247ae06b (c130995e-792e-41cc-983d-cee5247ae06b): created successfully
Jun 15 16:12:34 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-1e16110a-351f-422a-9307-62e02d26d185 tempest-VolumeImageDependencyTests-761867979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19d6ef33-ab03-4581-85d3-ee743833579c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:34 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-1e16110a-351f-422a-9307-62e02d26d185 tempest-VolumeImageDependencyTests-761867979 None] Flow 'volume_create_manager' (35c5f6a6-c129-4285-81ce-d9c0e2e9b6b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:12:34 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-1e16110a-351f-422a-9307-62e02d26d185 tempest-VolumeImageDependencyTests-761867979 None] Created volume successfully.
Jun 15 16:12:34 devstack sudo[111480]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:34 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-9d340512-a61f-44f2-a070-0af306485edc tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-ee6bb652-4fd7-4e2a-a015-22326843139a" returned: 0 in 0.788s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:34 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-9d340512-a61f-44f2-a070-0af306485edc tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Lock "cinder-quobyte-ee6bb652-4fd7-4e2a-a015-22326843139a" released by "delete_volume" :: held 1.940s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:12:34 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-9d340512-a61f-44f2-a070-0af306485edc tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Created reservations ['e8896706-a326-406f-b70e-e43e8abcd738', 'b5a0e829-7d41-4df2-a219-df8a9a19c0a1', 'dfec04c7-bc1f-4a6e-96ca-a5128d64027c', '9284498d-cb09-4a50-a87a-d5f809229e31'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 16:12:34 devstack sudo[111479]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:34 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c31a8b8b-a9e2-4db6-ae2e-046a7f4215ed tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-7d89e0e0-a019-419e-9e12-6aee4dbc88e1" returned: 0 in 0.961s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:34 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c31a8b8b-a9e2-4db6-ae2e-046a7f4215ed tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-7d89e0e0-a019-419e-9e12-6aee4dbc88e1 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:34 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-9d340512-a61f-44f2-a070-0af306485edc tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:12:34 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-9d340512-a61f-44f2-a070-0af306485edc tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:12:34 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-9d340512-a61f-44f2-a070-0af306485edc tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:12:34 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-9d340512-a61f-44f2-a070-0af306485edc tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:12:34 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-9d340512-a61f-44f2-a070-0af306485edc tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:12:34 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-9d340512-a61f-44f2-a070-0af306485edc tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:34 devstack sudo[111489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-7d89e0e0-a019-419e-9e12-6aee4dbc88e1
Jun 15 16:12:34 devstack sudo[111489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:34 devstack sudo[111490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 16:12:34 devstack sudo[111490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:35 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-50125124-d850-49fc-b510-0f694756d8ce tempest-VolumeImageDependencyTests-761867979 None] Acquiring lock "cinder-c130995e-792e-41cc-983d-cee5247ae06b-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:12:35 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-4bc21a6d-4a4b-4c06-948f-74c5cd997f71 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Acquiring lock "cinder-413041fa-40e5-4bcc-96b5-1563744d2716-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:12:35 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-50125124-d850-49fc-b510-0f694756d8ce tempest-VolumeImageDependencyTests-761867979 None] Lock "cinder-c130995e-792e-41cc-983d-cee5247ae06b-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:12:35 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-4bc21a6d-4a4b-4c06-948f-74c5cd997f71 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Lock "cinder-413041fa-40e5-4bcc-96b5-1563744d2716-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:12:35 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-50125124-d850-49fc-b510-0f694756d8ce tempest-VolumeImageDependencyTests-761867979 None] Acquiring lock "cinder-quobyte-c130995e-792e-41cc-983d-cee5247ae06b" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:12:35 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-4bc21a6d-4a4b-4c06-948f-74c5cd997f71 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Acquiring lock "cinder-quobyte-413041fa-40e5-4bcc-96b5-1563744d2716" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:12:35 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-50125124-d850-49fc-b510-0f694756d8ce tempest-VolumeImageDependencyTests-761867979 None] Lock "cinder-quobyte-c130995e-792e-41cc-983d-cee5247ae06b" acquired by "delete_volume" :: waited 0.029s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:12:35 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-4bc21a6d-4a4b-4c06-948f-74c5cd997f71 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Lock "cinder-quobyte-413041fa-40e5-4bcc-96b5-1563744d2716" acquired by "delete_volume" :: waited 0.041s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:12:35 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d75e2771-f9ef-486d-a6eb-656a163da6d2]: (4, 'raw') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:12:35 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-50125124-d850-49fc-b510-0f694756d8ce tempest-VolumeImageDependencyTests-761867979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-c130995e-792e-41cc-983d-cee5247ae06b {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:35 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a227ff-d863-4f2e-b7ee-5b7ce9421a2d]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:12:35 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-4bc21a6d-4a4b-4c06-948f-74c5cd997f71 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-413041fa-40e5-4bcc-96b5-1563744d2716 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:35 devstack sudo[111495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-413041fa-40e5-4bcc-96b5-1563744d2716
Jun 15 16:12:35 devstack sudo[111495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:35 devstack sudo[111494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-c130995e-792e-41cc-983d-cee5247ae06b
Jun 15 16:12:35 devstack sudo[111494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:35 devstack sudo[111489]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:35 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c31a8b8b-a9e2-4db6-ae2e-046a7f4215ed tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-7d89e0e0-a019-419e-9e12-6aee4dbc88e1" returned: 1 in 0.871s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:35 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c31a8b8b-a9e2-4db6-ae2e-046a7f4215ed tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-7d89e0e0-a019-419e-9e12-6aee4dbc88e1' failed. Not Retrying. {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 15 16:12:35 devstack cinder-volume[91863]: DEBUG cinder.volume.volume_utils [None req-c31a8b8b-a9e2-4db6-ae2e-046a7f4215ed tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] Downloaded image 39f5e834-44ad-4d59-bd8b-97ed9b791648 ((None, [{'url': 'file:///opt/stack/data/glance/images/39f5e834-44ad-4d59-bd8b-97ed9b791648', 'metadata': {}}])) to volume 7d89e0e0-a019-419e-9e12-6aee4dbc88e1 successfully. {{(pid=91863) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 15 16:12:35 devstack cinder-volume[91863]: DEBUG cinder.image.image_utils [None req-c31a8b8b-a9e2-4db6-ae2e-046a7f4215ed tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] Temporary image 39f5e834-44ad-4d59-bd8b-97ed9b791648 for user ab33fd116d4c462f8e889f48c5aa2c1f is deleted. {{(pid=91863) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 15 16:12:35 devstack cinder-volume[91863]: DEBUG cinder.volume.volume_utils [None req-c31a8b8b-a9e2-4db6-ae2e-046a7f4215ed tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] Marking volume 7d89e0e0-a019-419e-9e12-6aee4dbc88e1 as bootable. {{(pid=91863) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 15 16:12:35 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-c31a8b8b-a9e2-4db6-ae2e-046a7f4215ed tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] Copying metadata from image 39f5e834-44ad-4d59-bd8b-97ed9b791648 to 7d89e0e0-a019-419e-9e12-6aee4dbc88e1. {{(pid=91863) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 15 16:12:35 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-c31a8b8b-a9e2-4db6-ae2e-046a7f4215ed tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] Creating volume glance metadata for volume 7d89e0e0-a019-419e-9e12-6aee4dbc88e1 backed by image 39f5e834-44ad-4d59-bd8b-97ed9b791648 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '39f5e834-44ad-4d59-bd8b-97ed9b791648', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '70ce7c24a61df7d23c4047066433efab', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=91863) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 15 16:12:35 devstack sudo[111490]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:35 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-9d340512-a61f-44f2-a070-0af306485edc tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.963s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:35 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-9d340512-a61f-44f2-a070-0af306485edc tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 16:12:35 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-c31a8b8b-a9e2-4db6-ae2e-046a7f4215ed tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29d4229a-e481-4358-92a2-a8e47cdbcecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d89e0e0-a019-419e-9e12-6aee4dbc88e1', 'volume_size': 1, 'image_id': '39f5e834-44ad-4d59-bd8b-97ed9b791648', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/39f5e834-44ad-4d59-bd8b-97ed9b791648', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '70ce7c24a61df7d23c4047066433efab', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '32d33ce746a14ec882cb31ac04bc5285', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4449306190b2615438ea272a07ec54be3b8ae817053a94b2a9767c88c54cdb789a405cfadb7f9b4b27698b7e0da4b191543dd497feb1efce6b86105774c02711', 'id': '39f5e834-44ad-4d59-bd8b-97ed9b791648', 'created_at': datetime.datetime(2026, 6, 15, 14, 12, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 14, 12, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/39f5e834-44ad-4d59-bd8b-97ed9b791648/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x77394a254d10>}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:35 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-c31a8b8b-a9e2-4db6-ae2e-046a7f4215ed tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84aaef39-2d00-4a05-b706-339a8446f640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:35 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-9d340512-a61f-44f2-a070-0af306485edc tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Deleted volume successfully.
Jun 15 16:12:35 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-c31a8b8b-a9e2-4db6-ae2e-046a7f4215ed tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] Volume volume-7d89e0e0-a019-419e-9e12-6aee4dbc88e1 (7d89e0e0-a019-419e-9e12-6aee4dbc88e1): created successfully
Jun 15 16:12:35 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-c31a8b8b-a9e2-4db6-ae2e-046a7f4215ed tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84aaef39-2d00-4a05-b706-339a8446f640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:35 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-c31a8b8b-a9e2-4db6-ae2e-046a7f4215ed tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] Flow 'volume_create_manager' (3bb2a65d-2643-4d0e-870e-415e6352eab7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:12:35 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-c31a8b8b-a9e2-4db6-ae2e-046a7f4215ed tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] Created volume successfully.
Jun 15 16:12:35 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-9d340512-a61f-44f2-a070-0af306485edc tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Lock "cinder-ee6bb652-4fd7-4e2a-a015-22326843139a-delete_volume" released by "delete_volume" :: held 3.194s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:12:36 devstack sudo[111494]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:36 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-50125124-d850-49fc-b510-0f694756d8ce tempest-VolumeImageDependencyTests-761867979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-c130995e-792e-41cc-983d-cee5247ae06b" returned: 0 in 0.988s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:36 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-50125124-d850-49fc-b510-0f694756d8ce tempest-VolumeImageDependencyTests-761867979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-c130995e-792e-41cc-983d-cee5247ae06b {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:36 devstack sudo[111495]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:36 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-4bc21a6d-4a4b-4c06-948f-74c5cd997f71 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-413041fa-40e5-4bcc-96b5-1563744d2716" returned: 0 in 0.980s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:36 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-4bc21a6d-4a4b-4c06-948f-74c5cd997f71 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-413041fa-40e5-4bcc-96b5-1563744d2716 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:36 devstack sudo[111508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-413041fa-40e5-4bcc-96b5-1563744d2716
Jun 15 16:12:36 devstack sudo[111508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:36 devstack sudo[111507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-c130995e-792e-41cc-983d-cee5247ae06b
Jun 15 16:12:36 devstack sudo[111507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:36 devstack sudo[111508]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:36 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-4bc21a6d-4a4b-4c06-948f-74c5cd997f71 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-413041fa-40e5-4bcc-96b5-1563744d2716" returned: 0 in 0.596s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:36 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-4bc21a6d-4a4b-4c06-948f-74c5cd997f71 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Lock "cinder-quobyte-413041fa-40e5-4bcc-96b5-1563744d2716" released by "delete_volume" :: held 1.656s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:12:36 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-4bc21a6d-4a4b-4c06-948f-74c5cd997f71 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Created reservations ['23dd35d0-3efc-4927-8371-c6530d3b2b9e', '0919c326-d13c-4932-ab11-e11703750c5e', '7dd60e74-bb0a-4cd0-a22f-ac4961239c51', 'e4af051e-05dc-4a55-be5c-b7f78c4c6fb3'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 16:12:36 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-ee6c08a8-0e51-44e8-a61c-d4d9e114c308 tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] Acquiring lock "cinder-7d89e0e0-a019-419e-9e12-6aee4dbc88e1-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:12:37 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-ee6c08a8-0e51-44e8-a61c-d4d9e114c308 tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] Lock "cinder-7d89e0e0-a019-419e-9e12-6aee4dbc88e1-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:12:37 devstack sudo[111507]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:37 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-ee6c08a8-0e51-44e8-a61c-d4d9e114c308 tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] Acquiring lock "cinder-quobyte-7d89e0e0-a019-419e-9e12-6aee4dbc88e1" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:12:37 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-50125124-d850-49fc-b510-0f694756d8ce tempest-VolumeImageDependencyTests-761867979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-c130995e-792e-41cc-983d-cee5247ae06b" returned: 1 in 0.836s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:37 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-50125124-d850-49fc-b510-0f694756d8ce tempest-VolumeImageDependencyTests-761867979 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-c130995e-792e-41cc-983d-cee5247ae06b' failed. Not Retrying. {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 15 16:12:37 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-50125124-d850-49fc-b510-0f694756d8ce tempest-VolumeImageDependencyTests-761867979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-c130995e-792e-41cc-983d-cee5247ae06b {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:37 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-ee6c08a8-0e51-44e8-a61c-d4d9e114c308 tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] Lock "cinder-quobyte-7d89e0e0-a019-419e-9e12-6aee4dbc88e1" acquired by "delete_volume" :: waited 0.037s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:12:37 devstack sudo[111515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-c130995e-792e-41cc-983d-cee5247ae06b
Jun 15 16:12:37 devstack sudo[111515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:37 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-4bc21a6d-4a4b-4c06-948f-74c5cd997f71 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:12:37 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-4bc21a6d-4a4b-4c06-948f-74c5cd997f71 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:12:37 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-4bc21a6d-4a4b-4c06-948f-74c5cd997f71 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:12:37 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-4bc21a6d-4a4b-4c06-948f-74c5cd997f71 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:12:37 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-4bc21a6d-4a4b-4c06-948f-74c5cd997f71 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:12:37 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-4bc21a6d-4a4b-4c06-948f-74c5cd997f71 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:37 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d55a6df-7bf6-4131-b158-3381a5849896]: (4, 'raw') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:12:37 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ee6c08a8-0e51-44e8-a61c-d4d9e114c308 tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-7d89e0e0-a019-419e-9e12-6aee4dbc88e1 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:37 devstack sudo[111517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 16:12:37 devstack sudo[111517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:37 devstack sudo[111519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-7d89e0e0-a019-419e-9e12-6aee4dbc88e1
Jun 15 16:12:37 devstack sudo[111519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:37 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-5e9c0ce4-5e64-42a8-a402-f7d66978b513 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Acquiring lock "cinder-d8de4246-6e95-4261-b7f7-f9cebf889e2c-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:12:37 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-5e9c0ce4-5e64-42a8-a402-f7d66978b513 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Lock "cinder-d8de4246-6e95-4261-b7f7-f9cebf889e2c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:12:37 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-5e9c0ce4-5e64-42a8-a402-f7d66978b513 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Acquiring lock "cinder-quobyte-d8de4246-6e95-4261-b7f7-f9cebf889e2c" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:12:37 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-5e9c0ce4-5e64-42a8-a402-f7d66978b513 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Lock "cinder-quobyte-d8de4246-6e95-4261-b7f7-f9cebf889e2c" acquired by "delete_volume" :: waited 0.021s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:12:37 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bf60dcb-34a2-43d4-80ff-b8f352149c0a]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:12:37 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5e9c0ce4-5e64-42a8-a402-f7d66978b513 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-d8de4246-6e95-4261-b7f7-f9cebf889e2c {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:37 devstack sudo[111521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-d8de4246-6e95-4261-b7f7-f9cebf889e2c
Jun 15 16:12:37 devstack sudo[111521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:37 devstack sudo[111517]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:37 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-4bc21a6d-4a4b-4c06-948f-74c5cd997f71 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.860s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:37 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-4bc21a6d-4a4b-4c06-948f-74c5cd997f71 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 16:12:38 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-4bc21a6d-4a4b-4c06-948f-74c5cd997f71 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Deleted volume successfully.
Jun 15 16:12:38 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-4bc21a6d-4a4b-4c06-948f-74c5cd997f71 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Lock "cinder-413041fa-40e5-4bcc-96b5-1563744d2716-delete_volume" released by "delete_volume" :: held 2.946s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:12:38 devstack sudo[111515]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:38 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-50125124-d850-49fc-b510-0f694756d8ce tempest-VolumeImageDependencyTests-761867979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-c130995e-792e-41cc-983d-cee5247ae06b" returned: 0 in 1.049s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:38 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-50125124-d850-49fc-b510-0f694756d8ce tempest-VolumeImageDependencyTests-761867979 None] Lock "cinder-quobyte-c130995e-792e-41cc-983d-cee5247ae06b" released by "delete_volume" :: held 2.961s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:12:38 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-50125124-d850-49fc-b510-0f694756d8ce tempest-VolumeImageDependencyTests-761867979 None] Created reservations ['6c0001dc-73a6-447d-a0c0-98cc7a1dc0b4', '09e647c2-5864-40ea-a579-6001ea4be468', '3fed73cb-d56b-44d9-bc0b-ee465e39c07c', '4a65a10b-2374-44c7-944d-3e6bfed6f512'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 16:12:38 devstack sudo[111519]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:38 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ee6c08a8-0e51-44e8-a61c-d4d9e114c308 tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-7d89e0e0-a019-419e-9e12-6aee4dbc88e1" returned: 0 in 1.072s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:38 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ee6c08a8-0e51-44e8-a61c-d4d9e114c308 tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-7d89e0e0-a019-419e-9e12-6aee4dbc88e1 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:38 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-50125124-d850-49fc-b510-0f694756d8ce tempest-VolumeImageDependencyTests-761867979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:12:38 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-50125124-d850-49fc-b510-0f694756d8ce tempest-VolumeImageDependencyTests-761867979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:12:38 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-50125124-d850-49fc-b510-0f694756d8ce tempest-VolumeImageDependencyTests-761867979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:12:38 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-50125124-d850-49fc-b510-0f694756d8ce tempest-VolumeImageDependencyTests-761867979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:12:38 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-50125124-d850-49fc-b510-0f694756d8ce tempest-VolumeImageDependencyTests-761867979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:12:38 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-50125124-d850-49fc-b510-0f694756d8ce tempest-VolumeImageDependencyTests-761867979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:38 devstack sudo[111521]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:38 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5e9c0ce4-5e64-42a8-a402-f7d66978b513 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-d8de4246-6e95-4261-b7f7-f9cebf889e2c" returned: 0 in 0.819s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:38 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5e9c0ce4-5e64-42a8-a402-f7d66978b513 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-d8de4246-6e95-4261-b7f7-f9cebf889e2c {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:38 devstack sudo[111532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 16:12:38 devstack sudo[111532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:38 devstack sudo[111533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-d8de4246-6e95-4261-b7f7-f9cebf889e2c
Jun 15 16:12:38 devstack sudo[111533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:38 devstack sudo[111531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-7d89e0e0-a019-419e-9e12-6aee4dbc88e1
Jun 15 16:12:38 devstack sudo[111531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:39 devstack sudo[111533]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5e9c0ce4-5e64-42a8-a402-f7d66978b513 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-d8de4246-6e95-4261-b7f7-f9cebf889e2c" returned: 0 in 0.736s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:39 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-5e9c0ce4-5e64-42a8-a402-f7d66978b513 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Lock "cinder-quobyte-d8de4246-6e95-4261-b7f7-f9cebf889e2c" released by "delete_volume" :: held 1.626s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:12:39 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-5e9c0ce4-5e64-42a8-a402-f7d66978b513 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Created reservations ['f4b4846e-414c-4bd1-8845-8286e52b2148', '3336e5ae-2677-4aeb-9c5d-ad548f52d5cf', 'ee19ac21-e853-4fac-8f23-30cd08903bd5', '8f52ae36-bee9-4785-809a-25866cd1151a'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 16:12:39 devstack sudo[111532]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:39 devstack sudo[111531]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-50125124-d850-49fc-b510-0f694756d8ce tempest-VolumeImageDependencyTests-761867979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.900s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ee6c08a8-0e51-44e8-a61c-d4d9e114c308 tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-7d89e0e0-a019-419e-9e12-6aee4dbc88e1" returned: 1 in 0.977s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ee6c08a8-0e51-44e8-a61c-d4d9e114c308 tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-7d89e0e0-a019-419e-9e12-6aee4dbc88e1' failed. Not Retrying. {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 15 16:12:39 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-50125124-d850-49fc-b510-0f694756d8ce tempest-VolumeImageDependencyTests-761867979 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 16:12:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ee6c08a8-0e51-44e8-a61c-d4d9e114c308 tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-7d89e0e0-a019-419e-9e12-6aee4dbc88e1 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:39 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-50125124-d850-49fc-b510-0f694756d8ce tempest-VolumeImageDependencyTests-761867979 None] Deleted volume successfully.
Jun 15 16:12:39 devstack sudo[111542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-7d89e0e0-a019-419e-9e12-6aee4dbc88e1
Jun 15 16:12:39 devstack sudo[111542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:39 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-50125124-d850-49fc-b510-0f694756d8ce tempest-VolumeImageDependencyTests-761867979 None] Lock "cinder-c130995e-792e-41cc-983d-cee5247ae06b-delete_volume" released by "delete_volume" :: held 4.246s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:12:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-5e9c0ce4-5e64-42a8-a402-f7d66978b513 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:12:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-5e9c0ce4-5e64-42a8-a402-f7d66978b513 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:12:39 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-5e9c0ce4-5e64-42a8-a402-f7d66978b513 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:12:39 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-5e9c0ce4-5e64-42a8-a402-f7d66978b513 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:12:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-5e9c0ce4-5e64-42a8-a402-f7d66978b513 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:12:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5e9c0ce4-5e64-42a8-a402-f7d66978b513 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:39 devstack sudo[111544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 16:12:39 devstack sudo[111544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:40 devstack sudo[111542]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:40 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ee6c08a8-0e51-44e8-a61c-d4d9e114c308 tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-7d89e0e0-a019-419e-9e12-6aee4dbc88e1" returned: 0 in 0.813s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:40 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-ee6c08a8-0e51-44e8-a61c-d4d9e114c308 tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] Lock "cinder-quobyte-7d89e0e0-a019-419e-9e12-6aee4dbc88e1" released by "delete_volume" :: held 2.949s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:12:40 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-ee6c08a8-0e51-44e8-a61c-d4d9e114c308 tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] Created reservations ['23c5db84-b05e-4ebe-99fa-1199e77fb019', 'e0e4d5f3-8725-4a59-a399-0c91fc408922', '3b81ef75-00fb-4062-92b8-4c92666e3556', '02793d8f-c01a-49e3-9c7e-3447a6d9959a'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 16:12:40 devstack sudo[111544]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:40 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5e9c0ce4-5e64-42a8-a402-f7d66978b513 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.843s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:40 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-5e9c0ce4-5e64-42a8-a402-f7d66978b513 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 16:12:40 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-5e9c0ce4-5e64-42a8-a402-f7d66978b513 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Deleted volume successfully.
Jun 15 16:12:40 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-5e9c0ce4-5e64-42a8-a402-f7d66978b513 tempest-CreateVolumesFromSourceVolumeTest-1874866620 None] Lock "cinder-d8de4246-6e95-4261-b7f7-f9cebf889e2c-delete_volume" released by "delete_volume" :: held 2.896s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:12:40 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-ee6c08a8-0e51-44e8-a61c-d4d9e114c308 tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:12:40 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-ee6c08a8-0e51-44e8-a61c-d4d9e114c308 tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:12:40 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-ee6c08a8-0e51-44e8-a61c-d4d9e114c308 tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:12:40 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-ee6c08a8-0e51-44e8-a61c-d4d9e114c308 tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:12:40 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-ee6c08a8-0e51-44e8-a61c-d4d9e114c308 tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:12:40 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ee6c08a8-0e51-44e8-a61c-d4d9e114c308 tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:40 devstack sudo[111548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 16:12:40 devstack sudo[111548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:41 devstack sudo[111548]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:41 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ee6c08a8-0e51-44e8-a61c-d4d9e114c308 tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.879s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:41 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-ee6c08a8-0e51-44e8-a61c-d4d9e114c308 tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 16:12:41 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-ee6c08a8-0e51-44e8-a61c-d4d9e114c308 tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] Deleted volume successfully.
Jun 15 16:12:41 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-ee6c08a8-0e51-44e8-a61c-d4d9e114c308 tempest-VolumeAndVolumeTypeFromImageTest-810201565 None] Lock "cinder-7d89e0e0-a019-419e-9e12-6aee4dbc88e1-delete_volume" released by "delete_volume" :: held 4.308s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:12:44 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e708ab1-2723-4c04-a43d-78a378f8b295 tempest-VolumeDependencyTests-1777202688 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 16:12:44 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5e708ab1-2723-4c04-a43d-78a378f8b295 tempest-VolumeDependencyTests-1777202688 None] Flow 'volume_create_manager' (6abbad8e-7211-42f9-a99b-bf8276b9c806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:12:44 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5e708ab1-2723-4c04-a43d-78a378f8b295 tempest-VolumeDependencyTests-1777202688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bc7df3a-168f-4400-9e27-3a21029a4123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:44 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5e708ab1-2723-4c04-a43d-78a378f8b295 tempest-VolumeDependencyTests-1777202688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bc7df3a-168f-4400-9e27-3a21029a4123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:12:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-732097189',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fea6610d-d072-42e3-938b-d2e8675ba1ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df0d66e5346f4a2498abf79ed1a563a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:12:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:12:44Z,use_quota=True,user_id='6e40d695589b473c9159239249ff10c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:44 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5e708ab1-2723-4c04-a43d-78a378f8b295 tempest-VolumeDependencyTests-1777202688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c1458dc-1195-4e53-8f1a-643e07b3b192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:44 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5e708ab1-2723-4c04-a43d-78a378f8b295 tempest-VolumeDependencyTests-1777202688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c1458dc-1195-4e53-8f1a-643e07b3b192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:44 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5e708ab1-2723-4c04-a43d-78a378f8b295 tempest-VolumeDependencyTests-1777202688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27f94523-9079-4767-929e-91ac4453fad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:44 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5e708ab1-2723-4c04-a43d-78a378f8b295 tempest-VolumeDependencyTests-1777202688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27f94523-9079-4767-929e-91ac4453fad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fea6610d-d072-42e3-938b-d2e8675ba1ad', 'volume_name': 'volume-fea6610d-d072-42e3-938b-d2e8675ba1ad', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:44 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5e708ab1-2723-4c04-a43d-78a378f8b295 tempest-VolumeDependencyTests-1777202688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (767fae46-0368-49bf-a636-c7a50f12d34c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:44 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5e708ab1-2723-4c04-a43d-78a378f8b295 tempest-VolumeDependencyTests-1777202688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (767fae46-0368-49bf-a636-c7a50f12d34c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:44 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5e708ab1-2723-4c04-a43d-78a378f8b295 tempest-VolumeDependencyTests-1777202688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d0bc113-d997-4301-a6cf-28930d2d2183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:44 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-5e708ab1-2723-4c04-a43d-78a378f8b295 tempest-VolumeDependencyTests-1777202688 None] Volume fea6610d-d072-42e3-938b-d2e8675ba1ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fea6610d-d072-42e3-938b-d2e8675ba1ad', 'volume_size': 1}
Jun 15 16:12:44 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-5e708ab1-2723-4c04-a43d-78a378f8b295 tempest-VolumeDependencyTests-1777202688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:12:44 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-5e708ab1-2723-4c04-a43d-78a378f8b295 tempest-VolumeDependencyTests-1777202688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:12:44 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-5e708ab1-2723-4c04-a43d-78a378f8b295 tempest-VolumeDependencyTests-1777202688 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:12:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-732097189',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fea6610d-d072-42e3-938b-d2e8675ba1ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df0d66e5346f4a2498abf79ed1a563a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:12:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:12:44Z,use_quota=True,user_id='6e40d695589b473c9159239249ff10c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 16:12:44 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-5e708ab1-2723-4c04-a43d-78a378f8b295 tempest-VolumeDependencyTests-1777202688 None] Creating volume fea6610d-d072-42e3-938b-d2e8675ba1ad {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 16:12:44 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-5e708ab1-2723-4c04-a43d-78a378f8b295 tempest-VolumeDependencyTests-1777202688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:12:44 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-5e708ab1-2723-4c04-a43d-78a378f8b295 tempest-VolumeDependencyTests-1777202688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:12:44 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-5e708ab1-2723-4c04-a43d-78a378f8b295 tempest-VolumeDependencyTests-1777202688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:12:44 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-5e708ab1-2723-4c04-a43d-78a378f8b295 tempest-VolumeDependencyTests-1777202688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:12:44 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-5e708ab1-2723-4c04-a43d-78a378f8b295 tempest-VolumeDependencyTests-1777202688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:12:44 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-5e708ab1-2723-4c04-a43d-78a378f8b295 tempest-VolumeDependencyTests-1777202688 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 16:12:44 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-5e708ab1-2723-4c04-a43d-78a378f8b295 tempest-VolumeDependencyTests-1777202688 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 16:12:44 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5e708ab1-2723-4c04-a43d-78a378f8b295 tempest-VolumeDependencyTests-1777202688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fea6610d-d072-42e3-938b-d2e8675ba1ad 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:44 devstack sudo[111587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fea6610d-d072-42e3-938b-d2e8675ba1ad 1073741824
Jun 15 16:12:44 devstack sudo[111587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:45 devstack sudo[111587]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:45 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5e708ab1-2723-4c04-a43d-78a378f8b295 tempest-VolumeDependencyTests-1777202688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fea6610d-d072-42e3-938b-d2e8675ba1ad 1073741824" returned: 0 in 0.990s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:45 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5e708ab1-2723-4c04-a43d-78a378f8b295 tempest-VolumeDependencyTests-1777202688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fea6610d-d072-42e3-938b-d2e8675ba1ad {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:45 devstack sudo[111594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fea6610d-d072-42e3-938b-d2e8675ba1ad
Jun 15 16:12:45 devstack sudo[111594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:46 devstack sudo[111594]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:46 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5e708ab1-2723-4c04-a43d-78a378f8b295 tempest-VolumeDependencyTests-1777202688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fea6610d-d072-42e3-938b-d2e8675ba1ad" returned: 0 in 0.658s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:46 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-5e708ab1-2723-4c04-a43d-78a378f8b295 tempest-VolumeDependencyTests-1777202688 None] <== create_volume: return (1697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 16:12:46 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-5e708ab1-2723-4c04-a43d-78a378f8b295 tempest-VolumeDependencyTests-1777202688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.700s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:12:46 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5e708ab1-2723-4c04-a43d-78a378f8b295 tempest-VolumeDependencyTests-1777202688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d0bc113-d997-4301-a6cf-28930d2d2183) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fea6610d-d072-42e3-938b-d2e8675ba1ad', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:46 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5e708ab1-2723-4c04-a43d-78a378f8b295 tempest-VolumeDependencyTests-1777202688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5678fb45-7db4-4a3c-a539-617f14236b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:46 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-5e708ab1-2723-4c04-a43d-78a378f8b295 tempest-VolumeDependencyTests-1777202688 None] Volume volume-fea6610d-d072-42e3-938b-d2e8675ba1ad (fea6610d-d072-42e3-938b-d2e8675ba1ad): created successfully
Jun 15 16:12:46 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5e708ab1-2723-4c04-a43d-78a378f8b295 tempest-VolumeDependencyTests-1777202688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5678fb45-7db4-4a3c-a539-617f14236b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:46 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-5e708ab1-2723-4c04-a43d-78a378f8b295 tempest-VolumeDependencyTests-1777202688 None] Flow 'volume_create_manager' (6abbad8e-7211-42f9-a99b-bf8276b9c806) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:12:46 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-5e708ab1-2723-4c04-a43d-78a378f8b295 tempest-VolumeDependencyTests-1777202688 None] Created volume successfully.
Jun 15 16:12:46 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-37500653-42d0-418b-a5f5-2afe229287c1 tempest-VolumeDependencyTests-1777202688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:12:46 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-37500653-42d0-418b-a5f5-2afe229287c1 tempest-VolumeDependencyTests-1777202688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:12:46 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-37500653-42d0-418b-a5f5-2afe229287c1 tempest-VolumeDependencyTests-1777202688 None] Creating offline snapshot d654f764-9366-4e8e-ba0f-34627d392c3d of volume fea6610d-d072-42e3-938b-d2e8675ba1ad {{(pid=91863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 15 16:12:46 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[cecb165f-0217-425f-834b-1cd1d2df9486]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:12:46 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-37500653-42d0-418b-a5f5-2afe229287c1 tempest-VolumeDependencyTests-1777202688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fea6610d-d072-42e3-938b-d2e8675ba1ad {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:46 devstack sudo[111597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fea6610d-d072-42e3-938b-d2e8675ba1ad
Jun 15 16:12:46 devstack sudo[111597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:47 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6b19900-6f17-47e1-b1b4-e4c7a650bda0 tempest-CreateVolumesFromSnapshotTest-334660388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 16:12:47 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-a6b19900-6f17-47e1-b1b4-e4c7a650bda0 tempest-CreateVolumesFromSnapshotTest-334660388 None] Flow 'volume_create_manager' (cd6e6c6b-fed5-41f5-a301-61421ef41524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:12:47 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-a6b19900-6f17-47e1-b1b4-e4c7a650bda0 tempest-CreateVolumesFromSnapshotTest-334660388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e1ffd50-b22f-42c8-acae-9e3e501df79b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:47 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-a6b19900-6f17-47e1-b1b4-e4c7a650bda0 tempest-CreateVolumesFromSnapshotTest-334660388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e1ffd50-b22f-42c8-acae-9e3e501df79b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-176957398',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efbf1d6c-a35b-420d-a317-fe36fcf4e67a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fe14878da3f4dd88de9896b21fed7d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:12:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:12:47Z,use_quota=True,user_id='53fa3d42dc7c44c6838c9ff0eda8987d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:47 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-a6b19900-6f17-47e1-b1b4-e4c7a650bda0 tempest-CreateVolumesFromSnapshotTest-334660388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96ac7334-0e84-4dfd-9ebc-52c8533b1a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:47 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-a6b19900-6f17-47e1-b1b4-e4c7a650bda0 tempest-CreateVolumesFromSnapshotTest-334660388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96ac7334-0e84-4dfd-9ebc-52c8533b1a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:47 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-a6b19900-6f17-47e1-b1b4-e4c7a650bda0 tempest-CreateVolumesFromSnapshotTest-334660388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba6453ce-e2df-4548-8115-f3879ae4473c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:47 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-a6b19900-6f17-47e1-b1b4-e4c7a650bda0 tempest-CreateVolumesFromSnapshotTest-334660388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba6453ce-e2df-4548-8115-f3879ae4473c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efbf1d6c-a35b-420d-a317-fe36fcf4e67a', 'volume_name': 'volume-efbf1d6c-a35b-420d-a317-fe36fcf4e67a', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:47 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-a6b19900-6f17-47e1-b1b4-e4c7a650bda0 tempest-CreateVolumesFromSnapshotTest-334660388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (067069b2-5013-46ca-b9a2-df8cf1931721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:47 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-a6b19900-6f17-47e1-b1b4-e4c7a650bda0 tempest-CreateVolumesFromSnapshotTest-334660388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (067069b2-5013-46ca-b9a2-df8cf1931721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:47 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-a6b19900-6f17-47e1-b1b4-e4c7a650bda0 tempest-CreateVolumesFromSnapshotTest-334660388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f22b2aab-d4df-4b9a-823c-71920ae41a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:47 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-a6b19900-6f17-47e1-b1b4-e4c7a650bda0 tempest-CreateVolumesFromSnapshotTest-334660388 None] Volume efbf1d6c-a35b-420d-a317-fe36fcf4e67a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efbf1d6c-a35b-420d-a317-fe36fcf4e67a', 'volume_size': 1}
Jun 15 16:12:47 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-a6b19900-6f17-47e1-b1b4-e4c7a650bda0 tempest-CreateVolumesFromSnapshotTest-334660388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:12:47 devstack sudo[111597]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:47 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-37500653-42d0-418b-a5f5-2afe229287c1 tempest-VolumeDependencyTests-1777202688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fea6610d-d072-42e3-938b-d2e8675ba1ad" returned: 0 in 0.898s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:47 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-37500653-42d0-418b-a5f5-2afe229287c1 tempest-VolumeDependencyTests-1777202688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fea6610d-d072-42e3-938b-d2e8675ba1ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fea6610d-d072-42e3-938b-d2e8675ba1ad.d654f764-9366-4e8e-ba0f-34627d392c3d 1G {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:47 devstack sudo[111603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fea6610d-d072-42e3-938b-d2e8675ba1ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fea6610d-d072-42e3-938b-d2e8675ba1ad.d654f764-9366-4e8e-ba0f-34627d392c3d 1G
Jun 15 16:12:47 devstack sudo[111603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:48 devstack sudo[111603]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:48 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-37500653-42d0-418b-a5f5-2afe229287c1 tempest-VolumeDependencyTests-1777202688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fea6610d-d072-42e3-938b-d2e8675ba1ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fea6610d-d072-42e3-938b-d2e8675ba1ad.d654f764-9366-4e8e-ba0f-34627d392c3d 1G" returned: 0 in 0.823s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:48 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-37500653-42d0-418b-a5f5-2afe229287c1 tempest-VolumeDependencyTests-1777202688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fea6610d-d072-42e3-938b-d2e8675ba1ad -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fea6610d-d072-42e3-938b-d2e8675ba1ad.d654f764-9366-4e8e-ba0f-34627d392c3d {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:48 devstack sudo[111610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fea6610d-d072-42e3-938b-d2e8675ba1ad -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fea6610d-d072-42e3-938b-d2e8675ba1ad.d654f764-9366-4e8e-ba0f-34627d392c3d
Jun 15 16:12:48 devstack sudo[111610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:49 devstack sudo[111610]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:49 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-37500653-42d0-418b-a5f5-2afe229287c1 tempest-VolumeDependencyTests-1777202688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fea6610d-d072-42e3-938b-d2e8675ba1ad -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fea6610d-d072-42e3-938b-d2e8675ba1ad.d654f764-9366-4e8e-ba0f-34627d392c3d" returned: 0 in 0.721s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:49 devstack cinder-volume[91863]: WARNING cinder.volume.drivers.remotefs [None req-37500653-42d0-418b-a5f5-2afe229287c1 tempest-VolumeDependencyTests-1777202688 None] /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fea6610d-d072-42e3-938b-d2e8675ba1ad.d654f764-9366-4e8e-ba0f-34627d392c3d is being set with open permissions: ugo+rw
Jun 15 16:12:49 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-37500653-42d0-418b-a5f5-2afe229287c1 tempest-VolumeDependencyTests-1777202688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fea6610d-d072-42e3-938b-d2e8675ba1ad.d654f764-9366-4e8e-ba0f-34627d392c3d {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:49 devstack sudo[111615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fea6610d-d072-42e3-938b-d2e8675ba1ad.d654f764-9366-4e8e-ba0f-34627d392c3d
Jun 15 16:12:49 devstack sudo[111615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:50 devstack sudo[111615]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:50 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-37500653-42d0-418b-a5f5-2afe229287c1 tempest-VolumeDependencyTests-1777202688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fea6610d-d072-42e3-938b-d2e8675ba1ad.d654f764-9366-4e8e-ba0f-34627d392c3d" returned: 0 in 0.738s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:50 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-37500653-42d0-418b-a5f5-2afe229287c1 tempest-VolumeDependencyTests-1777202688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fea6610d-d072-42e3-938b-d2e8675ba1ad.info {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:50 devstack sudo[111618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fea6610d-d072-42e3-938b-d2e8675ba1ad.info
Jun 15 16:12:50 devstack sudo[111618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:50 devstack sudo[111618]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:50 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-37500653-42d0-418b-a5f5-2afe229287c1 tempest-VolumeDependencyTests-1777202688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fea6610d-d072-42e3-938b-d2e8675ba1ad.info" returned: 0 in 0.657s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:50 devstack cinder-volume[91863]: WARNING cinder.volume.drivers.remotefs [None req-37500653-42d0-418b-a5f5-2afe229287c1 tempest-VolumeDependencyTests-1777202688 None] /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fea6610d-d072-42e3-938b-d2e8675ba1ad.info is being set with open permissions: ugo+rw
Jun 15 16:12:50 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-37500653-42d0-418b-a5f5-2afe229287c1 tempest-VolumeDependencyTests-1777202688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fea6610d-d072-42e3-938b-d2e8675ba1ad.info {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:50 devstack sudo[111621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fea6610d-d072-42e3-938b-d2e8675ba1ad.info
Jun 15 16:12:50 devstack sudo[111621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:51 devstack sudo[111621]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:51 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-37500653-42d0-418b-a5f5-2afe229287c1 tempest-VolumeDependencyTests-1777202688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fea6610d-d072-42e3-938b-d2e8675ba1ad.info" returned: 0 in 0.625s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:51 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-37500653-42d0-418b-a5f5-2afe229287c1 tempest-VolumeDependencyTests-1777202688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.578s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:12:51 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-a6b19900-6f17-47e1-b1b4-e4c7a650bda0 tempest-CreateVolumesFromSnapshotTest-334660388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.900s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:12:51 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-a6b19900-6f17-47e1-b1b4-e4c7a650bda0 tempest-CreateVolumesFromSnapshotTest-334660388 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-176957398',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efbf1d6c-a35b-420d-a317-fe36fcf4e67a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fe14878da3f4dd88de9896b21fed7d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:12:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:12:47Z,use_quota=True,user_id='53fa3d42dc7c44c6838c9ff0eda8987d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 16:12:51 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-a6b19900-6f17-47e1-b1b4-e4c7a650bda0 tempest-CreateVolumesFromSnapshotTest-334660388 None] Creating volume efbf1d6c-a35b-420d-a317-fe36fcf4e67a {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 16:12:51 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-a6b19900-6f17-47e1-b1b4-e4c7a650bda0 tempest-CreateVolumesFromSnapshotTest-334660388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:12:51 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-a6b19900-6f17-47e1-b1b4-e4c7a650bda0 tempest-CreateVolumesFromSnapshotTest-334660388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:12:51 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-a6b19900-6f17-47e1-b1b4-e4c7a650bda0 tempest-CreateVolumesFromSnapshotTest-334660388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:12:51 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-a6b19900-6f17-47e1-b1b4-e4c7a650bda0 tempest-CreateVolumesFromSnapshotTest-334660388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:12:51 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-a6b19900-6f17-47e1-b1b4-e4c7a650bda0 tempest-CreateVolumesFromSnapshotTest-334660388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:12:51 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-a6b19900-6f17-47e1-b1b4-e4c7a650bda0 tempest-CreateVolumesFromSnapshotTest-334660388 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 16:12:51 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-a6b19900-6f17-47e1-b1b4-e4c7a650bda0 tempest-CreateVolumesFromSnapshotTest-334660388 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 16:12:51 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-a6b19900-6f17-47e1-b1b4-e4c7a650bda0 tempest-CreateVolumesFromSnapshotTest-334660388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-efbf1d6c-a35b-420d-a317-fe36fcf4e67a 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:51 devstack sudo[111626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-efbf1d6c-a35b-420d-a317-fe36fcf4e67a 1073741824
Jun 15 16:12:51 devstack sudo[111626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:51 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-37500653-42d0-418b-a5f5-2afe229287c1 tempest-VolumeDependencyTests-1777202688 None] Create snapshot completed successfully
Jun 15 16:12:52 devstack sudo[111626]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:52 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-a6b19900-6f17-47e1-b1b4-e4c7a650bda0 tempest-CreateVolumesFromSnapshotTest-334660388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-efbf1d6c-a35b-420d-a317-fe36fcf4e67a 1073741824" returned: 0 in 0.861s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:52 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-a6b19900-6f17-47e1-b1b4-e4c7a650bda0 tempest-CreateVolumesFromSnapshotTest-334660388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-efbf1d6c-a35b-420d-a317-fe36fcf4e67a {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:52 devstack sudo[111632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-efbf1d6c-a35b-420d-a317-fe36fcf4e67a
Jun 15 16:12:52 devstack sudo[111632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:52 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa3db858-0d1d-4eb2-b529-fb5156ba56c3 tempest-VolumeDependencyTests-1777202688 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 16:12:52 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-aa3db858-0d1d-4eb2-b529-fb5156ba56c3 tempest-VolumeDependencyTests-1777202688 None] Flow 'volume_create_manager' (20759247-693f-4c99-b1a7-7164376e84e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:12:52 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-aa3db858-0d1d-4eb2-b529-fb5156ba56c3 tempest-VolumeDependencyTests-1777202688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4809b57d-dff3-4855-a1f9-5fd836f51401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:52 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-aa3db858-0d1d-4eb2-b529-fb5156ba56c3 tempest-VolumeDependencyTests-1777202688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4809b57d-dff3-4855-a1f9-5fd836f51401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:12:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1819534190',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58f8c056-8948-4660-96c8-0707f3e5d923,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df0d66e5346f4a2498abf79ed1a563a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:12:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d654f764-9366-4e8e-ba0f-34627d392c3d,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:12:53Z,use_quota=True,user_id='6e40d695589b473c9159239249ff10c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:52 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-aa3db858-0d1d-4eb2-b529-fb5156ba56c3 tempest-VolumeDependencyTests-1777202688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d01d904d-9648-455f-955c-9873d8ff0999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:52 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-aa3db858-0d1d-4eb2-b529-fb5156ba56c3 tempest-VolumeDependencyTests-1777202688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d01d904d-9648-455f-955c-9873d8ff0999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:52 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-aa3db858-0d1d-4eb2-b529-fb5156ba56c3 tempest-VolumeDependencyTests-1777202688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7606409b-3689-4cc0-81b8-b58e95a29139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:52 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-aa3db858-0d1d-4eb2-b529-fb5156ba56c3 tempest-VolumeDependencyTests-1777202688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7606409b-3689-4cc0-81b8-b58e95a29139) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '58f8c056-8948-4660-96c8-0707f3e5d923', 'volume_name': 'volume-58f8c056-8948-4660-96c8-0707f3e5d923', 'volume_size': 1, 'snapshot_id': 'd654f764-9366-4e8e-ba0f-34627d392c3d'}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:52 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-aa3db858-0d1d-4eb2-b529-fb5156ba56c3 tempest-VolumeDependencyTests-1777202688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d2bf50a-d5d1-4d74-abd5-d7a87123977b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:52 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-aa3db858-0d1d-4eb2-b529-fb5156ba56c3 tempest-VolumeDependencyTests-1777202688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d2bf50a-d5d1-4d74-abd5-d7a87123977b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:52 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-aa3db858-0d1d-4eb2-b529-fb5156ba56c3 tempest-VolumeDependencyTests-1777202688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06550020-8c3b-45c6-8048-dc4c8ab5a28c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:52 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-aa3db858-0d1d-4eb2-b529-fb5156ba56c3 tempest-VolumeDependencyTests-1777202688 None] Volume 58f8c056-8948-4660-96c8-0707f3e5d923: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-58f8c056-8948-4660-96c8-0707f3e5d923', 'volume_size': 1, 'snapshot_id': 'd654f764-9366-4e8e-ba0f-34627d392c3d'}
Jun 15 16:12:52 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-aa3db858-0d1d-4eb2-b529-fb5156ba56c3 tempest-VolumeDependencyTests-1777202688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:12:53 devstack sudo[111632]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:53 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-a6b19900-6f17-47e1-b1b4-e4c7a650bda0 tempest-CreateVolumesFromSnapshotTest-334660388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-efbf1d6c-a35b-420d-a317-fe36fcf4e67a" returned: 0 in 0.812s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:53 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-a6b19900-6f17-47e1-b1b4-e4c7a650bda0 tempest-CreateVolumesFromSnapshotTest-334660388 None] <== create_volume: return (1747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 16:12:53 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-a6b19900-6f17-47e1-b1b4-e4c7a650bda0 tempest-CreateVolumesFromSnapshotTest-334660388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.751s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:12:53 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-aa3db858-0d1d-4eb2-b529-fb5156ba56c3 tempest-VolumeDependencyTests-1777202688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.378s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:12:53 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-aa3db858-0d1d-4eb2-b529-fb5156ba56c3 tempest-VolumeDependencyTests-1777202688 None] Acquiring lock "cinder-quobyte-d654f764-9366-4e8e-ba0f-34627d392c3d-58f8c056-8948-4660-96c8-0707f3e5d923" by "_create_volume_from_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:12:53 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-a6b19900-6f17-47e1-b1b4-e4c7a650bda0 tempest-CreateVolumesFromSnapshotTest-334660388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f22b2aab-d4df-4b9a-823c-71920ae41a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efbf1d6c-a35b-420d-a317-fe36fcf4e67a', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:53 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-a6b19900-6f17-47e1-b1b4-e4c7a650bda0 tempest-CreateVolumesFromSnapshotTest-334660388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93d24c1e-9d2c-45f2-b32c-767e0337d751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:53 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-aa3db858-0d1d-4eb2-b529-fb5156ba56c3 tempest-VolumeDependencyTests-1777202688 None] Lock "cinder-quobyte-d654f764-9366-4e8e-ba0f-34627d392c3d-58f8c056-8948-4660-96c8-0707f3e5d923" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:12:53 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-aa3db858-0d1d-4eb2-b529-fb5156ba56c3 tempest-VolumeDependencyTests-1777202688 None] Creating volume 58f8c056-8948-4660-96c8-0707f3e5d923 from snapshot d654f764-9366-4e8e-ba0f-34627d392c3d {{(pid=91863) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 15 16:12:53 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-aa3db858-0d1d-4eb2-b529-fb5156ba56c3 tempest-VolumeDependencyTests-1777202688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:12:53 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-aa3db858-0d1d-4eb2-b529-fb5156ba56c3 tempest-VolumeDependencyTests-1777202688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:12:53 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-aa3db858-0d1d-4eb2-b529-fb5156ba56c3 tempest-VolumeDependencyTests-1777202688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:12:53 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-aa3db858-0d1d-4eb2-b529-fb5156ba56c3 tempest-VolumeDependencyTests-1777202688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:12:53 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-aa3db858-0d1d-4eb2-b529-fb5156ba56c3 tempest-VolumeDependencyTests-1777202688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:12:53 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-aa3db858-0d1d-4eb2-b529-fb5156ba56c3 tempest-VolumeDependencyTests-1777202688 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 16:12:53 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-aa3db858-0d1d-4eb2-b529-fb5156ba56c3 tempest-VolumeDependencyTests-1777202688 None] Acquiring lock "cinder-quobyte-58f8c056-8948-4660-96c8-0707f3e5d923" by "_copy_volume_from_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:12:53 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-a6b19900-6f17-47e1-b1b4-e4c7a650bda0 tempest-CreateVolumesFromSnapshotTest-334660388 None] Volume volume-efbf1d6c-a35b-420d-a317-fe36fcf4e67a (efbf1d6c-a35b-420d-a317-fe36fcf4e67a): created successfully
Jun 15 16:12:53 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-a6b19900-6f17-47e1-b1b4-e4c7a650bda0 tempest-CreateVolumesFromSnapshotTest-334660388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93d24c1e-9d2c-45f2-b32c-767e0337d751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:53 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-a6b19900-6f17-47e1-b1b4-e4c7a650bda0 tempest-CreateVolumesFromSnapshotTest-334660388 None] Flow 'volume_create_manager' (cd6e6c6b-fed5-41f5-a301-61421ef41524) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:12:53 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-aa3db858-0d1d-4eb2-b529-fb5156ba56c3 tempest-VolumeDependencyTests-1777202688 None] Lock "cinder-quobyte-58f8c056-8948-4660-96c8-0707f3e5d923" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:12:53 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-aa3db858-0d1d-4eb2-b529-fb5156ba56c3 tempest-VolumeDependencyTests-1777202688 None] snapshot: d654f764-9366-4e8e-ba0f-34627d392c3d, volume: 58f8c056-8948-4660-96c8-0707f3e5d923,  {{(pid=91863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 15 16:12:53 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-aa3db858-0d1d-4eb2-b529-fb5156ba56c3 tempest-VolumeDependencyTests-1777202688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:12:53 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-aa3db858-0d1d-4eb2-b529-fb5156ba56c3 tempest-VolumeDependencyTests-1777202688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:12:53 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-aa3db858-0d1d-4eb2-b529-fb5156ba56c3 tempest-VolumeDependencyTests-1777202688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:12:53 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-aa3db858-0d1d-4eb2-b529-fb5156ba56c3 tempest-VolumeDependencyTests-1777202688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:12:53 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-aa3db858-0d1d-4eb2-b529-fb5156ba56c3 tempest-VolumeDependencyTests-1777202688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:12:53 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-a6b19900-6f17-47e1-b1b4-e4c7a650bda0 tempest-CreateVolumesFromSnapshotTest-334660388 None] Created volume successfully.
Jun 15 16:12:53 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d8e28d9-6643-4e34-a204-7343d6410696]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:12:53 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-aa3db858-0d1d-4eb2-b529-fb5156ba56c3 tempest-VolumeDependencyTests-1777202688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fea6610d-d072-42e3-938b-d2e8675ba1ad.d654f764-9366-4e8e-ba0f-34627d392c3d {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:53 devstack sudo[111635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fea6610d-d072-42e3-938b-d2e8675ba1ad.d654f764-9366-4e8e-ba0f-34627d392c3d
Jun 15 16:12:53 devstack sudo[111635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:54 devstack sudo[111635]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:54 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-aa3db858-0d1d-4eb2-b529-fb5156ba56c3 tempest-VolumeDependencyTests-1777202688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fea6610d-d072-42e3-938b-d2e8675ba1ad.d654f764-9366-4e8e-ba0f-34627d392c3d" returned: 0 in 0.870s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:54 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-aa3db858-0d1d-4eb2-b529-fb5156ba56c3 tempest-VolumeDependencyTests-1777202688 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fea6610d-d072-42e3-938b-d2e8675ba1ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 16:12:54 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-aa3db858-0d1d-4eb2-b529-fb5156ba56c3 tempest-VolumeDependencyTests-1777202688 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fea6610d-d072-42e3-938b-d2e8675ba1ad {{(pid=91863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 15 16:12:54 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-aa3db858-0d1d-4eb2-b529-fb5156ba56c3 tempest-VolumeDependencyTests-1777202688 None] Creating direct copy from snapshot {{(pid=91863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 15 16:12:54 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-ec9a57aa-7e3e-420f-8e56-60dbff2106cd tempest-CreateVolumesFromSnapshotTest-334660388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:12:54 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[cabba0ff-3822-4660-9dcf-248464b7afa4]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:12:54 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-aa3db858-0d1d-4eb2-b529-fb5156ba56c3 tempest-VolumeDependencyTests-1777202688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fea6610d-d072-42e3-938b-d2e8675ba1ad {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:54 devstack sudo[111641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fea6610d-d072-42e3-938b-d2e8675ba1ad
Jun 15 16:12:54 devstack sudo[111641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:55 devstack sudo[111641]: pam_unix(sudo:session): session closed for user root
Jun 15 16:12:55 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-aa3db858-0d1d-4eb2-b529-fb5156ba56c3 tempest-VolumeDependencyTests-1777202688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fea6610d-d072-42e3-938b-d2e8675ba1ad" returned: 0 in 0.893s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:12:55 devstack cinder-volume[91863]: DEBUG cinder.utils [None req-aa3db858-0d1d-4eb2-b529-fb5156ba56c3 tempest-VolumeDependencyTests-1777202688 None] Path /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-58f8c056-8948-4660-96c8-0707f3e5d923 not found in is_blk_device check {{(pid=91863) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 15 16:12:55 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-aa3db858-0d1d-4eb2-b529-fb5156ba56c3 tempest-VolumeDependencyTests-1777202688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fea6610d-d072-42e3-938b-d2e8675ba1ad /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-58f8c056-8948-4660-96c8-0707f3e5d923 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:12:55 devstack sudo[111647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fea6610d-d072-42e3-938b-d2e8675ba1ad /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-58f8c056-8948-4660-96c8-0707f3e5d923
Jun 15 16:12:55 devstack sudo[111647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:12:59 devstack cinder-volume[91863]: DEBUG dbcounter [-] [91863] Writing DB stats cinder:UPDATE=150,cinder:SELECT=123,cinder:INSERT=43,cinder:DELETE=10 {{(pid=91863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 16:12:59 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4070206-9b89-4c91-8dcc-722d48bb46bb tempest-SnapshotDependencyTests-1103268421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 16:12:59 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-f4070206-9b89-4c91-8dcc-722d48bb46bb tempest-SnapshotDependencyTests-1103268421 None] Flow 'volume_create_manager' (317ff6a9-3e35-4a32-bc9e-8bb3cbd07ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:12:59 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-f4070206-9b89-4c91-8dcc-722d48bb46bb tempest-SnapshotDependencyTests-1103268421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9b583fb-7c51-4513-a81f-ca839111555d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:59 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-f4070206-9b89-4c91-8dcc-722d48bb46bb tempest-SnapshotDependencyTests-1103268421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9b583fb-7c51-4513-a81f-ca839111555d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:12:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-74330954',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1742891b-87ce-4deb-8a0e-064e89adbfb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d50bd19fa99742668f849bcf1e44adc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:12:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:12:59Z,use_quota=True,user_id='959f0942cd4a47f99e9bd18c0eb356a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:59 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-f4070206-9b89-4c91-8dcc-722d48bb46bb tempest-SnapshotDependencyTests-1103268421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cbd4d73-6c9c-49a5-8b1d-89020c617da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:59 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-f4070206-9b89-4c91-8dcc-722d48bb46bb tempest-SnapshotDependencyTests-1103268421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cbd4d73-6c9c-49a5-8b1d-89020c617da7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:59 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-f4070206-9b89-4c91-8dcc-722d48bb46bb tempest-SnapshotDependencyTests-1103268421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5107b117-560c-4520-ad38-cbb82f47ffa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:59 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-f4070206-9b89-4c91-8dcc-722d48bb46bb tempest-SnapshotDependencyTests-1103268421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5107b117-560c-4520-ad38-cbb82f47ffa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1742891b-87ce-4deb-8a0e-064e89adbfb4', 'volume_name': 'volume-1742891b-87ce-4deb-8a0e-064e89adbfb4', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:59 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-f4070206-9b89-4c91-8dcc-722d48bb46bb tempest-SnapshotDependencyTests-1103268421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b158a29e-fe2b-4587-bcea-788f930108e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:59 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-f4070206-9b89-4c91-8dcc-722d48bb46bb tempest-SnapshotDependencyTests-1103268421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b158a29e-fe2b-4587-bcea-788f930108e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:12:59 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-f4070206-9b89-4c91-8dcc-722d48bb46bb tempest-SnapshotDependencyTests-1103268421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e818f7c-c3fd-4db3-9cff-4830fe06af5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:12:59 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-f4070206-9b89-4c91-8dcc-722d48bb46bb tempest-SnapshotDependencyTests-1103268421 None] Volume 1742891b-87ce-4deb-8a0e-064e89adbfb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1742891b-87ce-4deb-8a0e-064e89adbfb4', 'volume_size': 1}
Jun 15 16:12:59 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-f4070206-9b89-4c91-8dcc-722d48bb46bb tempest-SnapshotDependencyTests-1103268421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:13:00 devstack sudo[111647]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:00 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-aa3db858-0d1d-4eb2-b529-fb5156ba56c3 tempest-VolumeDependencyTests-1777202688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fea6610d-d072-42e3-938b-d2e8675ba1ad /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-58f8c056-8948-4660-96c8-0707f3e5d923" returned: 0 in 5.768s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:00 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b4a1bca-9520-40de-9310-8db097925575]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:13:00 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-aa3db858-0d1d-4eb2-b529-fb5156ba56c3 tempest-VolumeDependencyTests-1777202688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fea6610d-d072-42e3-938b-d2e8675ba1ad {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:00 devstack sudo[111660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fea6610d-d072-42e3-938b-d2e8675ba1ad
Jun 15 16:13:00 devstack sudo[111660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:01 devstack sudo[111660]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:01 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-aa3db858-0d1d-4eb2-b529-fb5156ba56c3 tempest-VolumeDependencyTests-1777202688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fea6610d-d072-42e3-938b-d2e8675ba1ad" returned: 0 in 0.923s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:01 devstack cinder-volume[91863]: DEBUG cinder.image.image_utils [None req-aa3db858-0d1d-4eb2-b529-fb5156ba56c3 tempest-VolumeDependencyTests-1777202688 None] Image conversion details: src /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fea6610d-d072-42e3-938b-d2e8675ba1ad, size 1024.00 MB, duration 5.77 sec, destination /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-58f8c056-8948-4660-96c8-0707f3e5d923 {{(pid=91863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 15 16:13:01 devstack cinder-volume[91863]: INFO cinder.image.image_utils [None req-aa3db858-0d1d-4eb2-b529-fb5156ba56c3 tempest-VolumeDependencyTests-1777202688 None] Converted 1024.00 MB image at 177.51 MB/s
Jun 15 16:13:01 devstack cinder-volume[91863]: WARNING cinder.volume.drivers.remotefs [None req-aa3db858-0d1d-4eb2-b529-fb5156ba56c3 tempest-VolumeDependencyTests-1777202688 None] /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-58f8c056-8948-4660-96c8-0707f3e5d923 is being set with open permissions: ugo+rw
Jun 15 16:13:01 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-aa3db858-0d1d-4eb2-b529-fb5156ba56c3 tempest-VolumeDependencyTests-1777202688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-58f8c056-8948-4660-96c8-0707f3e5d923 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:01 devstack sudo[111665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-58f8c056-8948-4660-96c8-0707f3e5d923
Jun 15 16:13:01 devstack sudo[111665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:02 devstack sudo[111665]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:02 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-aa3db858-0d1d-4eb2-b529-fb5156ba56c3 tempest-VolumeDependencyTests-1777202688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-58f8c056-8948-4660-96c8-0707f3e5d923" returned: 0 in 0.649s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:02 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-aa3db858-0d1d-4eb2-b529-fb5156ba56c3 tempest-VolumeDependencyTests-1777202688 None] Lock "cinder-quobyte-58f8c056-8948-4660-96c8-0707f3e5d923" released by "_copy_volume_from_snapshot" :: held 9.216s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:13:02 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-aa3db858-0d1d-4eb2-b529-fb5156ba56c3 tempest-VolumeDependencyTests-1777202688 None] Lock "cinder-quobyte-d654f764-9366-4e8e-ba0f-34627d392c3d-58f8c056-8948-4660-96c8-0707f3e5d923" released by "_create_volume_from_snapshot" :: held 9.266s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:13:02 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-aa3db858-0d1d-4eb2-b529-fb5156ba56c3 tempest-VolumeDependencyTests-1777202688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.301s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:13:02 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-ec9a57aa-7e3e-420f-8e56-60dbff2106cd tempest-CreateVolumesFromSnapshotTest-334660388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.288s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:13:02 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-ec9a57aa-7e3e-420f-8e56-60dbff2106cd tempest-CreateVolumesFromSnapshotTest-334660388 None] Creating offline snapshot 4d2d9e80-b24d-4a80-b194-1d50163348e5 of volume efbf1d6c-a35b-420d-a317-fe36fcf4e67a {{(pid=91863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 15 16:13:02 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-aa3db858-0d1d-4eb2-b529-fb5156ba56c3 tempest-VolumeDependencyTests-1777202688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06550020-8c3b-45c6-8048-dc4c8ab5a28c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58f8c056-8948-4660-96c8-0707f3e5d923', 'volume_size': 1, 'snapshot_id': 'd654f764-9366-4e8e-ba0f-34627d392c3d'}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:13:02 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-aa3db858-0d1d-4eb2-b529-fb5156ba56c3 tempest-VolumeDependencyTests-1777202688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a42582d-bce9-46a3-b3ab-6a415879b5b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:13:02 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[349882d4-ab12-494a-91c5-f92cabd5ad39]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:13:02 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ec9a57aa-7e3e-420f-8e56-60dbff2106cd tempest-CreateVolumesFromSnapshotTest-334660388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-efbf1d6c-a35b-420d-a317-fe36fcf4e67a {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:02 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-aa3db858-0d1d-4eb2-b529-fb5156ba56c3 tempest-VolumeDependencyTests-1777202688 None] Volume volume-58f8c056-8948-4660-96c8-0707f3e5d923 (58f8c056-8948-4660-96c8-0707f3e5d923): created successfully
Jun 15 16:13:02 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-aa3db858-0d1d-4eb2-b529-fb5156ba56c3 tempest-VolumeDependencyTests-1777202688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a42582d-bce9-46a3-b3ab-6a415879b5b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:13:02 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-aa3db858-0d1d-4eb2-b529-fb5156ba56c3 tempest-VolumeDependencyTests-1777202688 None] Flow 'volume_create_manager' (20759247-693f-4c99-b1a7-7164376e84e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:13:02 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-aa3db858-0d1d-4eb2-b529-fb5156ba56c3 tempest-VolumeDependencyTests-1777202688 None] Created volume successfully.
Jun 15 16:13:02 devstack sudo[111668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-efbf1d6c-a35b-420d-a317-fe36fcf4e67a
Jun 15 16:13:02 devstack sudo[111668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:02 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-fff7f87f-1e7f-4ed8-8c18-e7d2f3b6f27a tempest-VolumeDependencyTests-1777202688 None] Acquiring lock "cinder-d654f764-9366-4e8e-ba0f-34627d392c3d-delete_snapshot" by "delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:13:02 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-fff7f87f-1e7f-4ed8-8c18-e7d2f3b6f27a tempest-VolumeDependencyTests-1777202688 None] Lock "cinder-d654f764-9366-4e8e-ba0f-34627d392c3d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:13:02 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-fff7f87f-1e7f-4ed8-8c18-e7d2f3b6f27a tempest-VolumeDependencyTests-1777202688 None] Acquiring lock "cinder-quobyte-fea6610d-d072-42e3-938b-d2e8675ba1ad" by "delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:13:02 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-fff7f87f-1e7f-4ed8-8c18-e7d2f3b6f27a tempest-VolumeDependencyTests-1777202688 None] Lock "cinder-quobyte-fea6610d-d072-42e3-938b-d2e8675ba1ad" acquired by "delete_snapshot" :: waited 0.026s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:13:02 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-fff7f87f-1e7f-4ed8-8c18-e7d2f3b6f27a tempest-VolumeDependencyTests-1777202688 None] Acquiring lock "cinder-quobyte-d654f764-9366-4e8e-ba0f-34627d392c3d" by "_delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:13:02 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-fff7f87f-1e7f-4ed8-8c18-e7d2f3b6f27a tempest-VolumeDependencyTests-1777202688 None] Lock "cinder-quobyte-d654f764-9366-4e8e-ba0f-34627d392c3d" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:13:02 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-fff7f87f-1e7f-4ed8-8c18-e7d2f3b6f27a tempest-VolumeDependencyTests-1777202688 None] Deleting offline snapshot d654f764-9366-4e8e-ba0f-34627d392c3d of volume fea6610d-d072-42e3-938b-d2e8675ba1ad {{(pid=91863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 15 16:13:02 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-fff7f87f-1e7f-4ed8-8c18-e7d2f3b6f27a tempest-VolumeDependencyTests-1777202688 None] snapshot_file for this snap is: volume-fea6610d-d072-42e3-938b-d2e8675ba1ad.d654f764-9366-4e8e-ba0f-34627d392c3d {{(pid=91863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 15 16:13:02 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a5007c3-173c-40b0-98e8-e708a9d6761d]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:13:02 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-fff7f87f-1e7f-4ed8-8c18-e7d2f3b6f27a tempest-VolumeDependencyTests-1777202688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fea6610d-d072-42e3-938b-d2e8675ba1ad.d654f764-9366-4e8e-ba0f-34627d392c3d {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:03 devstack sudo[111670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fea6610d-d072-42e3-938b-d2e8675ba1ad.d654f764-9366-4e8e-ba0f-34627d392c3d
Jun 15 16:13:03 devstack sudo[111670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:03 devstack sudo[111668]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:03 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ec9a57aa-7e3e-420f-8e56-60dbff2106cd tempest-CreateVolumesFromSnapshotTest-334660388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-efbf1d6c-a35b-420d-a317-fe36fcf4e67a" returned: 0 in 0.786s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:03 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ec9a57aa-7e3e-420f-8e56-60dbff2106cd tempest-CreateVolumesFromSnapshotTest-334660388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-efbf1d6c-a35b-420d-a317-fe36fcf4e67a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-efbf1d6c-a35b-420d-a317-fe36fcf4e67a.4d2d9e80-b24d-4a80-b194-1d50163348e5 1G {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:03 devstack sudo[111675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-efbf1d6c-a35b-420d-a317-fe36fcf4e67a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-efbf1d6c-a35b-420d-a317-fe36fcf4e67a.4d2d9e80-b24d-4a80-b194-1d50163348e5 1G
Jun 15 16:13:03 devstack sudo[111675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:03 devstack sudo[111670]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:03 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-fff7f87f-1e7f-4ed8-8c18-e7d2f3b6f27a tempest-VolumeDependencyTests-1777202688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fea6610d-d072-42e3-938b-d2e8675ba1ad.d654f764-9366-4e8e-ba0f-34627d392c3d" returned: 0 in 0.857s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:03 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-fff7f87f-1e7f-4ed8-8c18-e7d2f3b6f27a tempest-VolumeDependencyTests-1777202688 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fea6610d-d072-42e3-938b-d2e8675ba1ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 16:13:03 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7afc9f59-0819-4ded-a63c-4aa5aaf390d5]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:13:03 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-fff7f87f-1e7f-4ed8-8c18-e7d2f3b6f27a tempest-VolumeDependencyTests-1777202688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fea6610d-d072-42e3-938b-d2e8675ba1ad {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:03 devstack sudo[111683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fea6610d-d072-42e3-938b-d2e8675ba1ad
Jun 15 16:13:03 devstack sudo[111683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:04 devstack sudo[111675]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:04 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ec9a57aa-7e3e-420f-8e56-60dbff2106cd tempest-CreateVolumesFromSnapshotTest-334660388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-efbf1d6c-a35b-420d-a317-fe36fcf4e67a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-efbf1d6c-a35b-420d-a317-fe36fcf4e67a.4d2d9e80-b24d-4a80-b194-1d50163348e5 1G" returned: 0 in 0.889s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:04 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ec9a57aa-7e3e-420f-8e56-60dbff2106cd tempest-CreateVolumesFromSnapshotTest-334660388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efbf1d6c-a35b-420d-a317-fe36fcf4e67a -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-efbf1d6c-a35b-420d-a317-fe36fcf4e67a.4d2d9e80-b24d-4a80-b194-1d50163348e5 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:04 devstack sudo[111685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efbf1d6c-a35b-420d-a317-fe36fcf4e67a -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-efbf1d6c-a35b-420d-a317-fe36fcf4e67a.4d2d9e80-b24d-4a80-b194-1d50163348e5
Jun 15 16:13:04 devstack sudo[111685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:04 devstack sudo[111683]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:04 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-fff7f87f-1e7f-4ed8-8c18-e7d2f3b6f27a tempest-VolumeDependencyTests-1777202688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fea6610d-d072-42e3-938b-d2e8675ba1ad" returned: 0 in 0.829s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:04 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-fff7f87f-1e7f-4ed8-8c18-e7d2f3b6f27a tempest-VolumeDependencyTests-1777202688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fea6610d-d072-42e3-938b-d2e8675ba1ad.d654f764-9366-4e8e-ba0f-34627d392c3d {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:04 devstack sudo[111690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fea6610d-d072-42e3-938b-d2e8675ba1ad.d654f764-9366-4e8e-ba0f-34627d392c3d
Jun 15 16:13:04 devstack sudo[111690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:04 devstack sudo[111685]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:04 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ec9a57aa-7e3e-420f-8e56-60dbff2106cd tempest-CreateVolumesFromSnapshotTest-334660388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efbf1d6c-a35b-420d-a317-fe36fcf4e67a -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-efbf1d6c-a35b-420d-a317-fe36fcf4e67a.4d2d9e80-b24d-4a80-b194-1d50163348e5" returned: 0 in 0.745s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:04 devstack cinder-volume[91863]: WARNING cinder.volume.drivers.remotefs [None req-ec9a57aa-7e3e-420f-8e56-60dbff2106cd tempest-CreateVolumesFromSnapshotTest-334660388 None] /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-efbf1d6c-a35b-420d-a317-fe36fcf4e67a.4d2d9e80-b24d-4a80-b194-1d50163348e5 is being set with open permissions: ugo+rw
Jun 15 16:13:04 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ec9a57aa-7e3e-420f-8e56-60dbff2106cd tempest-CreateVolumesFromSnapshotTest-334660388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-efbf1d6c-a35b-420d-a317-fe36fcf4e67a.4d2d9e80-b24d-4a80-b194-1d50163348e5 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:04 devstack sudo[111695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-efbf1d6c-a35b-420d-a317-fe36fcf4e67a.4d2d9e80-b24d-4a80-b194-1d50163348e5
Jun 15 16:13:04 devstack sudo[111695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:05 devstack sudo[111690]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:05 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-fff7f87f-1e7f-4ed8-8c18-e7d2f3b6f27a tempest-VolumeDependencyTests-1777202688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fea6610d-d072-42e3-938b-d2e8675ba1ad.d654f764-9366-4e8e-ba0f-34627d392c3d" returned: 0 in 0.782s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:05 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-fff7f87f-1e7f-4ed8-8c18-e7d2f3b6f27a tempest-VolumeDependencyTests-1777202688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fea6610d-d072-42e3-938b-d2e8675ba1ad.d654f764-9366-4e8e-ba0f-34627d392c3d {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:05 devstack sudo[111701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fea6610d-d072-42e3-938b-d2e8675ba1ad.d654f764-9366-4e8e-ba0f-34627d392c3d
Jun 15 16:13:05 devstack sudo[111701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:05 devstack sudo[111695]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:05 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ec9a57aa-7e3e-420f-8e56-60dbff2106cd tempest-CreateVolumesFromSnapshotTest-334660388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-efbf1d6c-a35b-420d-a317-fe36fcf4e67a.4d2d9e80-b24d-4a80-b194-1d50163348e5" returned: 0 in 0.699s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:05 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ec9a57aa-7e3e-420f-8e56-60dbff2106cd tempest-CreateVolumesFromSnapshotTest-334660388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-efbf1d6c-a35b-420d-a317-fe36fcf4e67a.info {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:05 devstack sudo[111704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-efbf1d6c-a35b-420d-a317-fe36fcf4e67a.info
Jun 15 16:13:05 devstack sudo[111704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:06 devstack sudo[111701]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:06 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-fff7f87f-1e7f-4ed8-8c18-e7d2f3b6f27a tempest-VolumeDependencyTests-1777202688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fea6610d-d072-42e3-938b-d2e8675ba1ad.d654f764-9366-4e8e-ba0f-34627d392c3d" returned: 0 in 0.639s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:06 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-fff7f87f-1e7f-4ed8-8c18-e7d2f3b6f27a tempest-VolumeDependencyTests-1777202688 None] Lock "cinder-quobyte-d654f764-9366-4e8e-ba0f-34627d392c3d" released by "_delete_snapshot" :: held 3.215s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:13:06 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-fff7f87f-1e7f-4ed8-8c18-e7d2f3b6f27a tempest-VolumeDependencyTests-1777202688 None] Lock "cinder-quobyte-fea6610d-d072-42e3-938b-d2e8675ba1ad" released by "delete_snapshot" :: held 3.242s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:13:06 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-fff7f87f-1e7f-4ed8-8c18-e7d2f3b6f27a tempest-VolumeDependencyTests-1777202688 None] Created reservations ['579e3219-08b3-4736-bcff-bfe5007de7ee', 'd4b7dccc-60a2-497b-a198-eaaaa9380451', '5cf75abd-9cb7-46e7-bc7c-f209801bc7ae', '2b28d02a-ac67-4af9-9d37-47f488723fa4'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 16:13:06 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-fff7f87f-1e7f-4ed8-8c18-e7d2f3b6f27a tempest-VolumeDependencyTests-1777202688 None] Delete snapshot completed successfully.
Jun 15 16:13:06 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-fff7f87f-1e7f-4ed8-8c18-e7d2f3b6f27a tempest-VolumeDependencyTests-1777202688 None] Lock "cinder-d654f764-9366-4e8e-ba0f-34627d392c3d-delete_snapshot" released by "delete_snapshot" :: held 3.406s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:13:06 devstack sudo[111704]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:06 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ec9a57aa-7e3e-420f-8e56-60dbff2106cd tempest-CreateVolumesFromSnapshotTest-334660388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-efbf1d6c-a35b-420d-a317-fe36fcf4e67a.info" returned: 0 in 0.643s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:06 devstack cinder-volume[91863]: WARNING cinder.volume.drivers.remotefs [None req-ec9a57aa-7e3e-420f-8e56-60dbff2106cd tempest-CreateVolumesFromSnapshotTest-334660388 None] /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-efbf1d6c-a35b-420d-a317-fe36fcf4e67a.info is being set with open permissions: ugo+rw
Jun 15 16:13:06 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ec9a57aa-7e3e-420f-8e56-60dbff2106cd tempest-CreateVolumesFromSnapshotTest-334660388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-efbf1d6c-a35b-420d-a317-fe36fcf4e67a.info {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:06 devstack sudo[111708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-efbf1d6c-a35b-420d-a317-fe36fcf4e67a.info
Jun 15 16:13:06 devstack sudo[111708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:06 devstack sudo[111708]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:06 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-ec9a57aa-7e3e-420f-8e56-60dbff2106cd tempest-CreateVolumesFromSnapshotTest-334660388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-efbf1d6c-a35b-420d-a317-fe36fcf4e67a.info" returned: 0 in 0.643s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:06 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-ec9a57aa-7e3e-420f-8e56-60dbff2106cd tempest-CreateVolumesFromSnapshotTest-334660388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.536s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:13:06 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-f4070206-9b89-4c91-8dcc-722d48bb46bb tempest-SnapshotDependencyTests-1103268421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.315s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:13:06 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-f4070206-9b89-4c91-8dcc-722d48bb46bb tempest-SnapshotDependencyTests-1103268421 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:12:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-74330954',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1742891b-87ce-4deb-8a0e-064e89adbfb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d50bd19fa99742668f849bcf1e44adc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:12:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:12:59Z,use_quota=True,user_id='959f0942cd4a47f99e9bd18c0eb356a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 16:13:06 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-f4070206-9b89-4c91-8dcc-722d48bb46bb tempest-SnapshotDependencyTests-1103268421 None] Creating volume 1742891b-87ce-4deb-8a0e-064e89adbfb4 {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 16:13:06 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-f4070206-9b89-4c91-8dcc-722d48bb46bb tempest-SnapshotDependencyTests-1103268421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:13:06 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-f4070206-9b89-4c91-8dcc-722d48bb46bb tempest-SnapshotDependencyTests-1103268421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:13:06 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-f4070206-9b89-4c91-8dcc-722d48bb46bb tempest-SnapshotDependencyTests-1103268421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:13:06 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-f4070206-9b89-4c91-8dcc-722d48bb46bb tempest-SnapshotDependencyTests-1103268421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:13:06 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-f4070206-9b89-4c91-8dcc-722d48bb46bb tempest-SnapshotDependencyTests-1103268421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:13:06 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-f4070206-9b89-4c91-8dcc-722d48bb46bb tempest-SnapshotDependencyTests-1103268421 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 16:13:06 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-f4070206-9b89-4c91-8dcc-722d48bb46bb tempest-SnapshotDependencyTests-1103268421 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 16:13:06 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-f4070206-9b89-4c91-8dcc-722d48bb46bb tempest-SnapshotDependencyTests-1103268421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1742891b-87ce-4deb-8a0e-064e89adbfb4 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:06 devstack cinder-volume[91863]: DEBUG dbcounter [-] [91863] Writing DB stats cinder:SELECT=116,cinder:UPDATE=166,cinder:INSERT=47,cinder:DELETE=19 {{(pid=91863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 16:13:07 devstack sudo[111711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1742891b-87ce-4deb-8a0e-064e89adbfb4 1073741824
Jun 15 16:13:07 devstack sudo[111711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:07 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-ec9a57aa-7e3e-420f-8e56-60dbff2106cd tempest-CreateVolumesFromSnapshotTest-334660388 None] Create snapshot completed successfully
Jun 15 16:13:07 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-731b5ca6-16f6-459d-a603-2664173c36f9 tempest-VolumeDependencyTests-1777202688 None] Acquiring lock "cinder-fea6610d-d072-42e3-938b-d2e8675ba1ad-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:13:07 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-731b5ca6-16f6-459d-a603-2664173c36f9 tempest-VolumeDependencyTests-1777202688 None] Lock "cinder-fea6610d-d072-42e3-938b-d2e8675ba1ad-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:13:07 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-731b5ca6-16f6-459d-a603-2664173c36f9 tempest-VolumeDependencyTests-1777202688 None] Acquiring lock "cinder-quobyte-fea6610d-d072-42e3-938b-d2e8675ba1ad" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:13:07 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-731b5ca6-16f6-459d-a603-2664173c36f9 tempest-VolumeDependencyTests-1777202688 None] Lock "cinder-quobyte-fea6610d-d072-42e3-938b-d2e8675ba1ad" acquired by "delete_volume" :: waited 0.025s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:13:07 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9011e3c3-bd6e-4009-9dad-4470c367d7a3]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:13:07 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-731b5ca6-16f6-459d-a603-2664173c36f9 tempest-VolumeDependencyTests-1777202688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fea6610d-d072-42e3-938b-d2e8675ba1ad {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:07 devstack sudo[111713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fea6610d-d072-42e3-938b-d2e8675ba1ad
Jun 15 16:13:07 devstack sudo[111713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:07 devstack sudo[111711]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:07 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-f4070206-9b89-4c91-8dcc-722d48bb46bb tempest-SnapshotDependencyTests-1103268421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1742891b-87ce-4deb-8a0e-064e89adbfb4 1073741824" returned: 0 in 0.831s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:07 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-f4070206-9b89-4c91-8dcc-722d48bb46bb tempest-SnapshotDependencyTests-1103268421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1742891b-87ce-4deb-8a0e-064e89adbfb4 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:07 devstack sudo[111718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1742891b-87ce-4deb-8a0e-064e89adbfb4
Jun 15 16:13:07 devstack sudo[111718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:08 devstack sudo[111713]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:08 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-731b5ca6-16f6-459d-a603-2664173c36f9 tempest-VolumeDependencyTests-1777202688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fea6610d-d072-42e3-938b-d2e8675ba1ad" returned: 0 in 0.889s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:08 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-731b5ca6-16f6-459d-a603-2664173c36f9 tempest-VolumeDependencyTests-1777202688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fea6610d-d072-42e3-938b-d2e8675ba1ad {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:08 devstack sudo[111724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fea6610d-d072-42e3-938b-d2e8675ba1ad
Jun 15 16:13:08 devstack sudo[111724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:08 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-c891e125-99c3-4956-902a-59b66ea567f1 tempest-CreateVolumesFromSnapshotTest-334660388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 16:13:08 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-c891e125-99c3-4956-902a-59b66ea567f1 tempest-CreateVolumesFromSnapshotTest-334660388 None] Flow 'volume_create_manager' (1841dc3e-33c8-457f-91f4-f90a46f5ea99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:13:08 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-c891e125-99c3-4956-902a-59b66ea567f1 tempest-CreateVolumesFromSnapshotTest-334660388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (701d25da-770b-4994-a013-546cfdaef320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:13:08 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-c891e125-99c3-4956-902a-59b66ea567f1 tempest-CreateVolumesFromSnapshotTest-334660388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (701d25da-770b-4994-a013-546cfdaef320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:13:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1676517758',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a4613bb-080d-4f17-b3f2-c028c1c90a13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fe14878da3f4dd88de9896b21fed7d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:13:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:13:08Z,use_quota=True,user_id='53fa3d42dc7c44c6838c9ff0eda8987d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:13:08 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-c891e125-99c3-4956-902a-59b66ea567f1 tempest-CreateVolumesFromSnapshotTest-334660388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7facf29-5126-4af2-b2f2-67518d93083d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:13:08 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-c891e125-99c3-4956-902a-59b66ea567f1 tempest-CreateVolumesFromSnapshotTest-334660388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7facf29-5126-4af2-b2f2-67518d93083d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:13:08 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-c891e125-99c3-4956-902a-59b66ea567f1 tempest-CreateVolumesFromSnapshotTest-334660388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e2efb8a-a116-4a94-aba3-5c785fc2dfb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:13:08 devstack sudo[111718]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:08 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-c891e125-99c3-4956-902a-59b66ea567f1 tempest-CreateVolumesFromSnapshotTest-334660388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e2efb8a-a116-4a94-aba3-5c785fc2dfb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a4613bb-080d-4f17-b3f2-c028c1c90a13', 'volume_name': 'volume-6a4613bb-080d-4f17-b3f2-c028c1c90a13', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:13:08 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-c891e125-99c3-4956-902a-59b66ea567f1 tempest-CreateVolumesFromSnapshotTest-334660388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a79c3af7-e040-4a78-b920-9eba894bca5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:13:08 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-c891e125-99c3-4956-902a-59b66ea567f1 tempest-CreateVolumesFromSnapshotTest-334660388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a79c3af7-e040-4a78-b920-9eba894bca5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:13:08 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-c891e125-99c3-4956-902a-59b66ea567f1 tempest-CreateVolumesFromSnapshotTest-334660388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9923a36a-4dfd-496b-87f7-e9389cbb564f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:13:08 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-c891e125-99c3-4956-902a-59b66ea567f1 tempest-CreateVolumesFromSnapshotTest-334660388 None] Volume 6a4613bb-080d-4f17-b3f2-c028c1c90a13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a4613bb-080d-4f17-b3f2-c028c1c90a13', 'volume_size': 1}
Jun 15 16:13:08 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-c891e125-99c3-4956-902a-59b66ea567f1 tempest-CreateVolumesFromSnapshotTest-334660388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:13:08 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-f4070206-9b89-4c91-8dcc-722d48bb46bb tempest-SnapshotDependencyTests-1103268421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1742891b-87ce-4deb-8a0e-064e89adbfb4" returned: 0 in 0.748s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:08 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-f4070206-9b89-4c91-8dcc-722d48bb46bb tempest-SnapshotDependencyTests-1103268421 None] <== create_volume: return (1628ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 16:13:08 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-f4070206-9b89-4c91-8dcc-722d48bb46bb tempest-SnapshotDependencyTests-1103268421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.633s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:13:08 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-c891e125-99c3-4956-902a-59b66ea567f1 tempest-CreateVolumesFromSnapshotTest-334660388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:13:08 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-c891e125-99c3-4956-902a-59b66ea567f1 tempest-CreateVolumesFromSnapshotTest-334660388 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:13:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1676517758',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a4613bb-080d-4f17-b3f2-c028c1c90a13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fe14878da3f4dd88de9896b21fed7d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:13:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:13:08Z,use_quota=True,user_id='53fa3d42dc7c44c6838c9ff0eda8987d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 16:13:08 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-c891e125-99c3-4956-902a-59b66ea567f1 tempest-CreateVolumesFromSnapshotTest-334660388 None] Creating volume 6a4613bb-080d-4f17-b3f2-c028c1c90a13 {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 16:13:08 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-c891e125-99c3-4956-902a-59b66ea567f1 tempest-CreateVolumesFromSnapshotTest-334660388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:13:08 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-c891e125-99c3-4956-902a-59b66ea567f1 tempest-CreateVolumesFromSnapshotTest-334660388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:13:08 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-c891e125-99c3-4956-902a-59b66ea567f1 tempest-CreateVolumesFromSnapshotTest-334660388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:13:08 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-c891e125-99c3-4956-902a-59b66ea567f1 tempest-CreateVolumesFromSnapshotTest-334660388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:13:08 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-c891e125-99c3-4956-902a-59b66ea567f1 tempest-CreateVolumesFromSnapshotTest-334660388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:13:08 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-c891e125-99c3-4956-902a-59b66ea567f1 tempest-CreateVolumesFromSnapshotTest-334660388 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 16:13:08 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-c891e125-99c3-4956-902a-59b66ea567f1 tempest-CreateVolumesFromSnapshotTest-334660388 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 16:13:08 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c891e125-99c3-4956-902a-59b66ea567f1 tempest-CreateVolumesFromSnapshotTest-334660388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-6a4613bb-080d-4f17-b3f2-c028c1c90a13 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:08 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-f4070206-9b89-4c91-8dcc-722d48bb46bb tempest-SnapshotDependencyTests-1103268421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e818f7c-c3fd-4db3-9cff-4830fe06af5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1742891b-87ce-4deb-8a0e-064e89adbfb4', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:13:08 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-f4070206-9b89-4c91-8dcc-722d48bb46bb tempest-SnapshotDependencyTests-1103268421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e876969e-062e-4a20-abef-71951044fa1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:13:08 devstack sudo[111727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-6a4613bb-080d-4f17-b3f2-c028c1c90a13 1073741824
Jun 15 16:13:08 devstack sudo[111727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:08 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-f4070206-9b89-4c91-8dcc-722d48bb46bb tempest-SnapshotDependencyTests-1103268421 None] Volume volume-1742891b-87ce-4deb-8a0e-064e89adbfb4 (1742891b-87ce-4deb-8a0e-064e89adbfb4): created successfully
Jun 15 16:13:08 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-f4070206-9b89-4c91-8dcc-722d48bb46bb tempest-SnapshotDependencyTests-1103268421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e876969e-062e-4a20-abef-71951044fa1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:13:08 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-f4070206-9b89-4c91-8dcc-722d48bb46bb tempest-SnapshotDependencyTests-1103268421 None] Flow 'volume_create_manager' (317ff6a9-3e35-4a32-bc9e-8bb3cbd07ca4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:13:08 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-f4070206-9b89-4c91-8dcc-722d48bb46bb tempest-SnapshotDependencyTests-1103268421 None] Created volume successfully.
Jun 15 16:13:08 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-e68f8112-9503-4c61-a3cd-0ce967a22b1b tempest-CreateVolumesFromSnapshotTest-334660388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 16:13:08 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e68f8112-9503-4c61-a3cd-0ce967a22b1b tempest-CreateVolumesFromSnapshotTest-334660388 None] Flow 'volume_create_manager' (7e799aae-59aa-4c9d-8614-96b887bbb0e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:13:08 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e68f8112-9503-4c61-a3cd-0ce967a22b1b tempest-CreateVolumesFromSnapshotTest-334660388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (755dbcad-0b7c-4c94-855b-69200eeb48da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:13:08 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e68f8112-9503-4c61-a3cd-0ce967a22b1b tempest-CreateVolumesFromSnapshotTest-334660388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (755dbcad-0b7c-4c94-855b-69200eeb48da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:13:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1986347255',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72048783-d8c0-42f2-ae16-75f560446c5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fe14878da3f4dd88de9896b21fed7d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:13:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:13:09Z,use_quota=True,user_id='53fa3d42dc7c44c6838c9ff0eda8987d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:13:08 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e68f8112-9503-4c61-a3cd-0ce967a22b1b tempest-CreateVolumesFromSnapshotTest-334660388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99a4baf1-f065-485f-809f-d54635225d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:13:08 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e68f8112-9503-4c61-a3cd-0ce967a22b1b tempest-CreateVolumesFromSnapshotTest-334660388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99a4baf1-f065-485f-809f-d54635225d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:13:08 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e68f8112-9503-4c61-a3cd-0ce967a22b1b tempest-CreateVolumesFromSnapshotTest-334660388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87f9b363-affa-4612-a625-4905d68bfc7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:13:08 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e68f8112-9503-4c61-a3cd-0ce967a22b1b tempest-CreateVolumesFromSnapshotTest-334660388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87f9b363-affa-4612-a625-4905d68bfc7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72048783-d8c0-42f2-ae16-75f560446c5f', 'volume_name': 'volume-72048783-d8c0-42f2-ae16-75f560446c5f', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:13:09 devstack sudo[111724]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:09 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e68f8112-9503-4c61-a3cd-0ce967a22b1b tempest-CreateVolumesFromSnapshotTest-334660388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5126d351-bd51-4add-a392-032693a1e374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:13:09 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e68f8112-9503-4c61-a3cd-0ce967a22b1b tempest-CreateVolumesFromSnapshotTest-334660388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5126d351-bd51-4add-a392-032693a1e374) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:13:09 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e68f8112-9503-4c61-a3cd-0ce967a22b1b tempest-CreateVolumesFromSnapshotTest-334660388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10a623c2-887a-41c5-91f7-542bf4c5da32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:13:09 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-e68f8112-9503-4c61-a3cd-0ce967a22b1b tempest-CreateVolumesFromSnapshotTest-334660388 None] Volume 72048783-d8c0-42f2-ae16-75f560446c5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72048783-d8c0-42f2-ae16-75f560446c5f', 'volume_size': 1}
Jun 15 16:13:09 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-e68f8112-9503-4c61-a3cd-0ce967a22b1b tempest-CreateVolumesFromSnapshotTest-334660388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:13:09 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-731b5ca6-16f6-459d-a603-2664173c36f9 tempest-VolumeDependencyTests-1777202688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-fea6610d-d072-42e3-938b-d2e8675ba1ad" returned: 0 in 0.849s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:09 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-731b5ca6-16f6-459d-a603-2664173c36f9 tempest-VolumeDependencyTests-1777202688 None] Lock "cinder-quobyte-fea6610d-d072-42e3-938b-d2e8675ba1ad" released by "delete_volume" :: held 1.801s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:13:09 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-731b5ca6-16f6-459d-a603-2664173c36f9 tempest-VolumeDependencyTests-1777202688 None] Created reservations ['b4993fb5-df7a-4780-80fe-354bd0dd6a40', '2dd835bf-957e-4e95-b3ac-154c7ededc9b', 'ffc9d871-299c-4ff6-bf9b-a9df310b0342', '1660f11f-addd-46c4-8802-050cdc1b60c9'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 16:13:09 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-731b5ca6-16f6-459d-a603-2664173c36f9 tempest-VolumeDependencyTests-1777202688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:13:09 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-731b5ca6-16f6-459d-a603-2664173c36f9 tempest-VolumeDependencyTests-1777202688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:13:09 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-731b5ca6-16f6-459d-a603-2664173c36f9 tempest-VolumeDependencyTests-1777202688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:13:09 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-731b5ca6-16f6-459d-a603-2664173c36f9 tempest-VolumeDependencyTests-1777202688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:13:09 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-731b5ca6-16f6-459d-a603-2664173c36f9 tempest-VolumeDependencyTests-1777202688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:13:09 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-731b5ca6-16f6-459d-a603-2664173c36f9 tempest-VolumeDependencyTests-1777202688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:09 devstack sudo[111732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 16:13:09 devstack sudo[111732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:09 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0e0ea26-a083-4cf6-bb3d-28fde43b3b07 tempest-CreateVolumesFromSnapshotTest-334660388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 16:13:09 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-a0e0ea26-a083-4cf6-bb3d-28fde43b3b07 tempest-CreateVolumesFromSnapshotTest-334660388 None] Flow 'volume_create_manager' (d130004c-b33b-4975-bab5-d67d09997048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:13:09 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-a0e0ea26-a083-4cf6-bb3d-28fde43b3b07 tempest-CreateVolumesFromSnapshotTest-334660388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62b9109f-d866-4cd4-8cb0-f57481acb326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:13:09 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-a0e0ea26-a083-4cf6-bb3d-28fde43b3b07 tempest-CreateVolumesFromSnapshotTest-334660388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62b9109f-d866-4cd4-8cb0-f57481acb326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:13:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1532264295',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0540fcb9-fe0d-4b9b-a2aa-d33aeff1bc05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fe14878da3f4dd88de9896b21fed7d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:13:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:13:09Z,use_quota=True,user_id='53fa3d42dc7c44c6838c9ff0eda8987d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:13:09 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-a0e0ea26-a083-4cf6-bb3d-28fde43b3b07 tempest-CreateVolumesFromSnapshotTest-334660388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51557b78-2fe2-4c92-967f-e7f8f9f3b411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:13:09 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-a0e0ea26-a083-4cf6-bb3d-28fde43b3b07 tempest-CreateVolumesFromSnapshotTest-334660388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51557b78-2fe2-4c92-967f-e7f8f9f3b411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:13:09 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-a0e0ea26-a083-4cf6-bb3d-28fde43b3b07 tempest-CreateVolumesFromSnapshotTest-334660388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c595f238-7aa0-448f-b020-e61059ab3475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:13:09 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-a0e0ea26-a083-4cf6-bb3d-28fde43b3b07 tempest-CreateVolumesFromSnapshotTest-334660388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c595f238-7aa0-448f-b020-e61059ab3475) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0540fcb9-fe0d-4b9b-a2aa-d33aeff1bc05', 'volume_name': 'volume-0540fcb9-fe0d-4b9b-a2aa-d33aeff1bc05', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:13:09 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-a0e0ea26-a083-4cf6-bb3d-28fde43b3b07 tempest-CreateVolumesFromSnapshotTest-334660388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db349fef-c27d-4f85-9685-7cca48adb332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:13:09 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-a0e0ea26-a083-4cf6-bb3d-28fde43b3b07 tempest-CreateVolumesFromSnapshotTest-334660388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db349fef-c27d-4f85-9685-7cca48adb332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:13:09 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-a0e0ea26-a083-4cf6-bb3d-28fde43b3b07 tempest-CreateVolumesFromSnapshotTest-334660388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33dcdcdc-d933-45d9-9ca9-bc92c9a12951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:13:09 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-a0e0ea26-a083-4cf6-bb3d-28fde43b3b07 tempest-CreateVolumesFromSnapshotTest-334660388 None] Volume 0540fcb9-fe0d-4b9b-a2aa-d33aeff1bc05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0540fcb9-fe0d-4b9b-a2aa-d33aeff1bc05', 'volume_size': 1}
Jun 15 16:13:09 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-a0e0ea26-a083-4cf6-bb3d-28fde43b3b07 tempest-CreateVolumesFromSnapshotTest-334660388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:13:09 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-4705f3b1-1693-4be8-ad3c-dca9dbf85171 tempest-VolumeDependencyTests-1777202688 None] Acquiring lock "cinder-58f8c056-8948-4660-96c8-0707f3e5d923-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:13:09 devstack sudo[111727]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:09 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c891e125-99c3-4956-902a-59b66ea567f1 tempest-CreateVolumesFromSnapshotTest-334660388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-6a4613bb-080d-4f17-b3f2-c028c1c90a13 1073741824" returned: 0 in 1.234s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:09 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-4705f3b1-1693-4be8-ad3c-dca9dbf85171 tempest-VolumeDependencyTests-1777202688 None] Lock "cinder-58f8c056-8948-4660-96c8-0707f3e5d923-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:13:09 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c891e125-99c3-4956-902a-59b66ea567f1 tempest-CreateVolumesFromSnapshotTest-334660388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-6a4613bb-080d-4f17-b3f2-c028c1c90a13 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:09 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-0f84c459-8c91-4b2a-969d-33862ec183c8 tempest-SnapshotDependencyTests-1103268421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:13:09 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-4705f3b1-1693-4be8-ad3c-dca9dbf85171 tempest-VolumeDependencyTests-1777202688 None] Acquiring lock "cinder-quobyte-58f8c056-8948-4660-96c8-0707f3e5d923" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:13:09 devstack sudo[111737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-6a4613bb-080d-4f17-b3f2-c028c1c90a13
Jun 15 16:13:09 devstack sudo[111737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:10 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-4705f3b1-1693-4be8-ad3c-dca9dbf85171 tempest-VolumeDependencyTests-1777202688 None] Lock "cinder-quobyte-58f8c056-8948-4660-96c8-0707f3e5d923" acquired by "delete_volume" :: waited 0.025s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:13:10 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-a199b6d1-a994-4f66-8d6e-25f82aef8d53 tempest-CreateVolumesFromSnapshotTest-334660388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 16:13:10 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-a199b6d1-a994-4f66-8d6e-25f82aef8d53 tempest-CreateVolumesFromSnapshotTest-334660388 None] Flow 'volume_create_manager' (4a90fd46-6609-470f-bf4c-6fc025d7d963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:13:10 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-a199b6d1-a994-4f66-8d6e-25f82aef8d53 tempest-CreateVolumesFromSnapshotTest-334660388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfdf1eaf-37ce-4f7f-a803-e8e92d3d36c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:13:10 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b496df7a-57be-4a6b-be8e-7fd13ae5387e]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:13:10 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-4705f3b1-1693-4be8-ad3c-dca9dbf85171 tempest-VolumeDependencyTests-1777202688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-58f8c056-8948-4660-96c8-0707f3e5d923 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:10 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-a199b6d1-a994-4f66-8d6e-25f82aef8d53 tempest-CreateVolumesFromSnapshotTest-334660388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfdf1eaf-37ce-4f7f-a803-e8e92d3d36c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:13:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-774177042',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2df6b7f3-280f-49da-9397-686be2d49387,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fe14878da3f4dd88de9896b21fed7d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:13:10Z,use_quota=True,user_id='53fa3d42dc7c44c6838c9ff0eda8987d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:13:10 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-a199b6d1-a994-4f66-8d6e-25f82aef8d53 tempest-CreateVolumesFromSnapshotTest-334660388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18b412f5-44f4-4866-bdca-458f0f8e1c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:13:10 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-a199b6d1-a994-4f66-8d6e-25f82aef8d53 tempest-CreateVolumesFromSnapshotTest-334660388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18b412f5-44f4-4866-bdca-458f0f8e1c05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:13:10 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-a199b6d1-a994-4f66-8d6e-25f82aef8d53 tempest-CreateVolumesFromSnapshotTest-334660388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43902024-390b-4343-8473-03a6c3894e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:13:10 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-a199b6d1-a994-4f66-8d6e-25f82aef8d53 tempest-CreateVolumesFromSnapshotTest-334660388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43902024-390b-4343-8473-03a6c3894e6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2df6b7f3-280f-49da-9397-686be2d49387', 'volume_name': 'volume-2df6b7f3-280f-49da-9397-686be2d49387', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:13:10 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-a199b6d1-a994-4f66-8d6e-25f82aef8d53 tempest-CreateVolumesFromSnapshotTest-334660388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71f6f696-0e81-4e41-82d7-1833b2c824b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:13:10 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-a199b6d1-a994-4f66-8d6e-25f82aef8d53 tempest-CreateVolumesFromSnapshotTest-334660388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71f6f696-0e81-4e41-82d7-1833b2c824b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:13:10 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-a199b6d1-a994-4f66-8d6e-25f82aef8d53 tempest-CreateVolumesFromSnapshotTest-334660388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a89d8aa0-5d9c-4bf0-b274-eeaec43879be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:13:10 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-a199b6d1-a994-4f66-8d6e-25f82aef8d53 tempest-CreateVolumesFromSnapshotTest-334660388 None] Volume 2df6b7f3-280f-49da-9397-686be2d49387: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2df6b7f3-280f-49da-9397-686be2d49387', 'volume_size': 1}
Jun 15 16:13:10 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-a199b6d1-a994-4f66-8d6e-25f82aef8d53 tempest-CreateVolumesFromSnapshotTest-334660388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:13:10 devstack sudo[111732]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:10 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-731b5ca6-16f6-459d-a603-2664173c36f9 tempest-VolumeDependencyTests-1777202688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.971s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:10 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-731b5ca6-16f6-459d-a603-2664173c36f9 tempest-VolumeDependencyTests-1777202688 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 16:13:10 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-731b5ca6-16f6-459d-a603-2664173c36f9 tempest-VolumeDependencyTests-1777202688 None] Deleted volume successfully.
Jun 15 16:13:10 devstack sudo[111740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-58f8c056-8948-4660-96c8-0707f3e5d923
Jun 15 16:13:10 devstack sudo[111740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:10 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-731b5ca6-16f6-459d-a603-2664173c36f9 tempest-VolumeDependencyTests-1777202688 None] Lock "cinder-fea6610d-d072-42e3-938b-d2e8675ba1ad-delete_volume" released by "delete_volume" :: held 3.097s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:13:10 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-f33b9d75-35b5-46b3-84f8-a9c05b6831aa tempest-CreateVolumesFromSnapshotTest-334660388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 16:13:10 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-f33b9d75-35b5-46b3-84f8-a9c05b6831aa tempest-CreateVolumesFromSnapshotTest-334660388 None] Flow 'volume_create_manager' (8aff4775-a95e-446b-9b10-794b5d202489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:13:10 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-f33b9d75-35b5-46b3-84f8-a9c05b6831aa tempest-CreateVolumesFromSnapshotTest-334660388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ef6f76e-5a1c-41e2-ad29-7c242cf95b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:13:10 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-f33b9d75-35b5-46b3-84f8-a9c05b6831aa tempest-CreateVolumesFromSnapshotTest-334660388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ef6f76e-5a1c-41e2-ad29-7c242cf95b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:13:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1957190548',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5539fab-bf27-42dc-9cf8-7bf510d208e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fe14878da3f4dd88de9896b21fed7d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:13:10Z,use_quota=True,user_id='53fa3d42dc7c44c6838c9ff0eda8987d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:13:10 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-f33b9d75-35b5-46b3-84f8-a9c05b6831aa tempest-CreateVolumesFromSnapshotTest-334660388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e21586cf-af79-46fc-9d7d-df76b492d674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:13:10 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-f33b9d75-35b5-46b3-84f8-a9c05b6831aa tempest-CreateVolumesFromSnapshotTest-334660388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e21586cf-af79-46fc-9d7d-df76b492d674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:13:10 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-f33b9d75-35b5-46b3-84f8-a9c05b6831aa tempest-CreateVolumesFromSnapshotTest-334660388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3ede689-ebcb-452a-abee-8f5138641d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:13:10 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-f33b9d75-35b5-46b3-84f8-a9c05b6831aa tempest-CreateVolumesFromSnapshotTest-334660388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3ede689-ebcb-452a-abee-8f5138641d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5539fab-bf27-42dc-9cf8-7bf510d208e1', 'volume_name': 'volume-b5539fab-bf27-42dc-9cf8-7bf510d208e1', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:13:10 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-f33b9d75-35b5-46b3-84f8-a9c05b6831aa tempest-CreateVolumesFromSnapshotTest-334660388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79c4e4c4-6aa6-4dc5-af84-11f0e1767fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:13:10 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-f33b9d75-35b5-46b3-84f8-a9c05b6831aa tempest-CreateVolumesFromSnapshotTest-334660388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79c4e4c4-6aa6-4dc5-af84-11f0e1767fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:13:10 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-f33b9d75-35b5-46b3-84f8-a9c05b6831aa tempest-CreateVolumesFromSnapshotTest-334660388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (511dbb1e-2316-403b-b387-25811aaf7930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:13:10 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-f33b9d75-35b5-46b3-84f8-a9c05b6831aa tempest-CreateVolumesFromSnapshotTest-334660388 None] Volume b5539fab-bf27-42dc-9cf8-7bf510d208e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5539fab-bf27-42dc-9cf8-7bf510d208e1', 'volume_size': 1}
Jun 15 16:13:10 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-f33b9d75-35b5-46b3-84f8-a9c05b6831aa tempest-CreateVolumesFromSnapshotTest-334660388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:13:10 devstack sudo[111737]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:10 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c891e125-99c3-4956-902a-59b66ea567f1 tempest-CreateVolumesFromSnapshotTest-334660388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-6a4613bb-080d-4f17-b3f2-c028c1c90a13" returned: 0 in 0.776s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:10 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-c891e125-99c3-4956-902a-59b66ea567f1 tempest-CreateVolumesFromSnapshotTest-334660388 None] <== create_volume: return (2107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 16:13:10 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-c891e125-99c3-4956-902a-59b66ea567f1 tempest-CreateVolumesFromSnapshotTest-334660388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.110s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:13:10 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-e68f8112-9503-4c61-a3cd-0ce967a22b1b tempest-CreateVolumesFromSnapshotTest-334660388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.700s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:13:10 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-e68f8112-9503-4c61-a3cd-0ce967a22b1b tempest-CreateVolumesFromSnapshotTest-334660388 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:13:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1986347255',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72048783-d8c0-42f2-ae16-75f560446c5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fe14878da3f4dd88de9896b21fed7d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:13:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:13:09Z,use_quota=True,user_id='53fa3d42dc7c44c6838c9ff0eda8987d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 16:13:10 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-e68f8112-9503-4c61-a3cd-0ce967a22b1b tempest-CreateVolumesFromSnapshotTest-334660388 None] Creating volume 72048783-d8c0-42f2-ae16-75f560446c5f {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 16:13:10 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-e68f8112-9503-4c61-a3cd-0ce967a22b1b tempest-CreateVolumesFromSnapshotTest-334660388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:13:10 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-e68f8112-9503-4c61-a3cd-0ce967a22b1b tempest-CreateVolumesFromSnapshotTest-334660388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:13:10 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-e68f8112-9503-4c61-a3cd-0ce967a22b1b tempest-CreateVolumesFromSnapshotTest-334660388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:13:10 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-e68f8112-9503-4c61-a3cd-0ce967a22b1b tempest-CreateVolumesFromSnapshotTest-334660388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:13:10 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-e68f8112-9503-4c61-a3cd-0ce967a22b1b tempest-CreateVolumesFromSnapshotTest-334660388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:13:10 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-e68f8112-9503-4c61-a3cd-0ce967a22b1b tempest-CreateVolumesFromSnapshotTest-334660388 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 16:13:10 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-e68f8112-9503-4c61-a3cd-0ce967a22b1b tempest-CreateVolumesFromSnapshotTest-334660388 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 16:13:10 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-e68f8112-9503-4c61-a3cd-0ce967a22b1b tempest-CreateVolumesFromSnapshotTest-334660388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-72048783-d8c0-42f2-ae16-75f560446c5f 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:10 devstack sudo[111743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-72048783-d8c0-42f2-ae16-75f560446c5f 1073741824
Jun 15 16:13:10 devstack sudo[111743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:10 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-c891e125-99c3-4956-902a-59b66ea567f1 tempest-CreateVolumesFromSnapshotTest-334660388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9923a36a-4dfd-496b-87f7-e9389cbb564f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a4613bb-080d-4f17-b3f2-c028c1c90a13', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:13:10 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-c891e125-99c3-4956-902a-59b66ea567f1 tempest-CreateVolumesFromSnapshotTest-334660388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bdb6fc9-1812-4622-ba49-6feb07d10b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:13:10 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-c891e125-99c3-4956-902a-59b66ea567f1 tempest-CreateVolumesFromSnapshotTest-334660388 None] Volume volume-6a4613bb-080d-4f17-b3f2-c028c1c90a13 (6a4613bb-080d-4f17-b3f2-c028c1c90a13): created successfully
Jun 15 16:13:10 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-c891e125-99c3-4956-902a-59b66ea567f1 tempest-CreateVolumesFromSnapshotTest-334660388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bdb6fc9-1812-4622-ba49-6feb07d10b30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:13:10 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-c891e125-99c3-4956-902a-59b66ea567f1 tempest-CreateVolumesFromSnapshotTest-334660388 None] Flow 'volume_create_manager' (1841dc3e-33c8-457f-91f4-f90a46f5ea99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:13:10 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-c891e125-99c3-4956-902a-59b66ea567f1 tempest-CreateVolumesFromSnapshotTest-334660388 None] Created volume successfully.
Jun 15 16:13:10 devstack sudo[111740]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:10 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-4705f3b1-1693-4be8-ad3c-dca9dbf85171 tempest-VolumeDependencyTests-1777202688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-58f8c056-8948-4660-96c8-0707f3e5d923" returned: 0 in 0.912s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:10 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-4705f3b1-1693-4be8-ad3c-dca9dbf85171 tempest-VolumeDependencyTests-1777202688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-58f8c056-8948-4660-96c8-0707f3e5d923 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:11 devstack sudo[111748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-58f8c056-8948-4660-96c8-0707f3e5d923
Jun 15 16:13:11 devstack sudo[111748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:11 devstack sudo[111743]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:11 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-e68f8112-9503-4c61-a3cd-0ce967a22b1b tempest-CreateVolumesFromSnapshotTest-334660388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-72048783-d8c0-42f2-ae16-75f560446c5f 1073741824" returned: 0 in 0.843s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:11 devstack sudo[111748]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:11 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-4705f3b1-1693-4be8-ad3c-dca9dbf85171 tempest-VolumeDependencyTests-1777202688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-58f8c056-8948-4660-96c8-0707f3e5d923" returned: 0 in 0.636s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:11 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-e68f8112-9503-4c61-a3cd-0ce967a22b1b tempest-CreateVolumesFromSnapshotTest-334660388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-72048783-d8c0-42f2-ae16-75f560446c5f {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:11 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-4705f3b1-1693-4be8-ad3c-dca9dbf85171 tempest-VolumeDependencyTests-1777202688 None] Lock "cinder-quobyte-58f8c056-8948-4660-96c8-0707f3e5d923" released by "delete_volume" :: held 1.630s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:13:11 devstack sudo[111754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-72048783-d8c0-42f2-ae16-75f560446c5f
Jun 15 16:13:11 devstack sudo[111754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:11 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-4705f3b1-1693-4be8-ad3c-dca9dbf85171 tempest-VolumeDependencyTests-1777202688 None] Created reservations ['690dbc4e-4292-44f1-b377-6b7395cf2d89', 'e746b779-a7ca-4bcb-b0c3-b1e25b07f3ca', 'f8add093-e238-4107-ab25-890371589fe9', 'a96442b7-6859-4d7b-999e-d3ee438ee1fa'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 16:13:11 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-4705f3b1-1693-4be8-ad3c-dca9dbf85171 tempest-VolumeDependencyTests-1777202688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:13:11 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-4705f3b1-1693-4be8-ad3c-dca9dbf85171 tempest-VolumeDependencyTests-1777202688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:13:11 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-4705f3b1-1693-4be8-ad3c-dca9dbf85171 tempest-VolumeDependencyTests-1777202688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:13:11 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-4705f3b1-1693-4be8-ad3c-dca9dbf85171 tempest-VolumeDependencyTests-1777202688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:13:11 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-4705f3b1-1693-4be8-ad3c-dca9dbf85171 tempest-VolumeDependencyTests-1777202688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:13:11 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-4705f3b1-1693-4be8-ad3c-dca9dbf85171 tempest-VolumeDependencyTests-1777202688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:11 devstack sudo[111756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 16:13:11 devstack sudo[111756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:12 devstack sudo[111754]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:12 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-e68f8112-9503-4c61-a3cd-0ce967a22b1b tempest-CreateVolumesFromSnapshotTest-334660388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-72048783-d8c0-42f2-ae16-75f560446c5f" returned: 0 in 0.630s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:12 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-e68f8112-9503-4c61-a3cd-0ce967a22b1b tempest-CreateVolumesFromSnapshotTest-334660388 None] <== create_volume: return (1531ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 16:13:12 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-e68f8112-9503-4c61-a3cd-0ce967a22b1b tempest-CreateVolumesFromSnapshotTest-334660388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.533s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:13:12 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-a0e0ea26-a083-4cf6-bb3d-28fde43b3b07 tempest-CreateVolumesFromSnapshotTest-334660388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.610s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:13:12 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-a0e0ea26-a083-4cf6-bb3d-28fde43b3b07 tempest-CreateVolumesFromSnapshotTest-334660388 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:13:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1532264295',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0540fcb9-fe0d-4b9b-a2aa-d33aeff1bc05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fe14878da3f4dd88de9896b21fed7d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:13:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:13:09Z,use_quota=True,user_id='53fa3d42dc7c44c6838c9ff0eda8987d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 16:13:12 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-a0e0ea26-a083-4cf6-bb3d-28fde43b3b07 tempest-CreateVolumesFromSnapshotTest-334660388 None] Creating volume 0540fcb9-fe0d-4b9b-a2aa-d33aeff1bc05 {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 16:13:12 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-a0e0ea26-a083-4cf6-bb3d-28fde43b3b07 tempest-CreateVolumesFromSnapshotTest-334660388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:13:12 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-a0e0ea26-a083-4cf6-bb3d-28fde43b3b07 tempest-CreateVolumesFromSnapshotTest-334660388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:13:12 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-a0e0ea26-a083-4cf6-bb3d-28fde43b3b07 tempest-CreateVolumesFromSnapshotTest-334660388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:13:12 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-a0e0ea26-a083-4cf6-bb3d-28fde43b3b07 tempest-CreateVolumesFromSnapshotTest-334660388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:13:12 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-a0e0ea26-a083-4cf6-bb3d-28fde43b3b07 tempest-CreateVolumesFromSnapshotTest-334660388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:13:12 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-a0e0ea26-a083-4cf6-bb3d-28fde43b3b07 tempest-CreateVolumesFromSnapshotTest-334660388 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 16:13:12 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-a0e0ea26-a083-4cf6-bb3d-28fde43b3b07 tempest-CreateVolumesFromSnapshotTest-334660388 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 16:13:12 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-a0e0ea26-a083-4cf6-bb3d-28fde43b3b07 tempest-CreateVolumesFromSnapshotTest-334660388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-0540fcb9-fe0d-4b9b-a2aa-d33aeff1bc05 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:12 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e68f8112-9503-4c61-a3cd-0ce967a22b1b tempest-CreateVolumesFromSnapshotTest-334660388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10a623c2-887a-41c5-91f7-542bf4c5da32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72048783-d8c0-42f2-ae16-75f560446c5f', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:13:12 devstack sudo[111759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-0540fcb9-fe0d-4b9b-a2aa-d33aeff1bc05 1073741824
Jun 15 16:13:12 devstack sudo[111759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:12 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e68f8112-9503-4c61-a3cd-0ce967a22b1b tempest-CreateVolumesFromSnapshotTest-334660388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c5c4f1a-282c-448e-bdea-368d85def0e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:13:12 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-e68f8112-9503-4c61-a3cd-0ce967a22b1b tempest-CreateVolumesFromSnapshotTest-334660388 None] Volume volume-72048783-d8c0-42f2-ae16-75f560446c5f (72048783-d8c0-42f2-ae16-75f560446c5f): created successfully
Jun 15 16:13:12 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e68f8112-9503-4c61-a3cd-0ce967a22b1b tempest-CreateVolumesFromSnapshotTest-334660388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c5c4f1a-282c-448e-bdea-368d85def0e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:13:12 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-e68f8112-9503-4c61-a3cd-0ce967a22b1b tempest-CreateVolumesFromSnapshotTest-334660388 None] Flow 'volume_create_manager' (7e799aae-59aa-4c9d-8614-96b887bbb0e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:13:12 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-e68f8112-9503-4c61-a3cd-0ce967a22b1b tempest-CreateVolumesFromSnapshotTest-334660388 None] Created volume successfully.
Jun 15 16:13:12 devstack sudo[111756]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:12 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-4705f3b1-1693-4be8-ad3c-dca9dbf85171 tempest-VolumeDependencyTests-1777202688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.734s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:12 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-4705f3b1-1693-4be8-ad3c-dca9dbf85171 tempest-VolumeDependencyTests-1777202688 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 16:13:12 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-4705f3b1-1693-4be8-ad3c-dca9dbf85171 tempest-VolumeDependencyTests-1777202688 None] Deleted volume successfully.
Jun 15 16:13:12 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-4705f3b1-1693-4be8-ad3c-dca9dbf85171 tempest-VolumeDependencyTests-1777202688 None] Lock "cinder-58f8c056-8948-4660-96c8-0707f3e5d923-delete_volume" released by "delete_volume" :: held 2.661s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:13:13 devstack sudo[111759]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-a0e0ea26-a083-4cf6-bb3d-28fde43b3b07 tempest-CreateVolumesFromSnapshotTest-334660388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-0540fcb9-fe0d-4b9b-a2aa-d33aeff1bc05 1073741824" returned: 0 in 0.928s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-a0e0ea26-a083-4cf6-bb3d-28fde43b3b07 tempest-CreateVolumesFromSnapshotTest-334660388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-0540fcb9-fe0d-4b9b-a2aa-d33aeff1bc05 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:13 devstack sudo[111766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-0540fcb9-fe0d-4b9b-a2aa-d33aeff1bc05
Jun 15 16:13:13 devstack sudo[111766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:13 devstack sudo[111766]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-a0e0ea26-a083-4cf6-bb3d-28fde43b3b07 tempest-CreateVolumesFromSnapshotTest-334660388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-0540fcb9-fe0d-4b9b-a2aa-d33aeff1bc05" returned: 0 in 0.660s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:13 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-a0e0ea26-a083-4cf6-bb3d-28fde43b3b07 tempest-CreateVolumesFromSnapshotTest-334660388 None] <== create_volume: return (1630ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 16:13:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-a0e0ea26-a083-4cf6-bb3d-28fde43b3b07 tempest-CreateVolumesFromSnapshotTest-334660388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.633s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:13:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-0f84c459-8c91-4b2a-969d-33862ec183c8 tempest-SnapshotDependencyTests-1103268421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.946s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:13:13 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-a0e0ea26-a083-4cf6-bb3d-28fde43b3b07 tempest-CreateVolumesFromSnapshotTest-334660388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33dcdcdc-d933-45d9-9ca9-bc92c9a12951) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0540fcb9-fe0d-4b9b-a2aa-d33aeff1bc05', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:13:13 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-a0e0ea26-a083-4cf6-bb3d-28fde43b3b07 tempest-CreateVolumesFromSnapshotTest-334660388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27b9a426-1088-49c4-a608-0041fd349bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:13:13 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-0f84c459-8c91-4b2a-969d-33862ec183c8 tempest-SnapshotDependencyTests-1103268421 None] Creating offline snapshot 458cee47-13b9-4cec-ad2e-383473abbe08 of volume 1742891b-87ce-4deb-8a0e-064e89adbfb4 {{(pid=91863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 15 16:13:13 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-a0e0ea26-a083-4cf6-bb3d-28fde43b3b07 tempest-CreateVolumesFromSnapshotTest-334660388 None] Volume volume-0540fcb9-fe0d-4b9b-a2aa-d33aeff1bc05 (0540fcb9-fe0d-4b9b-a2aa-d33aeff1bc05): created successfully
Jun 15 16:13:13 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-a0e0ea26-a083-4cf6-bb3d-28fde43b3b07 tempest-CreateVolumesFromSnapshotTest-334660388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27b9a426-1088-49c4-a608-0041fd349bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:13:13 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-a0e0ea26-a083-4cf6-bb3d-28fde43b3b07 tempest-CreateVolumesFromSnapshotTest-334660388 None] Flow 'volume_create_manager' (d130004c-b33b-4975-bab5-d67d09997048) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:13:13 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f1900a4-599e-43a1-bb6b-cfd0eb0d42c0]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:13:13 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-0f84c459-8c91-4b2a-969d-33862ec183c8 tempest-SnapshotDependencyTests-1103268421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1742891b-87ce-4deb-8a0e-064e89adbfb4 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:14 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-a0e0ea26-a083-4cf6-bb3d-28fde43b3b07 tempest-CreateVolumesFromSnapshotTest-334660388 None] Created volume successfully.
Jun 15 16:13:14 devstack sudo[111769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1742891b-87ce-4deb-8a0e-064e89adbfb4
Jun 15 16:13:14 devstack sudo[111769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:14 devstack sudo[111769]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:14 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-0f84c459-8c91-4b2a-969d-33862ec183c8 tempest-SnapshotDependencyTests-1103268421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1742891b-87ce-4deb-8a0e-064e89adbfb4" returned: 0 in 0.714s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:14 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-0f84c459-8c91-4b2a-969d-33862ec183c8 tempest-SnapshotDependencyTests-1103268421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1742891b-87ce-4deb-8a0e-064e89adbfb4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1742891b-87ce-4deb-8a0e-064e89adbfb4.458cee47-13b9-4cec-ad2e-383473abbe08 1G {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:14 devstack sudo[111774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1742891b-87ce-4deb-8a0e-064e89adbfb4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1742891b-87ce-4deb-8a0e-064e89adbfb4.458cee47-13b9-4cec-ad2e-383473abbe08 1G
Jun 15 16:13:14 devstack sudo[111774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:15 devstack sudo[111774]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:15 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-0f84c459-8c91-4b2a-969d-33862ec183c8 tempest-SnapshotDependencyTests-1103268421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1742891b-87ce-4deb-8a0e-064e89adbfb4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1742891b-87ce-4deb-8a0e-064e89adbfb4.458cee47-13b9-4cec-ad2e-383473abbe08 1G" returned: 0 in 0.757s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:15 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-0f84c459-8c91-4b2a-969d-33862ec183c8 tempest-SnapshotDependencyTests-1103268421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1742891b-87ce-4deb-8a0e-064e89adbfb4 -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1742891b-87ce-4deb-8a0e-064e89adbfb4.458cee47-13b9-4cec-ad2e-383473abbe08 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:15 devstack sudo[111780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1742891b-87ce-4deb-8a0e-064e89adbfb4 -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1742891b-87ce-4deb-8a0e-064e89adbfb4.458cee47-13b9-4cec-ad2e-383473abbe08
Jun 15 16:13:15 devstack sudo[111780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:16 devstack sudo[111780]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:16 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-0f84c459-8c91-4b2a-969d-33862ec183c8 tempest-SnapshotDependencyTests-1103268421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1742891b-87ce-4deb-8a0e-064e89adbfb4 -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1742891b-87ce-4deb-8a0e-064e89adbfb4.458cee47-13b9-4cec-ad2e-383473abbe08" returned: 0 in 0.683s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:16 devstack cinder-volume[91863]: WARNING cinder.volume.drivers.remotefs [None req-0f84c459-8c91-4b2a-969d-33862ec183c8 tempest-SnapshotDependencyTests-1103268421 None] /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1742891b-87ce-4deb-8a0e-064e89adbfb4.458cee47-13b9-4cec-ad2e-383473abbe08 is being set with open permissions: ugo+rw
Jun 15 16:13:16 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-0f84c459-8c91-4b2a-969d-33862ec183c8 tempest-SnapshotDependencyTests-1103268421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1742891b-87ce-4deb-8a0e-064e89adbfb4.458cee47-13b9-4cec-ad2e-383473abbe08 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:16 devstack sudo[111786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1742891b-87ce-4deb-8a0e-064e89adbfb4.458cee47-13b9-4cec-ad2e-383473abbe08
Jun 15 16:13:16 devstack sudo[111786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:16 devstack sudo[111786]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:16 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-0f84c459-8c91-4b2a-969d-33862ec183c8 tempest-SnapshotDependencyTests-1103268421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1742891b-87ce-4deb-8a0e-064e89adbfb4.458cee47-13b9-4cec-ad2e-383473abbe08" returned: 0 in 0.582s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:16 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-0f84c459-8c91-4b2a-969d-33862ec183c8 tempest-SnapshotDependencyTests-1103268421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1742891b-87ce-4deb-8a0e-064e89adbfb4.info {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:16 devstack sudo[111790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1742891b-87ce-4deb-8a0e-064e89adbfb4.info
Jun 15 16:13:16 devstack sudo[111790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:17 devstack sudo[111790]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:17 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-0f84c459-8c91-4b2a-969d-33862ec183c8 tempest-SnapshotDependencyTests-1103268421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1742891b-87ce-4deb-8a0e-064e89adbfb4.info" returned: 0 in 0.573s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:17 devstack cinder-volume[91863]: WARNING cinder.volume.drivers.remotefs [None req-0f84c459-8c91-4b2a-969d-33862ec183c8 tempest-SnapshotDependencyTests-1103268421 None] /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1742891b-87ce-4deb-8a0e-064e89adbfb4.info is being set with open permissions: ugo+rw
Jun 15 16:13:17 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-0f84c459-8c91-4b2a-969d-33862ec183c8 tempest-SnapshotDependencyTests-1103268421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1742891b-87ce-4deb-8a0e-064e89adbfb4.info {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:17 devstack sudo[111793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1742891b-87ce-4deb-8a0e-064e89adbfb4.info
Jun 15 16:13:17 devstack sudo[111793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:17 devstack sudo[111793]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:17 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-0f84c459-8c91-4b2a-969d-33862ec183c8 tempest-SnapshotDependencyTests-1103268421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1742891b-87ce-4deb-8a0e-064e89adbfb4.info" returned: 0 in 0.599s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:17 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-0f84c459-8c91-4b2a-969d-33862ec183c8 tempest-SnapshotDependencyTests-1103268421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.039s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:13:17 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-a199b6d1-a994-4f66-8d6e-25f82aef8d53 tempest-CreateVolumesFromSnapshotTest-334660388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.799s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:13:17 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-a199b6d1-a994-4f66-8d6e-25f82aef8d53 tempest-CreateVolumesFromSnapshotTest-334660388 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:13:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-774177042',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2df6b7f3-280f-49da-9397-686be2d49387,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fe14878da3f4dd88de9896b21fed7d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:13:10Z,use_quota=True,user_id='53fa3d42dc7c44c6838c9ff0eda8987d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 16:13:17 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-a199b6d1-a994-4f66-8d6e-25f82aef8d53 tempest-CreateVolumesFromSnapshotTest-334660388 None] Creating volume 2df6b7f3-280f-49da-9397-686be2d49387 {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 16:13:17 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-a199b6d1-a994-4f66-8d6e-25f82aef8d53 tempest-CreateVolumesFromSnapshotTest-334660388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:13:17 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-a199b6d1-a994-4f66-8d6e-25f82aef8d53 tempest-CreateVolumesFromSnapshotTest-334660388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:13:17 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-a199b6d1-a994-4f66-8d6e-25f82aef8d53 tempest-CreateVolumesFromSnapshotTest-334660388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:13:17 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-a199b6d1-a994-4f66-8d6e-25f82aef8d53 tempest-CreateVolumesFromSnapshotTest-334660388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:13:17 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-a199b6d1-a994-4f66-8d6e-25f82aef8d53 tempest-CreateVolumesFromSnapshotTest-334660388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:13:17 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-a199b6d1-a994-4f66-8d6e-25f82aef8d53 tempest-CreateVolumesFromSnapshotTest-334660388 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 16:13:17 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-a199b6d1-a994-4f66-8d6e-25f82aef8d53 tempest-CreateVolumesFromSnapshotTest-334660388 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 16:13:17 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-a199b6d1-a994-4f66-8d6e-25f82aef8d53 tempest-CreateVolumesFromSnapshotTest-334660388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2df6b7f3-280f-49da-9397-686be2d49387 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:17 devstack sudo[111796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2df6b7f3-280f-49da-9397-686be2d49387 1073741824
Jun 15 16:13:17 devstack sudo[111796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:17 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-0f84c459-8c91-4b2a-969d-33862ec183c8 tempest-SnapshotDependencyTests-1103268421 None] Create snapshot completed successfully
Jun 15 16:13:18 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-93419a00-d61b-41c6-8e62-f82f5e9b2e51 tempest-SnapshotDependencyTests-1103268421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 16:13:18 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-93419a00-d61b-41c6-8e62-f82f5e9b2e51 tempest-SnapshotDependencyTests-1103268421 None] Flow 'volume_create_manager' (260915a3-fea4-49b9-a0e6-d7a36b59b4f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:13:18 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-93419a00-d61b-41c6-8e62-f82f5e9b2e51 tempest-SnapshotDependencyTests-1103268421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5a1d92d-1b00-44d7-ba50-54c142443cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:13:18 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-93419a00-d61b-41c6-8e62-f82f5e9b2e51 tempest-SnapshotDependencyTests-1103268421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5a1d92d-1b00-44d7-ba50-54c142443cb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:13:18Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0222940f-fa8f-476a-9817-1c899a439145,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d50bd19fa99742668f849bcf1e44adc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:13:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=458cee47-13b9-4cec-ad2e-383473abbe08,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:13:19Z,use_quota=True,user_id='959f0942cd4a47f99e9bd18c0eb356a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:13:18 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-93419a00-d61b-41c6-8e62-f82f5e9b2e51 tempest-SnapshotDependencyTests-1103268421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfed9bf1-5f59-4da1-8fef-671fc522952b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:13:18 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-93419a00-d61b-41c6-8e62-f82f5e9b2e51 tempest-SnapshotDependencyTests-1103268421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfed9bf1-5f59-4da1-8fef-671fc522952b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:13:18 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-93419a00-d61b-41c6-8e62-f82f5e9b2e51 tempest-SnapshotDependencyTests-1103268421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6cfaf7c-f877-4b75-aa41-04e5f7b1f0c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:13:18 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-93419a00-d61b-41c6-8e62-f82f5e9b2e51 tempest-SnapshotDependencyTests-1103268421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6cfaf7c-f877-4b75-aa41-04e5f7b1f0c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0222940f-fa8f-476a-9817-1c899a439145', 'volume_name': 'volume-0222940f-fa8f-476a-9817-1c899a439145', 'volume_size': 1, 'snapshot_id': '458cee47-13b9-4cec-ad2e-383473abbe08'}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:13:18 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-93419a00-d61b-41c6-8e62-f82f5e9b2e51 tempest-SnapshotDependencyTests-1103268421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff3787d9-0ee8-4ca1-a172-e9ebd60ab523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:13:18 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-93419a00-d61b-41c6-8e62-f82f5e9b2e51 tempest-SnapshotDependencyTests-1103268421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff3787d9-0ee8-4ca1-a172-e9ebd60ab523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:13:18 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-93419a00-d61b-41c6-8e62-f82f5e9b2e51 tempest-SnapshotDependencyTests-1103268421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (298bd373-3ec1-440f-ae6c-86be6b0c03dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:13:18 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-93419a00-d61b-41c6-8e62-f82f5e9b2e51 tempest-SnapshotDependencyTests-1103268421 None] Volume 0222940f-fa8f-476a-9817-1c899a439145: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0222940f-fa8f-476a-9817-1c899a439145', 'volume_size': 1, 'snapshot_id': '458cee47-13b9-4cec-ad2e-383473abbe08'}
Jun 15 16:13:18 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-93419a00-d61b-41c6-8e62-f82f5e9b2e51 tempest-SnapshotDependencyTests-1103268421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:13:18 devstack sudo[111796]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:18 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-a199b6d1-a994-4f66-8d6e-25f82aef8d53 tempest-CreateVolumesFromSnapshotTest-334660388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2df6b7f3-280f-49da-9397-686be2d49387 1073741824" returned: 0 in 0.907s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:18 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-a199b6d1-a994-4f66-8d6e-25f82aef8d53 tempest-CreateVolumesFromSnapshotTest-334660388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2df6b7f3-280f-49da-9397-686be2d49387 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:18 devstack sudo[111801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2df6b7f3-280f-49da-9397-686be2d49387
Jun 15 16:13:18 devstack sudo[111801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:19 devstack sudo[111801]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:19 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-a199b6d1-a994-4f66-8d6e-25f82aef8d53 tempest-CreateVolumesFromSnapshotTest-334660388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2df6b7f3-280f-49da-9397-686be2d49387" returned: 0 in 0.587s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:19 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-a199b6d1-a994-4f66-8d6e-25f82aef8d53 tempest-CreateVolumesFromSnapshotTest-334660388 None] <== create_volume: return (1528ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 16:13:19 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-a199b6d1-a994-4f66-8d6e-25f82aef8d53 tempest-CreateVolumesFromSnapshotTest-334660388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.531s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:13:19 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-f33b9d75-35b5-46b3-84f8-a9c05b6831aa tempest-CreateVolumesFromSnapshotTest-334660388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.956s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:13:19 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-f33b9d75-35b5-46b3-84f8-a9c05b6831aa tempest-CreateVolumesFromSnapshotTest-334660388 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:13:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1957190548',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5539fab-bf27-42dc-9cf8-7bf510d208e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fe14878da3f4dd88de9896b21fed7d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:13:10Z,use_quota=True,user_id='53fa3d42dc7c44c6838c9ff0eda8987d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 16:13:19 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-f33b9d75-35b5-46b3-84f8-a9c05b6831aa tempest-CreateVolumesFromSnapshotTest-334660388 None] Creating volume b5539fab-bf27-42dc-9cf8-7bf510d208e1 {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 16:13:19 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-f33b9d75-35b5-46b3-84f8-a9c05b6831aa tempest-CreateVolumesFromSnapshotTest-334660388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:13:19 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-f33b9d75-35b5-46b3-84f8-a9c05b6831aa tempest-CreateVolumesFromSnapshotTest-334660388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:13:19 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-f33b9d75-35b5-46b3-84f8-a9c05b6831aa tempest-CreateVolumesFromSnapshotTest-334660388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:13:19 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-f33b9d75-35b5-46b3-84f8-a9c05b6831aa tempest-CreateVolumesFromSnapshotTest-334660388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:13:19 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-f33b9d75-35b5-46b3-84f8-a9c05b6831aa tempest-CreateVolumesFromSnapshotTest-334660388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:13:19 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-f33b9d75-35b5-46b3-84f8-a9c05b6831aa tempest-CreateVolumesFromSnapshotTest-334660388 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 16:13:19 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-f33b9d75-35b5-46b3-84f8-a9c05b6831aa tempest-CreateVolumesFromSnapshotTest-334660388 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 16:13:19 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-f33b9d75-35b5-46b3-84f8-a9c05b6831aa tempest-CreateVolumesFromSnapshotTest-334660388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b5539fab-bf27-42dc-9cf8-7bf510d208e1 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:19 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-a199b6d1-a994-4f66-8d6e-25f82aef8d53 tempest-CreateVolumesFromSnapshotTest-334660388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a89d8aa0-5d9c-4bf0-b274-eeaec43879be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2df6b7f3-280f-49da-9397-686be2d49387', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:13:19 devstack sudo[111804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b5539fab-bf27-42dc-9cf8-7bf510d208e1 1073741824
Jun 15 16:13:19 devstack sudo[111804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:19 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-a199b6d1-a994-4f66-8d6e-25f82aef8d53 tempest-CreateVolumesFromSnapshotTest-334660388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c372ed35-9b65-4db9-a67e-24cea76d43e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:13:19 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-a199b6d1-a994-4f66-8d6e-25f82aef8d53 tempest-CreateVolumesFromSnapshotTest-334660388 None] Volume volume-2df6b7f3-280f-49da-9397-686be2d49387 (2df6b7f3-280f-49da-9397-686be2d49387): created successfully
Jun 15 16:13:19 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-a199b6d1-a994-4f66-8d6e-25f82aef8d53 tempest-CreateVolumesFromSnapshotTest-334660388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c372ed35-9b65-4db9-a67e-24cea76d43e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:13:19 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-a199b6d1-a994-4f66-8d6e-25f82aef8d53 tempest-CreateVolumesFromSnapshotTest-334660388 None] Flow 'volume_create_manager' (4a90fd46-6609-470f-bf4c-6fc025d7d963) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:13:19 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-a199b6d1-a994-4f66-8d6e-25f82aef8d53 tempest-CreateVolumesFromSnapshotTest-334660388 None] Created volume successfully.
Jun 15 16:13:20 devstack sudo[111804]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:20 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-f33b9d75-35b5-46b3-84f8-a9c05b6831aa tempest-CreateVolumesFromSnapshotTest-334660388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b5539fab-bf27-42dc-9cf8-7bf510d208e1 1073741824" returned: 0 in 0.754s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:20 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-f33b9d75-35b5-46b3-84f8-a9c05b6831aa tempest-CreateVolumesFromSnapshotTest-334660388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b5539fab-bf27-42dc-9cf8-7bf510d208e1 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:20 devstack sudo[111810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b5539fab-bf27-42dc-9cf8-7bf510d208e1
Jun 15 16:13:20 devstack sudo[111810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:20 devstack sudo[111810]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:20 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-f33b9d75-35b5-46b3-84f8-a9c05b6831aa tempest-CreateVolumesFromSnapshotTest-334660388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b5539fab-bf27-42dc-9cf8-7bf510d208e1" returned: 0 in 0.633s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:20 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-f33b9d75-35b5-46b3-84f8-a9c05b6831aa tempest-CreateVolumesFromSnapshotTest-334660388 None] <== create_volume: return (1429ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 16:13:20 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-f33b9d75-35b5-46b3-84f8-a9c05b6831aa tempest-CreateVolumesFromSnapshotTest-334660388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.433s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:13:20 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-93419a00-d61b-41c6-8e62-f82f5e9b2e51 tempest-SnapshotDependencyTests-1103268421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.092s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:13:20 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-93419a00-d61b-41c6-8e62-f82f5e9b2e51 tempest-SnapshotDependencyTests-1103268421 None] Acquiring lock "cinder-quobyte-458cee47-13b9-4cec-ad2e-383473abbe08-0222940f-fa8f-476a-9817-1c899a439145" by "_create_volume_from_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:13:20 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-f33b9d75-35b5-46b3-84f8-a9c05b6831aa tempest-CreateVolumesFromSnapshotTest-334660388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (511dbb1e-2316-403b-b387-25811aaf7930) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5539fab-bf27-42dc-9cf8-7bf510d208e1', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:13:20 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-f33b9d75-35b5-46b3-84f8-a9c05b6831aa tempest-CreateVolumesFromSnapshotTest-334660388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f150174a-556f-4413-a23d-bd856c5c8492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:13:20 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-93419a00-d61b-41c6-8e62-f82f5e9b2e51 tempest-SnapshotDependencyTests-1103268421 None] Lock "cinder-quobyte-458cee47-13b9-4cec-ad2e-383473abbe08-0222940f-fa8f-476a-9817-1c899a439145" acquired by "_create_volume_from_snapshot" :: waited 0.041s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:13:20 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-93419a00-d61b-41c6-8e62-f82f5e9b2e51 tempest-SnapshotDependencyTests-1103268421 None] Creating volume 0222940f-fa8f-476a-9817-1c899a439145 from snapshot 458cee47-13b9-4cec-ad2e-383473abbe08 {{(pid=91863) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 15 16:13:20 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-93419a00-d61b-41c6-8e62-f82f5e9b2e51 tempest-SnapshotDependencyTests-1103268421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:13:20 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-93419a00-d61b-41c6-8e62-f82f5e9b2e51 tempest-SnapshotDependencyTests-1103268421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:13:20 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-93419a00-d61b-41c6-8e62-f82f5e9b2e51 tempest-SnapshotDependencyTests-1103268421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:13:20 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-93419a00-d61b-41c6-8e62-f82f5e9b2e51 tempest-SnapshotDependencyTests-1103268421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:13:20 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-93419a00-d61b-41c6-8e62-f82f5e9b2e51 tempest-SnapshotDependencyTests-1103268421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:13:20 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-93419a00-d61b-41c6-8e62-f82f5e9b2e51 tempest-SnapshotDependencyTests-1103268421 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 16:13:20 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-93419a00-d61b-41c6-8e62-f82f5e9b2e51 tempest-SnapshotDependencyTests-1103268421 None] Acquiring lock "cinder-quobyte-0222940f-fa8f-476a-9817-1c899a439145" by "_copy_volume_from_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:13:20 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-f33b9d75-35b5-46b3-84f8-a9c05b6831aa tempest-CreateVolumesFromSnapshotTest-334660388 None] Volume volume-b5539fab-bf27-42dc-9cf8-7bf510d208e1 (b5539fab-bf27-42dc-9cf8-7bf510d208e1): created successfully
Jun 15 16:13:20 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-f33b9d75-35b5-46b3-84f8-a9c05b6831aa tempest-CreateVolumesFromSnapshotTest-334660388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f150174a-556f-4413-a23d-bd856c5c8492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:13:20 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-f33b9d75-35b5-46b3-84f8-a9c05b6831aa tempest-CreateVolumesFromSnapshotTest-334660388 None] Flow 'volume_create_manager' (8aff4775-a95e-446b-9b10-794b5d202489) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:13:21 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-93419a00-d61b-41c6-8e62-f82f5e9b2e51 tempest-SnapshotDependencyTests-1103268421 None] Lock "cinder-quobyte-0222940f-fa8f-476a-9817-1c899a439145" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:13:21 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-93419a00-d61b-41c6-8e62-f82f5e9b2e51 tempest-SnapshotDependencyTests-1103268421 None] snapshot: 458cee47-13b9-4cec-ad2e-383473abbe08, volume: 0222940f-fa8f-476a-9817-1c899a439145,  {{(pid=91863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 15 16:13:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-93419a00-d61b-41c6-8e62-f82f5e9b2e51 tempest-SnapshotDependencyTests-1103268421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:13:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-93419a00-d61b-41c6-8e62-f82f5e9b2e51 tempest-SnapshotDependencyTests-1103268421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:13:21 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-93419a00-d61b-41c6-8e62-f82f5e9b2e51 tempest-SnapshotDependencyTests-1103268421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:13:21 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-93419a00-d61b-41c6-8e62-f82f5e9b2e51 tempest-SnapshotDependencyTests-1103268421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:13:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-93419a00-d61b-41c6-8e62-f82f5e9b2e51 tempest-SnapshotDependencyTests-1103268421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:13:21 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-f33b9d75-35b5-46b3-84f8-a9c05b6831aa tempest-CreateVolumesFromSnapshotTest-334660388 None] Created volume successfully.
Jun 15 16:13:21 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f2e342d-0806-4ae3-bd72-8fd149926aff]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:13:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-93419a00-d61b-41c6-8e62-f82f5e9b2e51 tempest-SnapshotDependencyTests-1103268421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1742891b-87ce-4deb-8a0e-064e89adbfb4.458cee47-13b9-4cec-ad2e-383473abbe08 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:21 devstack sudo[111814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1742891b-87ce-4deb-8a0e-064e89adbfb4.458cee47-13b9-4cec-ad2e-383473abbe08
Jun 15 16:13:21 devstack sudo[111814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:21 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-d5562dcd-37c2-4d25-8f53-8cd71a280f11 tempest-CreateVolumesFromSnapshotTest-334660388 None] Acquiring lock "cinder-b5539fab-bf27-42dc-9cf8-7bf510d208e1-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:13:21 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-d5562dcd-37c2-4d25-8f53-8cd71a280f11 tempest-CreateVolumesFromSnapshotTest-334660388 None] Lock "cinder-b5539fab-bf27-42dc-9cf8-7bf510d208e1-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:13:21 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-d5562dcd-37c2-4d25-8f53-8cd71a280f11 tempest-CreateVolumesFromSnapshotTest-334660388 None] Acquiring lock "cinder-quobyte-b5539fab-bf27-42dc-9cf8-7bf510d208e1" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:13:21 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-d5562dcd-37c2-4d25-8f53-8cd71a280f11 tempest-CreateVolumesFromSnapshotTest-334660388 None] Lock "cinder-quobyte-b5539fab-bf27-42dc-9cf8-7bf510d208e1" acquired by "delete_volume" :: waited 0.019s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:13:21 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef6cb4d-dfd6-4eb6-8a4c-a674c74ba1bf]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:13:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-d5562dcd-37c2-4d25-8f53-8cd71a280f11 tempest-CreateVolumesFromSnapshotTest-334660388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b5539fab-bf27-42dc-9cf8-7bf510d208e1 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:21 devstack sudo[111816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b5539fab-bf27-42dc-9cf8-7bf510d208e1
Jun 15 16:13:21 devstack sudo[111816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:21 devstack sudo[111814]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-93419a00-d61b-41c6-8e62-f82f5e9b2e51 tempest-SnapshotDependencyTests-1103268421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1742891b-87ce-4deb-8a0e-064e89adbfb4.458cee47-13b9-4cec-ad2e-383473abbe08" returned: 0 in 0.795s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:21 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-93419a00-d61b-41c6-8e62-f82f5e9b2e51 tempest-SnapshotDependencyTests-1103268421 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1742891b-87ce-4deb-8a0e-064e89adbfb4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 16:13:21 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-93419a00-d61b-41c6-8e62-f82f5e9b2e51 tempest-SnapshotDependencyTests-1103268421 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1742891b-87ce-4deb-8a0e-064e89adbfb4 {{(pid=91863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 15 16:13:21 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-93419a00-d61b-41c6-8e62-f82f5e9b2e51 tempest-SnapshotDependencyTests-1103268421 None] Creating direct copy from snapshot {{(pid=91863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 15 16:13:21 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e446a6b-28c0-4f98-bcdb-7c6d60cd71d7]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:13:21 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-93419a00-d61b-41c6-8e62-f82f5e9b2e51 tempest-SnapshotDependencyTests-1103268421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1742891b-87ce-4deb-8a0e-064e89adbfb4 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:21 devstack sudo[111821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1742891b-87ce-4deb-8a0e-064e89adbfb4
Jun 15 16:13:21 devstack sudo[111821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:22 devstack sudo[111816]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:22 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-d5562dcd-37c2-4d25-8f53-8cd71a280f11 tempest-CreateVolumesFromSnapshotTest-334660388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b5539fab-bf27-42dc-9cf8-7bf510d208e1" returned: 0 in 0.785s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:22 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-d5562dcd-37c2-4d25-8f53-8cd71a280f11 tempest-CreateVolumesFromSnapshotTest-334660388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b5539fab-bf27-42dc-9cf8-7bf510d208e1 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:22 devstack sudo[111826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b5539fab-bf27-42dc-9cf8-7bf510d208e1
Jun 15 16:13:22 devstack sudo[111826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:22 devstack sudo[111821]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:22 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-93419a00-d61b-41c6-8e62-f82f5e9b2e51 tempest-SnapshotDependencyTests-1103268421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1742891b-87ce-4deb-8a0e-064e89adbfb4" returned: 0 in 0.750s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:22 devstack cinder-volume[91863]: DEBUG cinder.utils [None req-93419a00-d61b-41c6-8e62-f82f5e9b2e51 tempest-SnapshotDependencyTests-1103268421 None] Path /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-0222940f-fa8f-476a-9817-1c899a439145 not found in is_blk_device check {{(pid=91863) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 15 16:13:22 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-93419a00-d61b-41c6-8e62-f82f5e9b2e51 tempest-SnapshotDependencyTests-1103268421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1742891b-87ce-4deb-8a0e-064e89adbfb4 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-0222940f-fa8f-476a-9817-1c899a439145 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:22 devstack sudo[111831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1742891b-87ce-4deb-8a0e-064e89adbfb4 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-0222940f-fa8f-476a-9817-1c899a439145
Jun 15 16:13:22 devstack sudo[111831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:23 devstack sudo[111826]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:23 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-d5562dcd-37c2-4d25-8f53-8cd71a280f11 tempest-CreateVolumesFromSnapshotTest-334660388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-b5539fab-bf27-42dc-9cf8-7bf510d208e1" returned: 0 in 0.672s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:23 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-d5562dcd-37c2-4d25-8f53-8cd71a280f11 tempest-CreateVolumesFromSnapshotTest-334660388 None] Lock "cinder-quobyte-b5539fab-bf27-42dc-9cf8-7bf510d208e1" released by "delete_volume" :: held 1.504s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:13:23 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-d5562dcd-37c2-4d25-8f53-8cd71a280f11 tempest-CreateVolumesFromSnapshotTest-334660388 None] Created reservations ['1f41f1fd-b816-427e-a2ba-45a4ce205132', 'f9223512-37ce-427e-b3e3-50b475cb2962', '70bf3eea-f0c4-47fd-bd0e-c1a98358d3ea', 'daee77cb-b9a2-4eeb-b99a-28e786e625b1'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 16:13:23 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-d5562dcd-37c2-4d25-8f53-8cd71a280f11 tempest-CreateVolumesFromSnapshotTest-334660388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:13:23 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-d5562dcd-37c2-4d25-8f53-8cd71a280f11 tempest-CreateVolumesFromSnapshotTest-334660388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:13:23 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-d5562dcd-37c2-4d25-8f53-8cd71a280f11 tempest-CreateVolumesFromSnapshotTest-334660388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:13:23 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-d5562dcd-37c2-4d25-8f53-8cd71a280f11 tempest-CreateVolumesFromSnapshotTest-334660388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:13:23 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-d5562dcd-37c2-4d25-8f53-8cd71a280f11 tempest-CreateVolumesFromSnapshotTest-334660388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:13:23 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-d5562dcd-37c2-4d25-8f53-8cd71a280f11 tempest-CreateVolumesFromSnapshotTest-334660388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:23 devstack sudo[111837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 16:13:23 devstack sudo[111837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:23 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-fab12165-e0b7-4f2c-9796-f364c625dc62 tempest-CreateVolumesFromSnapshotTest-334660388 None] Acquiring lock "cinder-2df6b7f3-280f-49da-9397-686be2d49387-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:13:23 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-fab12165-e0b7-4f2c-9796-f364c625dc62 tempest-CreateVolumesFromSnapshotTest-334660388 None] Lock "cinder-2df6b7f3-280f-49da-9397-686be2d49387-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:13:24 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-fab12165-e0b7-4f2c-9796-f364c625dc62 tempest-CreateVolumesFromSnapshotTest-334660388 None] Acquiring lock "cinder-quobyte-2df6b7f3-280f-49da-9397-686be2d49387" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:13:24 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-fab12165-e0b7-4f2c-9796-f364c625dc62 tempest-CreateVolumesFromSnapshotTest-334660388 None] Lock "cinder-quobyte-2df6b7f3-280f-49da-9397-686be2d49387" acquired by "delete_volume" :: waited 0.027s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:13:24 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[da7e4114-01ab-4752-93c4-f6b52334de36]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:13:24 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-fab12165-e0b7-4f2c-9796-f364c625dc62 tempest-CreateVolumesFromSnapshotTest-334660388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2df6b7f3-280f-49da-9397-686be2d49387 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:24 devstack sudo[111837]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:24 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-d5562dcd-37c2-4d25-8f53-8cd71a280f11 tempest-CreateVolumesFromSnapshotTest-334660388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 1.189s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:24 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-d5562dcd-37c2-4d25-8f53-8cd71a280f11 tempest-CreateVolumesFromSnapshotTest-334660388 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 16:13:24 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-d5562dcd-37c2-4d25-8f53-8cd71a280f11 tempest-CreateVolumesFromSnapshotTest-334660388 None] Deleted volume successfully.
Jun 15 16:13:24 devstack sudo[111846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2df6b7f3-280f-49da-9397-686be2d49387
Jun 15 16:13:24 devstack sudo[111846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:24 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-d5562dcd-37c2-4d25-8f53-8cd71a280f11 tempest-CreateVolumesFromSnapshotTest-334660388 None] Lock "cinder-b5539fab-bf27-42dc-9cf8-7bf510d208e1-delete_volume" released by "delete_volume" :: held 2.951s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:13:25 devstack sudo[111846]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:25 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-fab12165-e0b7-4f2c-9796-f364c625dc62 tempest-CreateVolumesFromSnapshotTest-334660388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2df6b7f3-280f-49da-9397-686be2d49387" returned: 0 in 1.503s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:25 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-fab12165-e0b7-4f2c-9796-f364c625dc62 tempest-CreateVolumesFromSnapshotTest-334660388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2df6b7f3-280f-49da-9397-686be2d49387 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:25 devstack sudo[111859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2df6b7f3-280f-49da-9397-686be2d49387
Jun 15 16:13:25 devstack sudo[111859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:26 devstack sudo[111859]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:26 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-fab12165-e0b7-4f2c-9796-f364c625dc62 tempest-CreateVolumesFromSnapshotTest-334660388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-2df6b7f3-280f-49da-9397-686be2d49387" returned: 0 in 1.169s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:26 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-fab12165-e0b7-4f2c-9796-f364c625dc62 tempest-CreateVolumesFromSnapshotTest-334660388 None] Lock "cinder-quobyte-2df6b7f3-280f-49da-9397-686be2d49387" released by "delete_volume" :: held 2.773s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:13:26 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-fab12165-e0b7-4f2c-9796-f364c625dc62 tempest-CreateVolumesFromSnapshotTest-334660388 None] Created reservations ['0f5cbcc2-cfbb-477a-8415-95cd2538794b', 'ef1bc00e-4e91-4def-89e7-c572c03fa1ea', 'b0c3fa3c-4934-4cbd-b827-2599ee714d1c', '3b2a6c59-41eb-4f50-873c-21aee013e47b'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 16:13:27 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-fab12165-e0b7-4f2c-9796-f364c625dc62 tempest-CreateVolumesFromSnapshotTest-334660388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:13:27 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-fab12165-e0b7-4f2c-9796-f364c625dc62 tempest-CreateVolumesFromSnapshotTest-334660388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:13:27 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-fab12165-e0b7-4f2c-9796-f364c625dc62 tempest-CreateVolumesFromSnapshotTest-334660388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:13:27 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-fab12165-e0b7-4f2c-9796-f364c625dc62 tempest-CreateVolumesFromSnapshotTest-334660388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:13:27 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-fab12165-e0b7-4f2c-9796-f364c625dc62 tempest-CreateVolumesFromSnapshotTest-334660388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:13:27 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-fab12165-e0b7-4f2c-9796-f364c625dc62 tempest-CreateVolumesFromSnapshotTest-334660388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:27 devstack sudo[111862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 16:13:27 devstack sudo[111862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:27 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-254cffcc-a0ac-4570-967f-24a1d037034a tempest-CreateVolumesFromSnapshotTest-334660388 None] Acquiring lock "cinder-0540fcb9-fe0d-4b9b-a2aa-d33aeff1bc05-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:13:27 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-254cffcc-a0ac-4570-967f-24a1d037034a tempest-CreateVolumesFromSnapshotTest-334660388 None] Lock "cinder-0540fcb9-fe0d-4b9b-a2aa-d33aeff1bc05-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:13:27 devstack sudo[111862]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:27 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-fab12165-e0b7-4f2c-9796-f364c625dc62 tempest-CreateVolumesFromSnapshotTest-334660388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.812s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:27 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-fab12165-e0b7-4f2c-9796-f364c625dc62 tempest-CreateVolumesFromSnapshotTest-334660388 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 16:13:27 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-254cffcc-a0ac-4570-967f-24a1d037034a tempest-CreateVolumesFromSnapshotTest-334660388 None] Acquiring lock "cinder-quobyte-0540fcb9-fe0d-4b9b-a2aa-d33aeff1bc05" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:13:27 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-fab12165-e0b7-4f2c-9796-f364c625dc62 tempest-CreateVolumesFromSnapshotTest-334660388 None] Deleted volume successfully.
Jun 15 16:13:27 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-254cffcc-a0ac-4570-967f-24a1d037034a tempest-CreateVolumesFromSnapshotTest-334660388 None] Lock "cinder-quobyte-0540fcb9-fe0d-4b9b-a2aa-d33aeff1bc05" acquired by "delete_volume" :: waited 0.021s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:13:27 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-fab12165-e0b7-4f2c-9796-f364c625dc62 tempest-CreateVolumesFromSnapshotTest-334660388 None] Lock "cinder-2df6b7f3-280f-49da-9397-686be2d49387-delete_volume" released by "delete_volume" :: held 4.003s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:13:27 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffa9ae26-f19f-4f4a-970e-b2c7cf20022c]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:13:27 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-254cffcc-a0ac-4570-967f-24a1d037034a tempest-CreateVolumesFromSnapshotTest-334660388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-0540fcb9-fe0d-4b9b-a2aa-d33aeff1bc05 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:28 devstack sudo[111831]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:28 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-93419a00-d61b-41c6-8e62-f82f5e9b2e51 tempest-SnapshotDependencyTests-1103268421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1742891b-87ce-4deb-8a0e-064e89adbfb4 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-0222940f-fa8f-476a-9817-1c899a439145" returned: 0 in 5.393s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:28 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba3a22b5-772e-40e4-be7d-ba3ea2540f92]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:13:28 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-93419a00-d61b-41c6-8e62-f82f5e9b2e51 tempest-SnapshotDependencyTests-1103268421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1742891b-87ce-4deb-8a0e-064e89adbfb4 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:28 devstack sudo[111866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-0540fcb9-fe0d-4b9b-a2aa-d33aeff1bc05
Jun 15 16:13:28 devstack sudo[111866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:28 devstack sudo[111867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1742891b-87ce-4deb-8a0e-064e89adbfb4
Jun 15 16:13:28 devstack sudo[111867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:28 devstack sudo[111866]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:28 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-254cffcc-a0ac-4570-967f-24a1d037034a tempest-CreateVolumesFromSnapshotTest-334660388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-0540fcb9-fe0d-4b9b-a2aa-d33aeff1bc05" returned: 0 in 0.725s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:28 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-254cffcc-a0ac-4570-967f-24a1d037034a tempest-CreateVolumesFromSnapshotTest-334660388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-0540fcb9-fe0d-4b9b-a2aa-d33aeff1bc05 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:28 devstack sudo[111875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-0540fcb9-fe0d-4b9b-a2aa-d33aeff1bc05
Jun 15 16:13:28 devstack sudo[111875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:28 devstack sudo[111867]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:28 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-93419a00-d61b-41c6-8e62-f82f5e9b2e51 tempest-SnapshotDependencyTests-1103268421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1742891b-87ce-4deb-8a0e-064e89adbfb4" returned: 0 in 0.877s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:28 devstack cinder-volume[91863]: DEBUG cinder.image.image_utils [None req-93419a00-d61b-41c6-8e62-f82f5e9b2e51 tempest-SnapshotDependencyTests-1103268421 None] Image conversion details: src /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1742891b-87ce-4deb-8a0e-064e89adbfb4, size 1024.00 MB, duration 5.39 sec, destination /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-0222940f-fa8f-476a-9817-1c899a439145 {{(pid=91863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 15 16:13:28 devstack cinder-volume[91863]: INFO cinder.image.image_utils [None req-93419a00-d61b-41c6-8e62-f82f5e9b2e51 tempest-SnapshotDependencyTests-1103268421 None] Converted 1024.00 MB image at 189.84 MB/s
Jun 15 16:13:28 devstack cinder-volume[91863]: WARNING cinder.volume.drivers.remotefs [None req-93419a00-d61b-41c6-8e62-f82f5e9b2e51 tempest-SnapshotDependencyTests-1103268421 None] /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-0222940f-fa8f-476a-9817-1c899a439145 is being set with open permissions: ugo+rw
Jun 15 16:13:28 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-93419a00-d61b-41c6-8e62-f82f5e9b2e51 tempest-SnapshotDependencyTests-1103268421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-0222940f-fa8f-476a-9817-1c899a439145 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:28 devstack sudo[111878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-0222940f-fa8f-476a-9817-1c899a439145
Jun 15 16:13:28 devstack sudo[111878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:29 devstack sudo[111875]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:29 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-254cffcc-a0ac-4570-967f-24a1d037034a tempest-CreateVolumesFromSnapshotTest-334660388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-0540fcb9-fe0d-4b9b-a2aa-d33aeff1bc05" returned: 0 in 0.581s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:29 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-254cffcc-a0ac-4570-967f-24a1d037034a tempest-CreateVolumesFromSnapshotTest-334660388 None] Lock "cinder-quobyte-0540fcb9-fe0d-4b9b-a2aa-d33aeff1bc05" released by "delete_volume" :: held 1.351s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:13:29 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-254cffcc-a0ac-4570-967f-24a1d037034a tempest-CreateVolumesFromSnapshotTest-334660388 None] Created reservations ['456515bd-8317-4f4b-9801-1b5bafe1f87b', 'e569d473-2135-4af3-83de-36922ffc1240', 'f18d019d-3a69-43a3-b5aa-83ae2b73a7c6', '80931dff-4ff0-4e5e-8209-3908d1322679'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 16:13:29 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-254cffcc-a0ac-4570-967f-24a1d037034a tempest-CreateVolumesFromSnapshotTest-334660388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:13:29 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-254cffcc-a0ac-4570-967f-24a1d037034a tempest-CreateVolumesFromSnapshotTest-334660388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:13:29 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-254cffcc-a0ac-4570-967f-24a1d037034a tempest-CreateVolumesFromSnapshotTest-334660388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:13:29 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-254cffcc-a0ac-4570-967f-24a1d037034a tempest-CreateVolumesFromSnapshotTest-334660388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:13:29 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-254cffcc-a0ac-4570-967f-24a1d037034a tempest-CreateVolumesFromSnapshotTest-334660388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:13:29 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-254cffcc-a0ac-4570-967f-24a1d037034a tempest-CreateVolumesFromSnapshotTest-334660388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:29 devstack sudo[111881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 16:13:29 devstack sudo[111881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:29 devstack sudo[111878]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:29 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-93419a00-d61b-41c6-8e62-f82f5e9b2e51 tempest-SnapshotDependencyTests-1103268421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-0222940f-fa8f-476a-9817-1c899a439145" returned: 0 in 0.617s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:29 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-93419a00-d61b-41c6-8e62-f82f5e9b2e51 tempest-SnapshotDependencyTests-1103268421 None] Lock "cinder-quobyte-0222940f-fa8f-476a-9817-1c899a439145" released by "_copy_volume_from_snapshot" :: held 8.543s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:13:29 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-93419a00-d61b-41c6-8e62-f82f5e9b2e51 tempest-SnapshotDependencyTests-1103268421 None] Lock "cinder-quobyte-458cee47-13b9-4cec-ad2e-383473abbe08-0222940f-fa8f-476a-9817-1c899a439145" released by "_create_volume_from_snapshot" :: held 8.593s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:13:29 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-93419a00-d61b-41c6-8e62-f82f5e9b2e51 tempest-SnapshotDependencyTests-1103268421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.639s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:13:29 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-93419a00-d61b-41c6-8e62-f82f5e9b2e51 tempest-SnapshotDependencyTests-1103268421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (298bd373-3ec1-440f-ae6c-86be6b0c03dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0222940f-fa8f-476a-9817-1c899a439145', 'volume_size': 1, 'snapshot_id': '458cee47-13b9-4cec-ad2e-383473abbe08'}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:13:29 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-93419a00-d61b-41c6-8e62-f82f5e9b2e51 tempest-SnapshotDependencyTests-1103268421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46a3084a-7133-4130-8e51-85ffd7ddc92e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:13:29 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-93419a00-d61b-41c6-8e62-f82f5e9b2e51 tempest-SnapshotDependencyTests-1103268421 None] Volume volume-0222940f-fa8f-476a-9817-1c899a439145 (0222940f-fa8f-476a-9817-1c899a439145): created successfully
Jun 15 16:13:29 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-93419a00-d61b-41c6-8e62-f82f5e9b2e51 tempest-SnapshotDependencyTests-1103268421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46a3084a-7133-4130-8e51-85ffd7ddc92e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:13:29 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-93419a00-d61b-41c6-8e62-f82f5e9b2e51 tempest-SnapshotDependencyTests-1103268421 None] Flow 'volume_create_manager' (260915a3-fea4-49b9-a0e6-d7a36b59b4f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:13:29 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-93419a00-d61b-41c6-8e62-f82f5e9b2e51 tempest-SnapshotDependencyTests-1103268421 None] Created volume successfully.
Jun 15 16:13:29 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-353e6551-ddc3-465f-b399-473b65f6ff73 tempest-SnapshotDependencyTests-1103268421 None] Acquiring lock "cinder-458cee47-13b9-4cec-ad2e-383473abbe08-delete_snapshot" by "delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:13:29 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-353e6551-ddc3-465f-b399-473b65f6ff73 tempest-SnapshotDependencyTests-1103268421 None] Lock "cinder-458cee47-13b9-4cec-ad2e-383473abbe08-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:13:29 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-353e6551-ddc3-465f-b399-473b65f6ff73 tempest-SnapshotDependencyTests-1103268421 None] Acquiring lock "cinder-quobyte-1742891b-87ce-4deb-8a0e-064e89adbfb4" by "delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:13:29 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-353e6551-ddc3-465f-b399-473b65f6ff73 tempest-SnapshotDependencyTests-1103268421 None] Lock "cinder-quobyte-1742891b-87ce-4deb-8a0e-064e89adbfb4" acquired by "delete_snapshot" :: waited 0.020s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:13:29 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-353e6551-ddc3-465f-b399-473b65f6ff73 tempest-SnapshotDependencyTests-1103268421 None] Acquiring lock "cinder-quobyte-458cee47-13b9-4cec-ad2e-383473abbe08" by "_delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:13:29 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-353e6551-ddc3-465f-b399-473b65f6ff73 tempest-SnapshotDependencyTests-1103268421 None] Lock "cinder-quobyte-458cee47-13b9-4cec-ad2e-383473abbe08" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:13:29 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-353e6551-ddc3-465f-b399-473b65f6ff73 tempest-SnapshotDependencyTests-1103268421 None] Deleting offline snapshot 458cee47-13b9-4cec-ad2e-383473abbe08 of volume 1742891b-87ce-4deb-8a0e-064e89adbfb4 {{(pid=91863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 15 16:13:29 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-353e6551-ddc3-465f-b399-473b65f6ff73 tempest-SnapshotDependencyTests-1103268421 None] snapshot_file for this snap is: volume-1742891b-87ce-4deb-8a0e-064e89adbfb4.458cee47-13b9-4cec-ad2e-383473abbe08 {{(pid=91863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 15 16:13:29 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[35acd6f4-a7c8-4485-9740-ff62c5632f1f]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:13:29 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-353e6551-ddc3-465f-b399-473b65f6ff73 tempest-SnapshotDependencyTests-1103268421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1742891b-87ce-4deb-8a0e-064e89adbfb4.458cee47-13b9-4cec-ad2e-383473abbe08 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:30 devstack sudo[111881]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:30 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-254cffcc-a0ac-4570-967f-24a1d037034a tempest-CreateVolumesFromSnapshotTest-334660388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.594s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:30 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-254cffcc-a0ac-4570-967f-24a1d037034a tempest-CreateVolumesFromSnapshotTest-334660388 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 16:13:30 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-254cffcc-a0ac-4570-967f-24a1d037034a tempest-CreateVolumesFromSnapshotTest-334660388 None] Deleted volume successfully.
Jun 15 16:13:30 devstack sudo[111885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1742891b-87ce-4deb-8a0e-064e89adbfb4.458cee47-13b9-4cec-ad2e-383473abbe08
Jun 15 16:13:30 devstack sudo[111885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:30 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-254cffcc-a0ac-4570-967f-24a1d037034a tempest-CreateVolumesFromSnapshotTest-334660388 None] Lock "cinder-0540fcb9-fe0d-4b9b-a2aa-d33aeff1bc05-delete_volume" released by "delete_volume" :: held 2.278s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:13:30 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-2d98af36-04dd-46b3-a109-534223eb8ade tempest-CreateVolumesFromSnapshotTest-334660388 None] Acquiring lock "cinder-72048783-d8c0-42f2-ae16-75f560446c5f-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:13:30 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-2d98af36-04dd-46b3-a109-534223eb8ade tempest-CreateVolumesFromSnapshotTest-334660388 None] Lock "cinder-72048783-d8c0-42f2-ae16-75f560446c5f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:13:30 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-2d98af36-04dd-46b3-a109-534223eb8ade tempest-CreateVolumesFromSnapshotTest-334660388 None] Acquiring lock "cinder-quobyte-72048783-d8c0-42f2-ae16-75f560446c5f" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:13:30 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-2d98af36-04dd-46b3-a109-534223eb8ade tempest-CreateVolumesFromSnapshotTest-334660388 None] Lock "cinder-quobyte-72048783-d8c0-42f2-ae16-75f560446c5f" acquired by "delete_volume" :: waited 0.013s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:13:30 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e78c9382-425d-4f64-953c-83070cc62bc3]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:13:30 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-2d98af36-04dd-46b3-a109-534223eb8ade tempest-CreateVolumesFromSnapshotTest-334660388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-72048783-d8c0-42f2-ae16-75f560446c5f {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:30 devstack sudo[111887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-72048783-d8c0-42f2-ae16-75f560446c5f
Jun 15 16:13:30 devstack sudo[111887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:30 devstack sudo[111885]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:30 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-353e6551-ddc3-465f-b399-473b65f6ff73 tempest-SnapshotDependencyTests-1103268421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1742891b-87ce-4deb-8a0e-064e89adbfb4.458cee47-13b9-4cec-ad2e-383473abbe08" returned: 0 in 0.744s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:30 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-353e6551-ddc3-465f-b399-473b65f6ff73 tempest-SnapshotDependencyTests-1103268421 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1742891b-87ce-4deb-8a0e-064e89adbfb4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 16:13:30 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b3546b-c850-4383-8b40-40fbdc776693]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:13:30 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-353e6551-ddc3-465f-b399-473b65f6ff73 tempest-SnapshotDependencyTests-1103268421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1742891b-87ce-4deb-8a0e-064e89adbfb4 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:30 devstack sudo[111892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1742891b-87ce-4deb-8a0e-064e89adbfb4
Jun 15 16:13:30 devstack sudo[111892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:30 devstack sudo[111887]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:30 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-2d98af36-04dd-46b3-a109-534223eb8ade tempest-CreateVolumesFromSnapshotTest-334660388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-72048783-d8c0-42f2-ae16-75f560446c5f" returned: 0 in 0.734s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:30 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-2d98af36-04dd-46b3-a109-534223eb8ade tempest-CreateVolumesFromSnapshotTest-334660388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-72048783-d8c0-42f2-ae16-75f560446c5f {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:30 devstack sudo[111897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-72048783-d8c0-42f2-ae16-75f560446c5f
Jun 15 16:13:30 devstack sudo[111897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:31 devstack cinder-volume[91863]: DEBUG oslo_service.periodic_task [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 16:13:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:13:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:13:31 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:13:31 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:13:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:13:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:31 devstack sudo[111899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 16:13:31 devstack sudo[111899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:31 devstack sudo[111892]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-353e6551-ddc3-465f-b399-473b65f6ff73 tempest-SnapshotDependencyTests-1103268421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1742891b-87ce-4deb-8a0e-064e89adbfb4" returned: 0 in 0.701s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-353e6551-ddc3-465f-b399-473b65f6ff73 tempest-SnapshotDependencyTests-1103268421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1742891b-87ce-4deb-8a0e-064e89adbfb4.458cee47-13b9-4cec-ad2e-383473abbe08 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:31 devstack sudo[111904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1742891b-87ce-4deb-8a0e-064e89adbfb4.458cee47-13b9-4cec-ad2e-383473abbe08
Jun 15 16:13:31 devstack sudo[111904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:31 devstack sudo[111897]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-2d98af36-04dd-46b3-a109-534223eb8ade tempest-CreateVolumesFromSnapshotTest-334660388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-72048783-d8c0-42f2-ae16-75f560446c5f" returned: 0 in 0.612s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:31 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-2d98af36-04dd-46b3-a109-534223eb8ade tempest-CreateVolumesFromSnapshotTest-334660388 None] Lock "cinder-quobyte-72048783-d8c0-42f2-ae16-75f560446c5f" released by "delete_volume" :: held 1.394s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:13:31 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-2d98af36-04dd-46b3-a109-534223eb8ade tempest-CreateVolumesFromSnapshotTest-334660388 None] Created reservations ['fe86686c-d6b3-454f-8c9c-a0a29dddb253', '5c77525b-ca14-4e28-9465-d04f3e015231', '51d20bc5-901c-495f-bfed-907786fe8ce6', 'db105242-6e0f-473e-89b4-c69468875914'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 16:13:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-2d98af36-04dd-46b3-a109-534223eb8ade tempest-CreateVolumesFromSnapshotTest-334660388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:13:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-2d98af36-04dd-46b3-a109-534223eb8ade tempest-CreateVolumesFromSnapshotTest-334660388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:13:31 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-2d98af36-04dd-46b3-a109-534223eb8ade tempest-CreateVolumesFromSnapshotTest-334660388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:13:31 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-2d98af36-04dd-46b3-a109-534223eb8ade tempest-CreateVolumesFromSnapshotTest-334660388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:13:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-2d98af36-04dd-46b3-a109-534223eb8ade tempest-CreateVolumesFromSnapshotTest-334660388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:13:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-2d98af36-04dd-46b3-a109-534223eb8ade tempest-CreateVolumesFromSnapshotTest-334660388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:31 devstack sudo[111907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 16:13:31 devstack sudo[111907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:31 devstack sudo[111899]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:31 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.689s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:31 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 16:13:31 devstack cinder-volume[91863]: DEBUG oslo_service.periodic_task [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] Running periodic task VolumeManager._thread_info {{(pid=91863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Jun 15 16:13:31 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] thread count: 28 {{(pid=91863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 15 16:13:31 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-6c372723-761d-42f6-abdb-77c67cee76ab None None] thread info: [<_MainThread(MainThread, started 131088232640640)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131088122704576)>, <Thread(Thread-3 (stat_writer), started daemon 131088123058112)>, <Thread(Rabbit-heartbeat, started daemon 131088121268864)>, <Thread(Thread-5 (_runner), started daemon 131088121904192)>, <Thread(Thread-7 (_runner), started daemon 131088122037248)>, <Thread(fd_logger, started daemon 131088119630784)>, <Thread(privsep_reader, started daemon 131088119781440)>, <Thread(tpool_thread_0, started daemon 131088111617728)>, <Thread(tpool_thread_1, started daemon 131088103225024)>, <Thread(tpool_thread_2, started daemon 131088094832320)>, <Thread(tpool_thread_3, started daemon 131088086439616)>, <Thread(tpool_thread_4, started daemon 131088078046912)>, <Thread(tpool_thread_5, started daemon 131088069654208)>, <Thread(tpool_thread_6, started daemon 131088061261504)>, <Thread(tpool_thread_7, started daemon 131088052868800)>, <Thread(tpool_thread_8, started daemon 131088044476096)>, <Thread(tpool_thread_9, started daemon 131088036083392)>, <Thread(tpool_thread_10, started daemon 131088027690688)>, <Thread(tpool_thread_11, started daemon 131088019297984)>, <Thread(tpool_thread_12, started daemon 131088010905280)>, <Thread(tpool_thread_13, started daemon 131088002512576)>, <Thread(tpool_thread_14, started daemon 131087994119872)>, <Thread(tpool_thread_15, started daemon 131087985727168)>, <Thread(tpool_thread_16, started daemon 131087977334464)>, <Thread(tpool_thread_17, started daemon 131087968941760)>, <Thread(tpool_thread_18, started daemon 131087960549056)>, <Thread(tpool_thread_19, started daemon 131087952156352)>] {{(pid=91863) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 15 16:13:32 devstack sudo[111904]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:32 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-353e6551-ddc3-465f-b399-473b65f6ff73 tempest-SnapshotDependencyTests-1103268421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1742891b-87ce-4deb-8a0e-064e89adbfb4.458cee47-13b9-4cec-ad2e-383473abbe08" returned: 0 in 0.706s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:32 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-353e6551-ddc3-465f-b399-473b65f6ff73 tempest-SnapshotDependencyTests-1103268421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1742891b-87ce-4deb-8a0e-064e89adbfb4.458cee47-13b9-4cec-ad2e-383473abbe08 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:32 devstack sudo[111914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1742891b-87ce-4deb-8a0e-064e89adbfb4.458cee47-13b9-4cec-ad2e-383473abbe08
Jun 15 16:13:32 devstack sudo[111914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:32 devstack sudo[111907]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:32 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-2d98af36-04dd-46b3-a109-534223eb8ade tempest-CreateVolumesFromSnapshotTest-334660388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.653s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:32 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-2d98af36-04dd-46b3-a109-534223eb8ade tempest-CreateVolumesFromSnapshotTest-334660388 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 16:13:32 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-fddd41ce-ee41-48ee-aff4-bc1f550a38b7 tempest-CreateVolumesFromSnapshotTest-334660388 None] Acquiring lock "cinder-6a4613bb-080d-4f17-b3f2-c028c1c90a13-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:13:32 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-2d98af36-04dd-46b3-a109-534223eb8ade tempest-CreateVolumesFromSnapshotTest-334660388 None] Deleted volume successfully.
Jun 15 16:13:32 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-fddd41ce-ee41-48ee-aff4-bc1f550a38b7 tempest-CreateVolumesFromSnapshotTest-334660388 None] Lock "cinder-6a4613bb-080d-4f17-b3f2-c028c1c90a13-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:13:32 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-2d98af36-04dd-46b3-a109-534223eb8ade tempest-CreateVolumesFromSnapshotTest-334660388 None] Lock "cinder-72048783-d8c0-42f2-ae16-75f560446c5f-delete_volume" released by "delete_volume" :: held 2.315s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:13:32 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-fddd41ce-ee41-48ee-aff4-bc1f550a38b7 tempest-CreateVolumesFromSnapshotTest-334660388 None] Acquiring lock "cinder-quobyte-6a4613bb-080d-4f17-b3f2-c028c1c90a13" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:13:32 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-fddd41ce-ee41-48ee-aff4-bc1f550a38b7 tempest-CreateVolumesFromSnapshotTest-334660388 None] Lock "cinder-quobyte-6a4613bb-080d-4f17-b3f2-c028c1c90a13" acquired by "delete_volume" :: waited 0.017s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:13:32 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[baeecefd-52f0-4b23-bde5-5432d790e305]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:13:32 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-fddd41ce-ee41-48ee-aff4-bc1f550a38b7 tempest-CreateVolumesFromSnapshotTest-334660388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-6a4613bb-080d-4f17-b3f2-c028c1c90a13 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:32 devstack sudo[111917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-6a4613bb-080d-4f17-b3f2-c028c1c90a13
Jun 15 16:13:32 devstack sudo[111917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:32 devstack sudo[111914]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:32 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-353e6551-ddc3-465f-b399-473b65f6ff73 tempest-SnapshotDependencyTests-1103268421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1742891b-87ce-4deb-8a0e-064e89adbfb4.458cee47-13b9-4cec-ad2e-383473abbe08" returned: 0 in 0.636s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:32 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-353e6551-ddc3-465f-b399-473b65f6ff73 tempest-SnapshotDependencyTests-1103268421 None] Lock "cinder-quobyte-458cee47-13b9-4cec-ad2e-383473abbe08" released by "_delete_snapshot" :: held 2.877s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:13:32 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-353e6551-ddc3-465f-b399-473b65f6ff73 tempest-SnapshotDependencyTests-1103268421 None] Lock "cinder-quobyte-1742891b-87ce-4deb-8a0e-064e89adbfb4" released by "delete_snapshot" :: held 2.900s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:13:32 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-353e6551-ddc3-465f-b399-473b65f6ff73 tempest-SnapshotDependencyTests-1103268421 None] Created reservations ['2b24dda5-3a9c-4af7-aa45-9f758a71b090', '6e620207-3969-4bd5-85dd-0cc30d2a75c0', 'c09dcec1-a805-488d-aed4-d1d79572fc0c', '22960f90-9921-49ff-98de-3de16d600742'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 16:13:32 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-353e6551-ddc3-465f-b399-473b65f6ff73 tempest-SnapshotDependencyTests-1103268421 None] Delete snapshot completed successfully.
Jun 15 16:13:32 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-353e6551-ddc3-465f-b399-473b65f6ff73 tempest-SnapshotDependencyTests-1103268421 None] Lock "cinder-458cee47-13b9-4cec-ad2e-383473abbe08-delete_snapshot" released by "delete_snapshot" :: held 3.043s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:13:33 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-746887bf-f43a-4d5c-b220-c1a78e318601 tempest-SnapshotDependencyTests-1103268421 None] Acquiring lock "cinder-1742891b-87ce-4deb-8a0e-064e89adbfb4-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:13:33 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-746887bf-f43a-4d5c-b220-c1a78e318601 tempest-SnapshotDependencyTests-1103268421 None] Lock "cinder-1742891b-87ce-4deb-8a0e-064e89adbfb4-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:13:33 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-746887bf-f43a-4d5c-b220-c1a78e318601 tempest-SnapshotDependencyTests-1103268421 None] Acquiring lock "cinder-quobyte-1742891b-87ce-4deb-8a0e-064e89adbfb4" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:13:33 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-746887bf-f43a-4d5c-b220-c1a78e318601 tempest-SnapshotDependencyTests-1103268421 None] Lock "cinder-quobyte-1742891b-87ce-4deb-8a0e-064e89adbfb4" acquired by "delete_volume" :: waited 0.014s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:13:33 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e9596d3-8c01-47aa-aea0-5f543615cec4]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:13:33 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-746887bf-f43a-4d5c-b220-c1a78e318601 tempest-SnapshotDependencyTests-1103268421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1742891b-87ce-4deb-8a0e-064e89adbfb4 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:33 devstack sudo[111917]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:33 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-fddd41ce-ee41-48ee-aff4-bc1f550a38b7 tempest-CreateVolumesFromSnapshotTest-334660388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-6a4613bb-080d-4f17-b3f2-c028c1c90a13" returned: 0 in 0.723s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:33 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-fddd41ce-ee41-48ee-aff4-bc1f550a38b7 tempest-CreateVolumesFromSnapshotTest-334660388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-6a4613bb-080d-4f17-b3f2-c028c1c90a13 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:33 devstack sudo[111924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-6a4613bb-080d-4f17-b3f2-c028c1c90a13
Jun 15 16:13:33 devstack sudo[111924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:33 devstack sudo[111923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1742891b-87ce-4deb-8a0e-064e89adbfb4
Jun 15 16:13:33 devstack sudo[111923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:33 devstack sudo[111924]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:33 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-fddd41ce-ee41-48ee-aff4-bc1f550a38b7 tempest-CreateVolumesFromSnapshotTest-334660388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-6a4613bb-080d-4f17-b3f2-c028c1c90a13" returned: 0 in 0.626s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:33 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-fddd41ce-ee41-48ee-aff4-bc1f550a38b7 tempest-CreateVolumesFromSnapshotTest-334660388 None] Lock "cinder-quobyte-6a4613bb-080d-4f17-b3f2-c028c1c90a13" released by "delete_volume" :: held 1.388s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:13:33 devstack sudo[111923]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:33 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-746887bf-f43a-4d5c-b220-c1a78e318601 tempest-SnapshotDependencyTests-1103268421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1742891b-87ce-4deb-8a0e-064e89adbfb4" returned: 0 in 0.736s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:33 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-746887bf-f43a-4d5c-b220-c1a78e318601 tempest-SnapshotDependencyTests-1103268421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1742891b-87ce-4deb-8a0e-064e89adbfb4 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:33 devstack sudo[111931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1742891b-87ce-4deb-8a0e-064e89adbfb4
Jun 15 16:13:33 devstack sudo[111931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:33 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-fddd41ce-ee41-48ee-aff4-bc1f550a38b7 tempest-CreateVolumesFromSnapshotTest-334660388 None] Created reservations ['6c01cfa8-9bd6-4b0a-9685-fc106ca7e266', 'f0f1b3cc-e514-4d9b-b572-29514e39ba1f', '07d83ce1-493c-4e55-b3b6-f8eb2755746b', '764792ec-f824-4056-9ca3-98c05fb7b9f4'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 16:13:33 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-fddd41ce-ee41-48ee-aff4-bc1f550a38b7 tempest-CreateVolumesFromSnapshotTest-334660388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:13:33 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-fddd41ce-ee41-48ee-aff4-bc1f550a38b7 tempest-CreateVolumesFromSnapshotTest-334660388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:13:33 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-fddd41ce-ee41-48ee-aff4-bc1f550a38b7 tempest-CreateVolumesFromSnapshotTest-334660388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:13:34 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-fddd41ce-ee41-48ee-aff4-bc1f550a38b7 tempest-CreateVolumesFromSnapshotTest-334660388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:13:34 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-fddd41ce-ee41-48ee-aff4-bc1f550a38b7 tempest-CreateVolumesFromSnapshotTest-334660388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:13:34 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-fddd41ce-ee41-48ee-aff4-bc1f550a38b7 tempest-CreateVolumesFromSnapshotTest-334660388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:34 devstack sudo[111933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 16:13:34 devstack sudo[111933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:34 devstack sudo[111931]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:34 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-746887bf-f43a-4d5c-b220-c1a78e318601 tempest-SnapshotDependencyTests-1103268421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-1742891b-87ce-4deb-8a0e-064e89adbfb4" returned: 0 in 0.622s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:34 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-746887bf-f43a-4d5c-b220-c1a78e318601 tempest-SnapshotDependencyTests-1103268421 None] Lock "cinder-quobyte-1742891b-87ce-4deb-8a0e-064e89adbfb4" released by "delete_volume" :: held 1.418s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:13:34 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-5934ff24-cbfe-4e90-b664-45be05e47c3e tempest-CreateVolumesFromSnapshotTest-334660388 None] Acquiring lock "cinder-4d2d9e80-b24d-4a80-b194-1d50163348e5-delete_snapshot" by "delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:13:34 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-5934ff24-cbfe-4e90-b664-45be05e47c3e tempest-CreateVolumesFromSnapshotTest-334660388 None] Lock "cinder-4d2d9e80-b24d-4a80-b194-1d50163348e5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:13:34 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-5934ff24-cbfe-4e90-b664-45be05e47c3e tempest-CreateVolumesFromSnapshotTest-334660388 None] Acquiring lock "cinder-quobyte-efbf1d6c-a35b-420d-a317-fe36fcf4e67a" by "delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:13:34 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-746887bf-f43a-4d5c-b220-c1a78e318601 tempest-SnapshotDependencyTests-1103268421 None] Created reservations ['70e44c57-e0c2-4f3c-ba25-b24e1fbd529e', '90eb93e8-db3d-470c-ad98-e8e4dc90a823', '3ef5cf91-8b3f-410d-aa0f-56a40cbf25fe', '235c23bc-8165-4d0a-a77c-78b5e6c9e2e2'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 16:13:34 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-5934ff24-cbfe-4e90-b664-45be05e47c3e tempest-CreateVolumesFromSnapshotTest-334660388 None] Lock "cinder-quobyte-efbf1d6c-a35b-420d-a317-fe36fcf4e67a" acquired by "delete_snapshot" :: waited 0.023s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:13:34 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-5934ff24-cbfe-4e90-b664-45be05e47c3e tempest-CreateVolumesFromSnapshotTest-334660388 None] Acquiring lock "cinder-quobyte-4d2d9e80-b24d-4a80-b194-1d50163348e5" by "_delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:13:34 devstack sudo[111933]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:34 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-fddd41ce-ee41-48ee-aff4-bc1f550a38b7 tempest-CreateVolumesFromSnapshotTest-334660388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.654s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:34 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-fddd41ce-ee41-48ee-aff4-bc1f550a38b7 tempest-CreateVolumesFromSnapshotTest-334660388 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 16:13:34 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-fddd41ce-ee41-48ee-aff4-bc1f550a38b7 tempest-CreateVolumesFromSnapshotTest-334660388 None] Deleted volume successfully.
Jun 15 16:13:34 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-5934ff24-cbfe-4e90-b664-45be05e47c3e tempest-CreateVolumesFromSnapshotTest-334660388 None] Lock "cinder-quobyte-4d2d9e80-b24d-4a80-b194-1d50163348e5" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:13:34 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-5934ff24-cbfe-4e90-b664-45be05e47c3e tempest-CreateVolumesFromSnapshotTest-334660388 None] Deleting offline snapshot 4d2d9e80-b24d-4a80-b194-1d50163348e5 of volume efbf1d6c-a35b-420d-a317-fe36fcf4e67a {{(pid=91863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 15 16:13:34 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-5934ff24-cbfe-4e90-b664-45be05e47c3e tempest-CreateVolumesFromSnapshotTest-334660388 None] snapshot_file for this snap is: volume-efbf1d6c-a35b-420d-a317-fe36fcf4e67a.4d2d9e80-b24d-4a80-b194-1d50163348e5 {{(pid=91863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 15 16:13:34 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[956bb9ec-bf41-43b6-8698-09b0df9a01b0]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:13:34 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5934ff24-cbfe-4e90-b664-45be05e47c3e tempest-CreateVolumesFromSnapshotTest-334660388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-efbf1d6c-a35b-420d-a317-fe36fcf4e67a.4d2d9e80-b24d-4a80-b194-1d50163348e5 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:34 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-fddd41ce-ee41-48ee-aff4-bc1f550a38b7 tempest-CreateVolumesFromSnapshotTest-334660388 None] Lock "cinder-6a4613bb-080d-4f17-b3f2-c028c1c90a13-delete_volume" released by "delete_volume" :: held 2.323s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:13:34 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-746887bf-f43a-4d5c-b220-c1a78e318601 tempest-SnapshotDependencyTests-1103268421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:13:34 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-746887bf-f43a-4d5c-b220-c1a78e318601 tempest-SnapshotDependencyTests-1103268421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:13:34 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-746887bf-f43a-4d5c-b220-c1a78e318601 tempest-SnapshotDependencyTests-1103268421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:13:34 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-746887bf-f43a-4d5c-b220-c1a78e318601 tempest-SnapshotDependencyTests-1103268421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:13:34 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-746887bf-f43a-4d5c-b220-c1a78e318601 tempest-SnapshotDependencyTests-1103268421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:13:34 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-746887bf-f43a-4d5c-b220-c1a78e318601 tempest-SnapshotDependencyTests-1103268421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:34 devstack sudo[111938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 16:13:34 devstack sudo[111938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:34 devstack sudo[111937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-efbf1d6c-a35b-420d-a317-fe36fcf4e67a.4d2d9e80-b24d-4a80-b194-1d50163348e5
Jun 15 16:13:34 devstack sudo[111937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:35 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-696205bc-e84e-4f99-b0f6-133e3de9e7c8 tempest-SnapshotDependencyTests-1103268421 None] Acquiring lock "cinder-0222940f-fa8f-476a-9817-1c899a439145-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:13:35 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-696205bc-e84e-4f99-b0f6-133e3de9e7c8 tempest-SnapshotDependencyTests-1103268421 None] Lock "cinder-0222940f-fa8f-476a-9817-1c899a439145-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:13:35 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-696205bc-e84e-4f99-b0f6-133e3de9e7c8 tempest-SnapshotDependencyTests-1103268421 None] Acquiring lock "cinder-quobyte-0222940f-fa8f-476a-9817-1c899a439145" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:13:35 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-696205bc-e84e-4f99-b0f6-133e3de9e7c8 tempest-SnapshotDependencyTests-1103268421 None] Lock "cinder-quobyte-0222940f-fa8f-476a-9817-1c899a439145" acquired by "delete_volume" :: waited 0.018s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:13:35 devstack sudo[111938]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:35 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-746887bf-f43a-4d5c-b220-c1a78e318601 tempest-SnapshotDependencyTests-1103268421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.649s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:35 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-746887bf-f43a-4d5c-b220-c1a78e318601 tempest-SnapshotDependencyTests-1103268421 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 16:13:35 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-746887bf-f43a-4d5c-b220-c1a78e318601 tempest-SnapshotDependencyTests-1103268421 None] Deleted volume successfully.
Jun 15 16:13:35 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[901db73c-aaf8-40c6-a0f1-3e9dab2c189c]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:13:35 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-696205bc-e84e-4f99-b0f6-133e3de9e7c8 tempest-SnapshotDependencyTests-1103268421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-0222940f-fa8f-476a-9817-1c899a439145 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:35 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-746887bf-f43a-4d5c-b220-c1a78e318601 tempest-SnapshotDependencyTests-1103268421 None] Lock "cinder-1742891b-87ce-4deb-8a0e-064e89adbfb4-delete_volume" released by "delete_volume" :: held 2.382s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:13:35 devstack sudo[111937]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:35 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5934ff24-cbfe-4e90-b664-45be05e47c3e tempest-CreateVolumesFromSnapshotTest-334660388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-efbf1d6c-a35b-420d-a317-fe36fcf4e67a.4d2d9e80-b24d-4a80-b194-1d50163348e5" returned: 0 in 0.787s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:35 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-5934ff24-cbfe-4e90-b664-45be05e47c3e tempest-CreateVolumesFromSnapshotTest-334660388 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-efbf1d6c-a35b-420d-a317-fe36fcf4e67a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 16:13:35 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc8ca616-7475-469f-9c3e-2b80611272ed]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:13:35 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5934ff24-cbfe-4e90-b664-45be05e47c3e tempest-CreateVolumesFromSnapshotTest-334660388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-efbf1d6c-a35b-420d-a317-fe36fcf4e67a {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:35 devstack sudo[111946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-0222940f-fa8f-476a-9817-1c899a439145
Jun 15 16:13:35 devstack sudo[111946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:35 devstack sudo[111947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-efbf1d6c-a35b-420d-a317-fe36fcf4e67a
Jun 15 16:13:35 devstack sudo[111947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:36 devstack sudo[111946]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:36 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-696205bc-e84e-4f99-b0f6-133e3de9e7c8 tempest-SnapshotDependencyTests-1103268421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-0222940f-fa8f-476a-9817-1c899a439145" returned: 0 in 0.804s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:36 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-696205bc-e84e-4f99-b0f6-133e3de9e7c8 tempest-SnapshotDependencyTests-1103268421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-0222940f-fa8f-476a-9817-1c899a439145 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:36 devstack sudo[111947]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:36 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5934ff24-cbfe-4e90-b664-45be05e47c3e tempest-CreateVolumesFromSnapshotTest-334660388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-efbf1d6c-a35b-420d-a317-fe36fcf4e67a" returned: 0 in 0.722s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:36 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5934ff24-cbfe-4e90-b664-45be05e47c3e tempest-CreateVolumesFromSnapshotTest-334660388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-efbf1d6c-a35b-420d-a317-fe36fcf4e67a.4d2d9e80-b24d-4a80-b194-1d50163348e5 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:36 devstack sudo[111956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-0222940f-fa8f-476a-9817-1c899a439145
Jun 15 16:13:36 devstack sudo[111956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:36 devstack sudo[111958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-efbf1d6c-a35b-420d-a317-fe36fcf4e67a.4d2d9e80-b24d-4a80-b194-1d50163348e5
Jun 15 16:13:36 devstack sudo[111958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:36 devstack sudo[111956]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:36 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-696205bc-e84e-4f99-b0f6-133e3de9e7c8 tempest-SnapshotDependencyTests-1103268421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-0222940f-fa8f-476a-9817-1c899a439145" returned: 0 in 0.576s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:36 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-696205bc-e84e-4f99-b0f6-133e3de9e7c8 tempest-SnapshotDependencyTests-1103268421 None] Lock "cinder-quobyte-0222940f-fa8f-476a-9817-1c899a439145" released by "delete_volume" :: held 1.427s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:13:36 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-696205bc-e84e-4f99-b0f6-133e3de9e7c8 tempest-SnapshotDependencyTests-1103268421 None] Created reservations ['50c6befb-33ce-41c7-a3ee-c57403302b7d', 'efaa7070-2ef7-4943-aae3-eb16a03319ef', 'b6e20c82-6e5c-4ece-9d7d-fb64c2db720a', '090571ac-1043-4e5d-8227-f43de9e529c2'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 16:13:36 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-696205bc-e84e-4f99-b0f6-133e3de9e7c8 tempest-SnapshotDependencyTests-1103268421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:13:36 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-696205bc-e84e-4f99-b0f6-133e3de9e7c8 tempest-SnapshotDependencyTests-1103268421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:13:36 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-696205bc-e84e-4f99-b0f6-133e3de9e7c8 tempest-SnapshotDependencyTests-1103268421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:13:36 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-696205bc-e84e-4f99-b0f6-133e3de9e7c8 tempest-SnapshotDependencyTests-1103268421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:13:36 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-696205bc-e84e-4f99-b0f6-133e3de9e7c8 tempest-SnapshotDependencyTests-1103268421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:13:36 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-696205bc-e84e-4f99-b0f6-133e3de9e7c8 tempest-SnapshotDependencyTests-1103268421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:36 devstack sudo[111958]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:36 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5934ff24-cbfe-4e90-b664-45be05e47c3e tempest-CreateVolumesFromSnapshotTest-334660388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-efbf1d6c-a35b-420d-a317-fe36fcf4e67a.4d2d9e80-b24d-4a80-b194-1d50163348e5" returned: 0 in 0.689s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:36 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5934ff24-cbfe-4e90-b664-45be05e47c3e tempest-CreateVolumesFromSnapshotTest-334660388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-efbf1d6c-a35b-420d-a317-fe36fcf4e67a.4d2d9e80-b24d-4a80-b194-1d50163348e5 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:36 devstack sudo[111965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 16:13:36 devstack sudo[111965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:36 devstack sudo[111966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-efbf1d6c-a35b-420d-a317-fe36fcf4e67a.4d2d9e80-b24d-4a80-b194-1d50163348e5
Jun 15 16:13:36 devstack sudo[111966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:37 devstack sudo[111965]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:37 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-696205bc-e84e-4f99-b0f6-133e3de9e7c8 tempest-SnapshotDependencyTests-1103268421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.609s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:37 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-696205bc-e84e-4f99-b0f6-133e3de9e7c8 tempest-SnapshotDependencyTests-1103268421 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 16:13:37 devstack sudo[111966]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:37 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-5934ff24-cbfe-4e90-b664-45be05e47c3e tempest-CreateVolumesFromSnapshotTest-334660388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-efbf1d6c-a35b-420d-a317-fe36fcf4e67a.4d2d9e80-b24d-4a80-b194-1d50163348e5" returned: 0 in 0.605s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:37 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-696205bc-e84e-4f99-b0f6-133e3de9e7c8 tempest-SnapshotDependencyTests-1103268421 None] Deleted volume successfully.
Jun 15 16:13:37 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-5934ff24-cbfe-4e90-b664-45be05e47c3e tempest-CreateVolumesFromSnapshotTest-334660388 None] Lock "cinder-quobyte-4d2d9e80-b24d-4a80-b194-1d50163348e5" released by "_delete_snapshot" :: held 2.923s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:13:37 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-696205bc-e84e-4f99-b0f6-133e3de9e7c8 tempest-SnapshotDependencyTests-1103268421 None] Lock "cinder-0222940f-fa8f-476a-9817-1c899a439145-delete_volume" released by "delete_volume" :: held 2.286s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:13:37 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-5934ff24-cbfe-4e90-b664-45be05e47c3e tempest-CreateVolumesFromSnapshotTest-334660388 None] Lock "cinder-quobyte-efbf1d6c-a35b-420d-a317-fe36fcf4e67a" released by "delete_snapshot" :: held 2.962s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:13:37 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-5934ff24-cbfe-4e90-b664-45be05e47c3e tempest-CreateVolumesFromSnapshotTest-334660388 None] Created reservations ['a249e66e-e7b8-472a-af14-ff4a48d6536a', '01b9a903-bc2d-482b-91a7-27ee8c1875e4', '90a9bc36-1c7d-4a09-9a45-578da8c43c44', 'dec5accc-d1b4-4457-a1c8-8c98de097dee'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 16:13:37 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-5934ff24-cbfe-4e90-b664-45be05e47c3e tempest-CreateVolumesFromSnapshotTest-334660388 None] Delete snapshot completed successfully.
Jun 15 16:13:37 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-5934ff24-cbfe-4e90-b664-45be05e47c3e tempest-CreateVolumesFromSnapshotTest-334660388 None] Lock "cinder-4d2d9e80-b24d-4a80-b194-1d50163348e5-delete_snapshot" released by "delete_snapshot" :: held 3.105s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:13:37 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-45920399-ef23-429b-8d55-233e1000f696 tempest-CreateVolumesFromSnapshotTest-334660388 None] Acquiring lock "cinder-efbf1d6c-a35b-420d-a317-fe36fcf4e67a-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:13:37 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-45920399-ef23-429b-8d55-233e1000f696 tempest-CreateVolumesFromSnapshotTest-334660388 None] Lock "cinder-efbf1d6c-a35b-420d-a317-fe36fcf4e67a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:13:37 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-45920399-ef23-429b-8d55-233e1000f696 tempest-CreateVolumesFromSnapshotTest-334660388 None] Acquiring lock "cinder-quobyte-efbf1d6c-a35b-420d-a317-fe36fcf4e67a" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:13:37 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-45920399-ef23-429b-8d55-233e1000f696 tempest-CreateVolumesFromSnapshotTest-334660388 None] Lock "cinder-quobyte-efbf1d6c-a35b-420d-a317-fe36fcf4e67a" acquired by "delete_volume" :: waited 0.013s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:13:37 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf4b422-ffb7-40ec-ab38-3241d84db52d]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:13:37 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-45920399-ef23-429b-8d55-233e1000f696 tempest-CreateVolumesFromSnapshotTest-334660388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-efbf1d6c-a35b-420d-a317-fe36fcf4e67a {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:38 devstack sudo[111971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-efbf1d6c-a35b-420d-a317-fe36fcf4e67a
Jun 15 16:13:38 devstack sudo[111971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:38 devstack sudo[111971]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:38 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-45920399-ef23-429b-8d55-233e1000f696 tempest-CreateVolumesFromSnapshotTest-334660388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-efbf1d6c-a35b-420d-a317-fe36fcf4e67a" returned: 0 in 0.724s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:38 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-45920399-ef23-429b-8d55-233e1000f696 tempest-CreateVolumesFromSnapshotTest-334660388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-efbf1d6c-a35b-420d-a317-fe36fcf4e67a {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:38 devstack sudo[111976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-efbf1d6c-a35b-420d-a317-fe36fcf4e67a
Jun 15 16:13:38 devstack sudo[111976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:39 devstack sudo[111976]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-45920399-ef23-429b-8d55-233e1000f696 tempest-CreateVolumesFromSnapshotTest-334660388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-efbf1d6c-a35b-420d-a317-fe36fcf4e67a" returned: 0 in 0.639s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:39 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-45920399-ef23-429b-8d55-233e1000f696 tempest-CreateVolumesFromSnapshotTest-334660388 None] Lock "cinder-quobyte-efbf1d6c-a35b-420d-a317-fe36fcf4e67a" released by "delete_volume" :: held 1.423s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:13:39 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-45920399-ef23-429b-8d55-233e1000f696 tempest-CreateVolumesFromSnapshotTest-334660388 None] Created reservations ['db4d43ec-507a-4231-bcc3-ff4e46c7e172', '61f73b19-187e-4f32-9762-0b86689942ba', '1493a790-2e61-489d-9d12-67cae579eabb', 'ad18a67d-147e-4267-9f4f-6eab9d6119ad'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 16:13:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-45920399-ef23-429b-8d55-233e1000f696 tempest-CreateVolumesFromSnapshotTest-334660388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:13:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-45920399-ef23-429b-8d55-233e1000f696 tempest-CreateVolumesFromSnapshotTest-334660388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:13:39 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-45920399-ef23-429b-8d55-233e1000f696 tempest-CreateVolumesFromSnapshotTest-334660388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:13:39 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-45920399-ef23-429b-8d55-233e1000f696 tempest-CreateVolumesFromSnapshotTest-334660388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:13:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-45920399-ef23-429b-8d55-233e1000f696 tempest-CreateVolumesFromSnapshotTest-334660388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:13:39 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-45920399-ef23-429b-8d55-233e1000f696 tempest-CreateVolumesFromSnapshotTest-334660388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:39 devstack sudo[111980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 16:13:39 devstack sudo[111980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:40 devstack sudo[111980]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:40 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-45920399-ef23-429b-8d55-233e1000f696 tempest-CreateVolumesFromSnapshotTest-334660388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.646s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:40 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-45920399-ef23-429b-8d55-233e1000f696 tempest-CreateVolumesFromSnapshotTest-334660388 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 16:13:40 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-45920399-ef23-429b-8d55-233e1000f696 tempest-CreateVolumesFromSnapshotTest-334660388 None] Deleted volume successfully.
Jun 15 16:13:40 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-45920399-ef23-429b-8d55-233e1000f696 tempest-CreateVolumesFromSnapshotTest-334660388 None] Lock "cinder-efbf1d6c-a35b-420d-a317-fe36fcf4e67a-delete_volume" released by "delete_volume" :: held 2.271s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:13:42 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-158e0cfb-c32f-4267-9d52-451309379b2d tempest-CinderUnicodeTest-1201326799 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 16:13:42 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-158e0cfb-c32f-4267-9d52-451309379b2d tempest-CinderUnicodeTest-1201326799 None] Flow 'volume_create_manager' (0993d05f-742d-46c8-8d26-e538c44a4ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:13:42 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-158e0cfb-c32f-4267-9d52-451309379b2d tempest-CinderUnicodeTest-1201326799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0302626e-1095-42f6-962e-53f8b0c604f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:13:42 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-158e0cfb-c32f-4267-9d52-451309379b2d tempest-CinderUnicodeTest-1201326799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0302626e-1095-42f6-962e-53f8b0c604f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:13:43Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80113733-1004-4b52-95eb-21007f4b710f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b4c89082e964ac2bebd4cd5a486bddf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:13:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:13:43Z,use_quota=True,user_id='9bf6817ebf664f3d94097dcaf9c3c578',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:13:42 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-158e0cfb-c32f-4267-9d52-451309379b2d tempest-CinderUnicodeTest-1201326799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac890930-79f2-4cc5-b715-6d18a4bf06fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:13:42 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-158e0cfb-c32f-4267-9d52-451309379b2d tempest-CinderUnicodeTest-1201326799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac890930-79f2-4cc5-b715-6d18a4bf06fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:13:42 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-158e0cfb-c32f-4267-9d52-451309379b2d tempest-CinderUnicodeTest-1201326799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f9b40f0-3e2f-4510-a96f-8661b99bd6b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:13:42 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-158e0cfb-c32f-4267-9d52-451309379b2d tempest-CinderUnicodeTest-1201326799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f9b40f0-3e2f-4510-a96f-8661b99bd6b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80113733-1004-4b52-95eb-21007f4b710f', 'volume_name': 'volume-80113733-1004-4b52-95eb-21007f4b710f', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:13:42 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-158e0cfb-c32f-4267-9d52-451309379b2d tempest-CinderUnicodeTest-1201326799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c698eda-f990-49ca-a699-9b706eea6d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:13:42 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-158e0cfb-c32f-4267-9d52-451309379b2d tempest-CinderUnicodeTest-1201326799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c698eda-f990-49ca-a699-9b706eea6d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:13:42 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-158e0cfb-c32f-4267-9d52-451309379b2d tempest-CinderUnicodeTest-1201326799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edb07586-ff6b-43d3-8a7f-24969d25cc62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:13:42 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-158e0cfb-c32f-4267-9d52-451309379b2d tempest-CinderUnicodeTest-1201326799 None] Volume 80113733-1004-4b52-95eb-21007f4b710f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80113733-1004-4b52-95eb-21007f4b710f', 'volume_size': 1}
Jun 15 16:13:42 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-158e0cfb-c32f-4267-9d52-451309379b2d tempest-CinderUnicodeTest-1201326799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:13:42 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-158e0cfb-c32f-4267-9d52-451309379b2d tempest-CinderUnicodeTest-1201326799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:13:42 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-158e0cfb-c32f-4267-9d52-451309379b2d tempest-CinderUnicodeTest-1201326799 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:13:43Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80113733-1004-4b52-95eb-21007f4b710f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b4c89082e964ac2bebd4cd5a486bddf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:13:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:13:43Z,use_quota=True,user_id='9bf6817ebf664f3d94097dcaf9c3c578',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 16:13:42 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-158e0cfb-c32f-4267-9d52-451309379b2d tempest-CinderUnicodeTest-1201326799 None] Creating volume 80113733-1004-4b52-95eb-21007f4b710f {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 16:13:42 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-158e0cfb-c32f-4267-9d52-451309379b2d tempest-CinderUnicodeTest-1201326799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:13:42 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-158e0cfb-c32f-4267-9d52-451309379b2d tempest-CinderUnicodeTest-1201326799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:13:42 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-158e0cfb-c32f-4267-9d52-451309379b2d tempest-CinderUnicodeTest-1201326799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:13:42 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-158e0cfb-c32f-4267-9d52-451309379b2d tempest-CinderUnicodeTest-1201326799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:13:42 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-158e0cfb-c32f-4267-9d52-451309379b2d tempest-CinderUnicodeTest-1201326799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:13:42 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-158e0cfb-c32f-4267-9d52-451309379b2d tempest-CinderUnicodeTest-1201326799 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 16:13:42 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-158e0cfb-c32f-4267-9d52-451309379b2d tempest-CinderUnicodeTest-1201326799 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 16:13:42 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-158e0cfb-c32f-4267-9d52-451309379b2d tempest-CinderUnicodeTest-1201326799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-80113733-1004-4b52-95eb-21007f4b710f 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:42 devstack sudo[112021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-80113733-1004-4b52-95eb-21007f4b710f 1073741824
Jun 15 16:13:42 devstack sudo[112021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:43 devstack sudo[112021]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:43 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-158e0cfb-c32f-4267-9d52-451309379b2d tempest-CinderUnicodeTest-1201326799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-80113733-1004-4b52-95eb-21007f4b710f 1073741824" returned: 0 in 0.850s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:43 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-158e0cfb-c32f-4267-9d52-451309379b2d tempest-CinderUnicodeTest-1201326799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-80113733-1004-4b52-95eb-21007f4b710f {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:43 devstack sudo[112027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-80113733-1004-4b52-95eb-21007f4b710f
Jun 15 16:13:43 devstack sudo[112027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:44 devstack sudo[112027]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:44 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-158e0cfb-c32f-4267-9d52-451309379b2d tempest-CinderUnicodeTest-1201326799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-80113733-1004-4b52-95eb-21007f4b710f" returned: 0 in 0.594s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:44 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-158e0cfb-c32f-4267-9d52-451309379b2d tempest-CinderUnicodeTest-1201326799 None] <== create_volume: return (1498ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 16:13:44 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-158e0cfb-c32f-4267-9d52-451309379b2d tempest-CinderUnicodeTest-1201326799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.503s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:13:44 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-158e0cfb-c32f-4267-9d52-451309379b2d tempest-CinderUnicodeTest-1201326799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edb07586-ff6b-43d3-8a7f-24969d25cc62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80113733-1004-4b52-95eb-21007f4b710f', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:13:44 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-158e0cfb-c32f-4267-9d52-451309379b2d tempest-CinderUnicodeTest-1201326799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54d4441d-f800-4fd1-8d73-5098ab4a411b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:13:44 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-158e0cfb-c32f-4267-9d52-451309379b2d tempest-CinderUnicodeTest-1201326799 None] Volume volume-80113733-1004-4b52-95eb-21007f4b710f (80113733-1004-4b52-95eb-21007f4b710f): created successfully
Jun 15 16:13:44 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-158e0cfb-c32f-4267-9d52-451309379b2d tempest-CinderUnicodeTest-1201326799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54d4441d-f800-4fd1-8d73-5098ab4a411b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:13:44 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-158e0cfb-c32f-4267-9d52-451309379b2d tempest-CinderUnicodeTest-1201326799 None] Flow 'volume_create_manager' (0993d05f-742d-46c8-8d26-e538c44a4ff8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:13:44 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-158e0cfb-c32f-4267-9d52-451309379b2d tempest-CinderUnicodeTest-1201326799 None] Created volume successfully.
Jun 15 16:13:45 devstack cinder-volume[91863]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a9033bf-7069-4049-8752-ab7b78c08b76 tempest-CinderUnicodeTest-1201326799 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 15 16:13:45 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-4a9033bf-7069-4049-8752-ab7b78c08b76 tempest-CinderUnicodeTest-1201326799 None] Flow 'volume_create_manager' (ad2f4b9a-c539-4ae4-94ed-cd3c20d8358e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:13:45 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-4a9033bf-7069-4049-8752-ab7b78c08b76 tempest-CinderUnicodeTest-1201326799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5baaec48-da67-484d-9c55-9652d56e5256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:13:45 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-4a9033bf-7069-4049-8752-ab7b78c08b76 tempest-CinderUnicodeTest-1201326799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5baaec48-da67-484d-9c55-9652d56e5256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:13:45Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1705048857',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0b38858-b2c2-41f5-b9b3-1720e8d367c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b4c89082e964ac2bebd4cd5a486bddf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:13:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:13:45Z,use_quota=True,user_id='9bf6817ebf664f3d94097dcaf9c3c578',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:13:45 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-4a9033bf-7069-4049-8752-ab7b78c08b76 tempest-CinderUnicodeTest-1201326799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7766324f-ee08-46b1-8c9b-03b113cf8b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:13:45 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-4a9033bf-7069-4049-8752-ab7b78c08b76 tempest-CinderUnicodeTest-1201326799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7766324f-ee08-46b1-8c9b-03b113cf8b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:13:45 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-4a9033bf-7069-4049-8752-ab7b78c08b76 tempest-CinderUnicodeTest-1201326799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17be2c48-b9dc-44e0-b0b0-244d89846659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:13:45 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-4a9033bf-7069-4049-8752-ab7b78c08b76 tempest-CinderUnicodeTest-1201326799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17be2c48-b9dc-44e0-b0b0-244d89846659) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0b38858-b2c2-41f5-b9b3-1720e8d367c7', 'volume_name': 'volume-f0b38858-b2c2-41f5-b9b3-1720e8d367c7', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:13:45 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-4a9033bf-7069-4049-8752-ab7b78c08b76 tempest-CinderUnicodeTest-1201326799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c184be7-cf79-45f0-a721-bec92689f7be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:13:45 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-4a9033bf-7069-4049-8752-ab7b78c08b76 tempest-CinderUnicodeTest-1201326799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c184be7-cf79-45f0-a721-bec92689f7be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:13:45 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-4a9033bf-7069-4049-8752-ab7b78c08b76 tempest-CinderUnicodeTest-1201326799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2e3284b-be17-451b-b160-77c40c2cb9f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:13:45 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-4a9033bf-7069-4049-8752-ab7b78c08b76 tempest-CinderUnicodeTest-1201326799 None] Volume f0b38858-b2c2-41f5-b9b3-1720e8d367c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0b38858-b2c2-41f5-b9b3-1720e8d367c7', 'volume_size': 1}
Jun 15 16:13:45 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-4a9033bf-7069-4049-8752-ab7b78c08b76 tempest-CinderUnicodeTest-1201326799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:13:45 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-4a9033bf-7069-4049-8752-ab7b78c08b76 tempest-CinderUnicodeTest-1201326799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:13:45 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-4a9033bf-7069-4049-8752-ab7b78c08b76 tempest-CinderUnicodeTest-1201326799 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x773955123bc0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-15T14:13:45Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1705048857',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0b38858-b2c2-41f5-b9b3-1720e8d367c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b4c89082e964ac2bebd4cd5a486bddf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T14:13:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T14:13:45Z,use_quota=True,user_id='9bf6817ebf664f3d94097dcaf9c3c578',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2639ebe-cfee-407e-8f68-ddec7c8e780b),volume_type_id=f2639ebe-cfee-407e-8f68-ddec7c8e780b)}" {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 15 16:13:45 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-4a9033bf-7069-4049-8752-ab7b78c08b76 tempest-CinderUnicodeTest-1201326799 None] Creating volume f0b38858-b2c2-41f5-b9b3-1720e8d367c7 {{(pid=91863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 15 16:13:45 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-4a9033bf-7069-4049-8752-ab7b78c08b76 tempest-CinderUnicodeTest-1201326799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:13:45 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-4a9033bf-7069-4049-8752-ab7b78c08b76 tempest-CinderUnicodeTest-1201326799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:13:45 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-4a9033bf-7069-4049-8752-ab7b78c08b76 tempest-CinderUnicodeTest-1201326799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:13:45 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-4a9033bf-7069-4049-8752-ab7b78c08b76 tempest-CinderUnicodeTest-1201326799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:13:45 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-4a9033bf-7069-4049-8752-ab7b78c08b76 tempest-CinderUnicodeTest-1201326799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:13:45 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-4a9033bf-7069-4049-8752-ab7b78c08b76 tempest-CinderUnicodeTest-1201326799 None] Selected osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc as target Quobyte volume. {{(pid=91863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 15 16:13:45 devstack cinder-volume[91863]: INFO cinder.volume.drivers.remotefs [None req-4a9033bf-7069-4049-8752-ab7b78c08b76 tempest-CinderUnicodeTest-1201326799 None] casted to osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc
Jun 15 16:13:45 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-4a9033bf-7069-4049-8752-ab7b78c08b76 tempest-CinderUnicodeTest-1201326799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-f0b38858-b2c2-41f5-b9b3-1720e8d367c7 1073741824 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:45 devstack sudo[112032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-f0b38858-b2c2-41f5-b9b3-1720e8d367c7 1073741824
Jun 15 16:13:45 devstack sudo[112032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:46 devstack sudo[112032]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:46 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-4a9033bf-7069-4049-8752-ab7b78c08b76 tempest-CinderUnicodeTest-1201326799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-f0b38858-b2c2-41f5-b9b3-1720e8d367c7 1073741824" returned: 0 in 0.737s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:46 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-4a9033bf-7069-4049-8752-ab7b78c08b76 tempest-CinderUnicodeTest-1201326799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-f0b38858-b2c2-41f5-b9b3-1720e8d367c7 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:46 devstack sudo[112037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-f0b38858-b2c2-41f5-b9b3-1720e8d367c7
Jun 15 16:13:46 devstack sudo[112037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:46 devstack sudo[112037]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:46 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-4a9033bf-7069-4049-8752-ab7b78c08b76 tempest-CinderUnicodeTest-1201326799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-f0b38858-b2c2-41f5-b9b3-1720e8d367c7" returned: 0 in 0.557s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:46 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-4a9033bf-7069-4049-8752-ab7b78c08b76 tempest-CinderUnicodeTest-1201326799 None] <== create_volume: return (1336ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'} {{(pid=91863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 15 16:13:46 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-4a9033bf-7069-4049-8752-ab7b78c08b76 tempest-CinderUnicodeTest-1201326799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.339s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:13:46 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-4a9033bf-7069-4049-8752-ab7b78c08b76 tempest-CinderUnicodeTest-1201326799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2e3284b-be17-451b-b160-77c40c2cb9f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0b38858-b2c2-41f5-b9b3-1720e8d367c7', 'volume_size': 1}' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:13:46 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-4a9033bf-7069-4049-8752-ab7b78c08b76 tempest-CinderUnicodeTest-1201326799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28d9e3b5-71e6-4cf2-adc6-a56d2d614081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Jun 15 16:13:46 devstack cinder-volume[91863]: INFO cinder.volume.flows.manager.create_volume [None req-4a9033bf-7069-4049-8752-ab7b78c08b76 tempest-CinderUnicodeTest-1201326799 None] Volume volume-f0b38858-b2c2-41f5-b9b3-1720e8d367c7 (f0b38858-b2c2-41f5-b9b3-1720e8d367c7): created successfully
Jun 15 16:13:46 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-4a9033bf-7069-4049-8752-ab7b78c08b76 tempest-CinderUnicodeTest-1201326799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28d9e3b5-71e6-4cf2-adc6-a56d2d614081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Jun 15 16:13:46 devstack cinder-volume[91863]: DEBUG cinder.volume.manager [None req-4a9033bf-7069-4049-8752-ab7b78c08b76 tempest-CinderUnicodeTest-1201326799 None] Flow 'volume_create_manager' (ad2f4b9a-c539-4ae4-94ed-cd3c20d8358e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Jun 15 16:13:46 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-4a9033bf-7069-4049-8752-ab7b78c08b76 tempest-CinderUnicodeTest-1201326799 None] Created volume successfully.
Jun 15 16:13:47 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-c5941569-3780-4b47-bf16-149e2c03e7f6 tempest-CinderUnicodeTest-1201326799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:13:47 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-c5941569-3780-4b47-bf16-149e2c03e7f6 tempest-CinderUnicodeTest-1201326799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:13:47 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-c5941569-3780-4b47-bf16-149e2c03e7f6 tempest-CinderUnicodeTest-1201326799 None] Creating offline snapshot 538b5e67-33c1-4c38-82a5-48a9057f3be2 of volume f0b38858-b2c2-41f5-b9b3-1720e8d367c7 {{(pid=91863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 15 16:13:47 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f203ab57-c65c-42bc-8201-65c3b720d9a4]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:13:47 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c5941569-3780-4b47-bf16-149e2c03e7f6 tempest-CinderUnicodeTest-1201326799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-f0b38858-b2c2-41f5-b9b3-1720e8d367c7 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:47 devstack sudo[112040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-f0b38858-b2c2-41f5-b9b3-1720e8d367c7
Jun 15 16:13:47 devstack sudo[112040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:48 devstack sudo[112040]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:48 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c5941569-3780-4b47-bf16-149e2c03e7f6 tempest-CinderUnicodeTest-1201326799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-f0b38858-b2c2-41f5-b9b3-1720e8d367c7" returned: 0 in 0.673s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:48 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c5941569-3780-4b47-bf16-149e2c03e7f6 tempest-CinderUnicodeTest-1201326799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-f0b38858-b2c2-41f5-b9b3-1720e8d367c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-f0b38858-b2c2-41f5-b9b3-1720e8d367c7.538b5e67-33c1-4c38-82a5-48a9057f3be2 1G {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:48 devstack sudo[112046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-f0b38858-b2c2-41f5-b9b3-1720e8d367c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-f0b38858-b2c2-41f5-b9b3-1720e8d367c7.538b5e67-33c1-4c38-82a5-48a9057f3be2 1G
Jun 15 16:13:48 devstack sudo[112046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:49 devstack sudo[112046]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:49 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c5941569-3780-4b47-bf16-149e2c03e7f6 tempest-CinderUnicodeTest-1201326799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-f0b38858-b2c2-41f5-b9b3-1720e8d367c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-f0b38858-b2c2-41f5-b9b3-1720e8d367c7.538b5e67-33c1-4c38-82a5-48a9057f3be2 1G" returned: 0 in 0.715s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:49 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c5941569-3780-4b47-bf16-149e2c03e7f6 tempest-CinderUnicodeTest-1201326799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0b38858-b2c2-41f5-b9b3-1720e8d367c7 -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-f0b38858-b2c2-41f5-b9b3-1720e8d367c7.538b5e67-33c1-4c38-82a5-48a9057f3be2 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:49 devstack sudo[112051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0b38858-b2c2-41f5-b9b3-1720e8d367c7 -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-f0b38858-b2c2-41f5-b9b3-1720e8d367c7.538b5e67-33c1-4c38-82a5-48a9057f3be2
Jun 15 16:13:49 devstack sudo[112051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:49 devstack sudo[112051]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:49 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c5941569-3780-4b47-bf16-149e2c03e7f6 tempest-CinderUnicodeTest-1201326799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0b38858-b2c2-41f5-b9b3-1720e8d367c7 -F qcow2 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-f0b38858-b2c2-41f5-b9b3-1720e8d367c7.538b5e67-33c1-4c38-82a5-48a9057f3be2" returned: 0 in 0.622s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:49 devstack cinder-volume[91863]: WARNING cinder.volume.drivers.remotefs [None req-c5941569-3780-4b47-bf16-149e2c03e7f6 tempest-CinderUnicodeTest-1201326799 None] /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-f0b38858-b2c2-41f5-b9b3-1720e8d367c7.538b5e67-33c1-4c38-82a5-48a9057f3be2 is being set with open permissions: ugo+rw
Jun 15 16:13:49 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c5941569-3780-4b47-bf16-149e2c03e7f6 tempest-CinderUnicodeTest-1201326799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-f0b38858-b2c2-41f5-b9b3-1720e8d367c7.538b5e67-33c1-4c38-82a5-48a9057f3be2 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:49 devstack sudo[112056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-f0b38858-b2c2-41f5-b9b3-1720e8d367c7.538b5e67-33c1-4c38-82a5-48a9057f3be2
Jun 15 16:13:49 devstack sudo[112056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:50 devstack sudo[112056]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:50 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c5941569-3780-4b47-bf16-149e2c03e7f6 tempest-CinderUnicodeTest-1201326799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-f0b38858-b2c2-41f5-b9b3-1720e8d367c7.538b5e67-33c1-4c38-82a5-48a9057f3be2" returned: 0 in 0.594s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:50 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c5941569-3780-4b47-bf16-149e2c03e7f6 tempest-CinderUnicodeTest-1201326799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-f0b38858-b2c2-41f5-b9b3-1720e8d367c7.info {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:50 devstack sudo[112061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-f0b38858-b2c2-41f5-b9b3-1720e8d367c7.info
Jun 15 16:13:50 devstack sudo[112061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:51 devstack sudo[112061]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:51 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c5941569-3780-4b47-bf16-149e2c03e7f6 tempest-CinderUnicodeTest-1201326799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-f0b38858-b2c2-41f5-b9b3-1720e8d367c7.info" returned: 0 in 0.586s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:51 devstack cinder-volume[91863]: WARNING cinder.volume.drivers.remotefs [None req-c5941569-3780-4b47-bf16-149e2c03e7f6 tempest-CinderUnicodeTest-1201326799 None] /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-f0b38858-b2c2-41f5-b9b3-1720e8d367c7.info is being set with open permissions: ugo+rw
Jun 15 16:13:51 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c5941569-3780-4b47-bf16-149e2c03e7f6 tempest-CinderUnicodeTest-1201326799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-f0b38858-b2c2-41f5-b9b3-1720e8d367c7.info {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:51 devstack sudo[112064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-f0b38858-b2c2-41f5-b9b3-1720e8d367c7.info
Jun 15 16:13:51 devstack sudo[112064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:51 devstack sudo[112064]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:51 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c5941569-3780-4b47-bf16-149e2c03e7f6 tempest-CinderUnicodeTest-1201326799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-f0b38858-b2c2-41f5-b9b3-1720e8d367c7.info" returned: 0 in 0.555s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:51 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-c5941569-3780-4b47-bf16-149e2c03e7f6 tempest-CinderUnicodeTest-1201326799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.826s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:13:51 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-c5941569-3780-4b47-bf16-149e2c03e7f6 tempest-CinderUnicodeTest-1201326799 None] Create snapshot completed successfully
Jun 15 16:13:51 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-393447af-3cc0-4bf5-9bbd-dbe174e19dcc tempest-CinderUnicodeTest-1201326799 None] Acquiring lock "cinder-538b5e67-33c1-4c38-82a5-48a9057f3be2-delete_snapshot" by "delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:13:51 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-393447af-3cc0-4bf5-9bbd-dbe174e19dcc tempest-CinderUnicodeTest-1201326799 None] Lock "cinder-538b5e67-33c1-4c38-82a5-48a9057f3be2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:13:51 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-393447af-3cc0-4bf5-9bbd-dbe174e19dcc tempest-CinderUnicodeTest-1201326799 None] Acquiring lock "cinder-quobyte-f0b38858-b2c2-41f5-b9b3-1720e8d367c7" by "delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:13:51 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-393447af-3cc0-4bf5-9bbd-dbe174e19dcc tempest-CinderUnicodeTest-1201326799 None] Lock "cinder-quobyte-f0b38858-b2c2-41f5-b9b3-1720e8d367c7" acquired by "delete_snapshot" :: waited 0.015s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:13:51 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-393447af-3cc0-4bf5-9bbd-dbe174e19dcc tempest-CinderUnicodeTest-1201326799 None] Acquiring lock "cinder-quobyte-538b5e67-33c1-4c38-82a5-48a9057f3be2" by "_delete_snapshot" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:13:52 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-393447af-3cc0-4bf5-9bbd-dbe174e19dcc tempest-CinderUnicodeTest-1201326799 None] Lock "cinder-quobyte-538b5e67-33c1-4c38-82a5-48a9057f3be2" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:13:52 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-393447af-3cc0-4bf5-9bbd-dbe174e19dcc tempest-CinderUnicodeTest-1201326799 None] Deleting offline snapshot 538b5e67-33c1-4c38-82a5-48a9057f3be2 of volume f0b38858-b2c2-41f5-b9b3-1720e8d367c7 {{(pid=91863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 15 16:13:52 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-393447af-3cc0-4bf5-9bbd-dbe174e19dcc tempest-CinderUnicodeTest-1201326799 None] snapshot_file for this snap is: volume-f0b38858-b2c2-41f5-b9b3-1720e8d367c7.538b5e67-33c1-4c38-82a5-48a9057f3be2 {{(pid=91863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 15 16:13:52 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c8bef8-e246-4027-874f-19587159f540]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:13:52 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-393447af-3cc0-4bf5-9bbd-dbe174e19dcc tempest-CinderUnicodeTest-1201326799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-f0b38858-b2c2-41f5-b9b3-1720e8d367c7.538b5e67-33c1-4c38-82a5-48a9057f3be2 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:52 devstack sudo[112069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-f0b38858-b2c2-41f5-b9b3-1720e8d367c7.538b5e67-33c1-4c38-82a5-48a9057f3be2
Jun 15 16:13:52 devstack sudo[112069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:52 devstack sudo[112069]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:52 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-393447af-3cc0-4bf5-9bbd-dbe174e19dcc tempest-CinderUnicodeTest-1201326799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-f0b38858-b2c2-41f5-b9b3-1720e8d367c7.538b5e67-33c1-4c38-82a5-48a9057f3be2" returned: 0 in 0.674s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:52 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.remotefs [None req-393447af-3cc0-4bf5-9bbd-dbe174e19dcc tempest-CinderUnicodeTest-1201326799 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f0b38858-b2c2-41f5-b9b3-1720e8d367c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 15 16:13:52 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[55272e6d-9101-42e7-b545-e6ac71f4df49]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:13:52 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-393447af-3cc0-4bf5-9bbd-dbe174e19dcc tempest-CinderUnicodeTest-1201326799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-f0b38858-b2c2-41f5-b9b3-1720e8d367c7 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:52 devstack sudo[112074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-f0b38858-b2c2-41f5-b9b3-1720e8d367c7
Jun 15 16:13:52 devstack sudo[112074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:53 devstack sudo[112074]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:53 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-393447af-3cc0-4bf5-9bbd-dbe174e19dcc tempest-CinderUnicodeTest-1201326799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-f0b38858-b2c2-41f5-b9b3-1720e8d367c7" returned: 0 in 0.674s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:53 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-393447af-3cc0-4bf5-9bbd-dbe174e19dcc tempest-CinderUnicodeTest-1201326799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-f0b38858-b2c2-41f5-b9b3-1720e8d367c7.538b5e67-33c1-4c38-82a5-48a9057f3be2 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:53 devstack sudo[112079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-f0b38858-b2c2-41f5-b9b3-1720e8d367c7.538b5e67-33c1-4c38-82a5-48a9057f3be2
Jun 15 16:13:53 devstack sudo[112079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:54 devstack sudo[112079]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:54 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-393447af-3cc0-4bf5-9bbd-dbe174e19dcc tempest-CinderUnicodeTest-1201326799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-f0b38858-b2c2-41f5-b9b3-1720e8d367c7.538b5e67-33c1-4c38-82a5-48a9057f3be2" returned: 0 in 0.664s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:54 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-393447af-3cc0-4bf5-9bbd-dbe174e19dcc tempest-CinderUnicodeTest-1201326799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-f0b38858-b2c2-41f5-b9b3-1720e8d367c7.538b5e67-33c1-4c38-82a5-48a9057f3be2 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:54 devstack sudo[112084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-f0b38858-b2c2-41f5-b9b3-1720e8d367c7.538b5e67-33c1-4c38-82a5-48a9057f3be2
Jun 15 16:13:54 devstack sudo[112084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:54 devstack sudo[112084]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:54 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-393447af-3cc0-4bf5-9bbd-dbe174e19dcc tempest-CinderUnicodeTest-1201326799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-f0b38858-b2c2-41f5-b9b3-1720e8d367c7.538b5e67-33c1-4c38-82a5-48a9057f3be2" returned: 0 in 0.579s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:54 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-393447af-3cc0-4bf5-9bbd-dbe174e19dcc tempest-CinderUnicodeTest-1201326799 None] Lock "cinder-quobyte-538b5e67-33c1-4c38-82a5-48a9057f3be2" released by "_delete_snapshot" :: held 2.691s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:13:54 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-393447af-3cc0-4bf5-9bbd-dbe174e19dcc tempest-CinderUnicodeTest-1201326799 None] Lock "cinder-quobyte-f0b38858-b2c2-41f5-b9b3-1720e8d367c7" released by "delete_snapshot" :: held 2.712s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:13:54 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-393447af-3cc0-4bf5-9bbd-dbe174e19dcc tempest-CinderUnicodeTest-1201326799 None] Created reservations ['377cfff4-4a5a-441a-8d84-bb4212a8fbac', '2e08499c-ea5b-44ba-b959-239191cc6a77', '4f3cf44f-dbe2-4efc-b66e-a43513b2b91c', '11c45572-41cd-4eca-85c3-27a011955acc'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 16:13:54 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-393447af-3cc0-4bf5-9bbd-dbe174e19dcc tempest-CinderUnicodeTest-1201326799 None] Delete snapshot completed successfully.
Jun 15 16:13:54 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-393447af-3cc0-4bf5-9bbd-dbe174e19dcc tempest-CinderUnicodeTest-1201326799 None] Lock "cinder-538b5e67-33c1-4c38-82a5-48a9057f3be2-delete_snapshot" released by "delete_snapshot" :: held 2.846s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:13:55 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-c74d090b-4f00-42b2-95cb-058f4adc060f tempest-CinderUnicodeTest-1201326799 None] Acquiring lock "cinder-f0b38858-b2c2-41f5-b9b3-1720e8d367c7-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:13:55 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-c74d090b-4f00-42b2-95cb-058f4adc060f tempest-CinderUnicodeTest-1201326799 None] Lock "cinder-f0b38858-b2c2-41f5-b9b3-1720e8d367c7-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:13:55 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-c74d090b-4f00-42b2-95cb-058f4adc060f tempest-CinderUnicodeTest-1201326799 None] Acquiring lock "cinder-quobyte-f0b38858-b2c2-41f5-b9b3-1720e8d367c7" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:13:55 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-c74d090b-4f00-42b2-95cb-058f4adc060f tempest-CinderUnicodeTest-1201326799 None] Lock "cinder-quobyte-f0b38858-b2c2-41f5-b9b3-1720e8d367c7" acquired by "delete_volume" :: waited 0.016s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:13:55 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c1ce7e-6adc-4a32-abed-3d76d3ae9940]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:13:55 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c74d090b-4f00-42b2-95cb-058f4adc060f tempest-CinderUnicodeTest-1201326799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-f0b38858-b2c2-41f5-b9b3-1720e8d367c7 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:55 devstack sudo[112088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-f0b38858-b2c2-41f5-b9b3-1720e8d367c7
Jun 15 16:13:55 devstack sudo[112088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:55 devstack sudo[112088]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:55 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c74d090b-4f00-42b2-95cb-058f4adc060f tempest-CinderUnicodeTest-1201326799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-f0b38858-b2c2-41f5-b9b3-1720e8d367c7" returned: 0 in 0.695s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:55 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c74d090b-4f00-42b2-95cb-058f4adc060f tempest-CinderUnicodeTest-1201326799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-f0b38858-b2c2-41f5-b9b3-1720e8d367c7 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:55 devstack sudo[112093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-f0b38858-b2c2-41f5-b9b3-1720e8d367c7
Jun 15 16:13:55 devstack sudo[112093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:56 devstack sudo[112093]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:56 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c74d090b-4f00-42b2-95cb-058f4adc060f tempest-CinderUnicodeTest-1201326799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-f0b38858-b2c2-41f5-b9b3-1720e8d367c7" returned: 0 in 0.588s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:56 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-c74d090b-4f00-42b2-95cb-058f4adc060f tempest-CinderUnicodeTest-1201326799 None] Lock "cinder-quobyte-f0b38858-b2c2-41f5-b9b3-1720e8d367c7" released by "delete_volume" :: held 1.339s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:13:56 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-c74d090b-4f00-42b2-95cb-058f4adc060f tempest-CinderUnicodeTest-1201326799 None] Created reservations ['9b784266-2bc4-43d2-8c89-7244c9248e87', '70a55c50-a86e-4dd7-8ced-0dd3fb0e9f2b', 'fcfbc9c4-d25f-4f7a-bb20-8f9acde4fdec', 'c10c8343-4fc9-45fc-b401-32d81cba8038'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 16:13:56 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-c74d090b-4f00-42b2-95cb-058f4adc060f tempest-CinderUnicodeTest-1201326799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:13:56 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-c74d090b-4f00-42b2-95cb-058f4adc060f tempest-CinderUnicodeTest-1201326799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:13:56 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-c74d090b-4f00-42b2-95cb-058f4adc060f tempest-CinderUnicodeTest-1201326799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:13:56 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-c74d090b-4f00-42b2-95cb-058f4adc060f tempest-CinderUnicodeTest-1201326799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:13:56 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-c74d090b-4f00-42b2-95cb-058f4adc060f tempest-CinderUnicodeTest-1201326799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:13:56 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c74d090b-4f00-42b2-95cb-058f4adc060f tempest-CinderUnicodeTest-1201326799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:56 devstack sudo[112096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 16:13:56 devstack sudo[112096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:57 devstack sudo[112096]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:57 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-c74d090b-4f00-42b2-95cb-058f4adc060f tempest-CinderUnicodeTest-1201326799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.587s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:57 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-c74d090b-4f00-42b2-95cb-058f4adc060f tempest-CinderUnicodeTest-1201326799 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 16:13:57 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-c74d090b-4f00-42b2-95cb-058f4adc060f tempest-CinderUnicodeTest-1201326799 None] Deleted volume successfully.
Jun 15 16:13:57 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-c74d090b-4f00-42b2-95cb-058f4adc060f tempest-CinderUnicodeTest-1201326799 None] Lock "cinder-f0b38858-b2c2-41f5-b9b3-1720e8d367c7-delete_volume" released by "delete_volume" :: held 2.123s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:13:57 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-fbd51ea9-8c5d-46ef-9f91-8ad3a4dc37ed tempest-CinderUnicodeTest-1201326799 None] Acquiring lock "cinder-80113733-1004-4b52-95eb-21007f4b710f-delete_volume" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:13:57 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-fbd51ea9-8c5d-46ef-9f91-8ad3a4dc37ed tempest-CinderUnicodeTest-1201326799 None] Lock "cinder-80113733-1004-4b52-95eb-21007f4b710f-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:13:57 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-fbd51ea9-8c5d-46ef-9f91-8ad3a4dc37ed tempest-CinderUnicodeTest-1201326799 None] Acquiring lock "cinder-quobyte-80113733-1004-4b52-95eb-21007f4b710f" by "delete_volume" {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 15 16:13:57 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-fbd51ea9-8c5d-46ef-9f91-8ad3a4dc37ed tempest-CinderUnicodeTest-1201326799 None] Lock "cinder-quobyte-80113733-1004-4b52-95eb-21007f4b710f" acquired by "delete_volume" :: waited 0.013s {{(pid=91863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 15 16:13:57 devstack cinder-volume[91863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0aa2c54-d1d5-4a2d-8dd5-ebc0075ff7e3]: (4, 'qcow2') {{(pid=93229) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Jun 15 16:13:57 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-fbd51ea9-8c5d-46ef-9f91-8ad3a4dc37ed tempest-CinderUnicodeTest-1201326799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-80113733-1004-4b52-95eb-21007f4b710f {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:57 devstack sudo[112099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-80113733-1004-4b52-95eb-21007f4b710f
Jun 15 16:13:57 devstack sudo[112099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:58 devstack sudo[112099]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:58 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-fbd51ea9-8c5d-46ef-9f91-8ad3a4dc37ed tempest-CinderUnicodeTest-1201326799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-80113733-1004-4b52-95eb-21007f4b710f" returned: 0 in 0.695s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:58 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-fbd51ea9-8c5d-46ef-9f91-8ad3a4dc37ed tempest-CinderUnicodeTest-1201326799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-80113733-1004-4b52-95eb-21007f4b710f {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:58 devstack sudo[112104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-80113733-1004-4b52-95eb-21007f4b710f
Jun 15 16:13:58 devstack sudo[112104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:58 devstack sudo[112104]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:58 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-fbd51ea9-8c5d-46ef-9f91-8ad3a4dc37ed tempest-CinderUnicodeTest-1201326799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54/volume-80113733-1004-4b52-95eb-21007f4b710f" returned: 0 in 0.594s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:58 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-fbd51ea9-8c5d-46ef-9f91-8ad3a4dc37ed tempest-CinderUnicodeTest-1201326799 None] Lock "cinder-quobyte-80113733-1004-4b52-95eb-21007f4b710f" released by "delete_volume" :: held 1.324s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:13:58 devstack cinder-volume[91863]: DEBUG cinder.quota [None req-fbd51ea9-8c5d-46ef-9f91-8ad3a4dc37ed tempest-CinderUnicodeTest-1201326799 None] Created reservations ['d97fd8cd-05d4-4085-abb4-30e8770960d5', 'ea269a4b-0515-4ec6-bb8f-6f2c08b098be', '5d266531-ee7c-4943-b6f0-518b4f2d1be9', '3bc20a97-d9ff-444a-859b-7da0cda27d50'] {{(pid=91863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 15 16:13:58 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-fbd51ea9-8c5d-46ef-9f91-8ad3a4dc37ed tempest-CinderUnicodeTest-1201326799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Jun 15 16:13:58 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-fbd51ea9-8c5d-46ef-9f91-8ad3a4dc37ed tempest-CinderUnicodeTest-1201326799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Jun 15 16:13:58 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-fbd51ea9-8c5d-46ef-9f91-8ad3a4dc37ed tempest-CinderUnicodeTest-1201326799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc': None} {{(pid=91863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 15 16:13:58 devstack cinder-volume[91863]: DEBUG cinder.volume.drivers.quobyte [None req-fbd51ea9-8c5d-46ef-9f91-8ad3a4dc37ed tempest-CinderUnicodeTest-1201326799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1bb4d4a-a26d-4cbd-bcdd-0449c92294cc'] {{(pid=91863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 15 16:13:58 devstack cinder-volume[91863]: DEBUG oslo_concurrency.lockutils [None req-fbd51ea9-8c5d-46ef-9f91-8ad3a4dc37ed tempest-CinderUnicodeTest-1201326799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Jun 15 16:13:58 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-fbd51ea9-8c5d-46ef-9f91-8ad3a4dc37ed tempest-CinderUnicodeTest-1201326799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54 {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 15 16:13:58 devstack sudo[112107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54
Jun 15 16:13:58 devstack sudo[112107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 15 16:13:59 devstack sudo[112107]: pam_unix(sudo:session): session closed for user root
Jun 15 16:13:59 devstack cinder-volume[91863]: DEBUG oslo_concurrency.processutils [None req-fbd51ea9-8c5d-46ef-9f91-8ad3a4dc37ed tempest-CinderUnicodeTest-1201326799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca40c863312585d696c46500505c6e54" returned: 0 in 0.586s {{(pid=91863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 15 16:13:59 devstack cinder-volume[91863]: DEBUG cinder.manager [None req-fbd51ea9-8c5d-46ef-9f91-8ad3a4dc37ed tempest-CinderUnicodeTest-1201326799 None] Notifying Schedulers of capabilities ... {{(pid=91863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 15 16:13:59 devstack cinder-volume[91863]: INFO cinder.volume.manager [None req-fbd51ea9-8c5d-46ef-9f91-8ad3a4dc37ed tempest-CinderUnicodeTest-1201326799 None] Deleted volume successfully.
Jun 15 16:13:59 devstack cinder-volume[91863]: DEBUG cinder.coordination [None req-fbd51ea9-8c5d-46ef-9f91-8ad3a4dc37ed tempest-CinderUnicodeTest-1201326799 None] Lock "cinder-80113733-1004-4b52-95eb-21007f4b710f-delete_volume" released by "delete_volume" :: held 2.100s {{(pid=91863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 15 16:14:08 devstack cinder-volume[91863]: DEBUG dbcounter [-] [91863] Writing DB stats cinder:SELECT=118,cinder:UPDATE=147,cinder:DELETE=13,cinder:INSERT=37 {{(pid=91863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 15 16:14:09 devstack cinder-volume[91863]: DEBUG dbcounter [-] [91863] Writing DB stats cinder:SELECT=91,cinder:UPDATE=146,cinder:INSERT=35,cinder:DELETE=12 {{(pid=91863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}